Aug 26 14:16:29 devstack cinder-volume[83138]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Aug 26 14:16:29 devstack cinder-volume[83138]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 26 14:16:29 devstack cinder-volume[83138]: we strongly recommend against using it for new projects. Aug 26 14:16:29 devstack cinder-volume[83138]: If you are already using Eventlet, we recommend migrating to a different Aug 26 14:16:29 devstack cinder-volume[83138]: framework. For more detail see Aug 26 14:16:29 devstack cinder-volume[83138]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 26 14:16:29 devstack cinder-volume[83138]: import eventlet # noqa Aug 26 14:16:32 devstack cinder-volume[83138]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=83138) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 26 14:16:32 devstack cinder-volume[83138]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=83138) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 26 14:16:32 devstack cinder-volume[83138]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=83138) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 26 14:16:33 devstack cinder-volume[83138]: INFO dbcounter [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] Registered counter for database cinder Aug 26 14:16:33 devstack cinder-volume[83138]: DEBUG oslo_db.sqlalchemy.engines [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83138) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 26 14:16:33 devstack cinder-volume[83138]: DEBUG dbcounter [-] [83138] Writer thread running {{(pid=83138) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 26 14:16:33 devstack cinder-volume[83138]: INFO cinder.rpc [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Aug 26 14:16:33 devstack cinder-volume[83138]: INFO cinder.rpc [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Aug 26 14:16:33 devstack cinder-volume[83138]: DEBUG oslo_db.sqlalchemy.engines [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83138) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 26 14:16:33 devstack cinder-volume[83138]: INFO cinder.volume.manager [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] Determined volume DB was empty at startup. Aug 26 14:16:33 devstack cinder-volume[83138]: DEBUG cinder.volume.manager [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=83138) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Aug 26 14:16:33 devstack cinder-volume[83138]: INFO cinder.volume.manager [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] Service not found for updating active_backend_id, assuming default for driver init. Aug 26 14:16:33 devstack cinder-volume[83138]: WARNING stevedore.named [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 26 14:16:33 devstack cinder-volume[83138]: WARNING castellan.key_manager [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 26 14:16:33 devstack cinder-volume[83138]: WARNING cinder.keymgr.conf_key_mgr [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 26 14:16:33 devstack cinder-volume[83138]: DEBUG cinder.volume.drivers.lvm [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=83138) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Aug 26 14:16:33 devstack cinder-volume[83138]: DEBUG oslo_concurrency.processutils [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=83138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_concurrency.processutils [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] CMD "cinder-rtstool verify" returned: 0 in 0.420s {{(pid=83138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_db.sqlalchemy.engines [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83138) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 26 14:16:34 devstack cinder-volume[83138]: INFO cinder.rpc [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Aug 26 14:16:34 devstack cinder-volume[83138]: INFO cinder.rpc [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Aug 26 14:16:34 devstack cinder-volume[83138]: WARNING stevedore.named [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 26 14:16:34 devstack cinder-volume[83138]: WARNING castellan.key_manager [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 26 14:16:34 devstack cinder-volume[83138]: INFO cinder.volume.manager [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_db.sqlalchemy.engines [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83138) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 26 14:16:34 devstack cinder-volume[83138]: INFO oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] Starting 1 workers Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] Started child 83289 {{(pid=83138) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] Full set of CONF: {{(pid=83138) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] ******************************************************************************** {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] Configuration options gathered from: {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] ================================================================================ {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] allow_availability_zone_fallback = False {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] allow_compression_on_image_upload = False {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] allowed_direct_url_schemes = [] {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] api_rate_limit = True {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] auth_strategy = keystone {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] az_cache_duration = 3600 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] backend_availability_zone = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] backend_host = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] backend_name = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] backend_stats_polling_interval = 60 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] backup_api_class = cinder.backup.api.API {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83289]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] backup_name_template = backup-%s {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] backup_use_same_host = False {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] backup_use_temp_snapshot = False {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] chap_password = **** {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] chap_username = {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] cinder_internal_tenant_project_id = 74cd0dea6428401d898b8535eb1abbbf {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] cinder_internal_tenant_user_id = 2cf395441d19444ea88d57af1aa42cdb {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] cloned_volume_same_az = True {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] cluster = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] compression_format = gzip {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] compute_api_class = cinder.compute.nova.API {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] config_dir = [] {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] config_source = [] {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] control_exchange = openstack {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] debug = True {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] default_availability_zone = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] default_group_type = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] default_volume_type = lvmdriver-1 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] disk_geometry = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] driver_client_cert = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] driver_client_cert_key = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] driver_data_namespace = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] driver_ssl_cert_path = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] driver_ssl_cert_verify = False {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] driver_use_ssl = False {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] enable_force_upload = False {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] enable_new_services = True {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] enable_unsupported_driver = False {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] enabled_backends = ['lvmdriver-1'] {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] enforce_multipath_for_image_xfer = False {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] filter_function = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] glance_api_insecure = False {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] glance_api_servers = ['http://192.168.122.164/image'] {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] glance_api_ssl_compression = False {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] glance_ca_certificates_file = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] glance_catalog_info = image:glance:publicURL {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] glance_certfile = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] glance_keyfile = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] glance_num_retries = 3 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] glance_request_timeout = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] goodness_function = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] graceful_shutdown_timeout = 5 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] group_api_class = cinder.group.api.API {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] host = devstack {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] image_compress_on_upload = True {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] image_conversion_address_space_limit = 1 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] image_conversion_cpu_limit = 60 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] image_conversion_disable = False {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] image_upload_use_cinder_backend = False {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] image_upload_use_internal_tenant = False {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] image_volume_cache_enabled = False {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] image_volume_cache_max_count = 0 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] image_volume_cache_max_size_gb = 0 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] init_host_max_objects_retrieval = 0 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] instance_format = [instance: %(uuid)s] {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] iscsi_target_flags = {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] iscsi_write_cache = on {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] iser_helper = tgtadm {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] iser_ip_address = 192.168.122.164 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] iser_port = 3260 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] log_color = False {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] log_config_append = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] log_dir = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] log_file = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] log_options = True {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] log_rotate_interval = 1 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] log_rotate_interval_type = days {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] log_rotation_type = none {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] max_age = 0 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] max_logfile_count = 30 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] max_logfile_size_mb = 200 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] max_over_subscription_ratio = 20.0 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] message_reap_interval = 86400 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] message_ttl = 2592000 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] migration_create_volume_timeout_secs = 300 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] monkey_patch = False {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] monkey_patch_modules = [] {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] my_ip = 192.168.122.164 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] no_snapshot_gb_quota = False {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] num_iser_scan_tries = 3 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] num_shell_tries = 3 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] num_volume_device_scan_tries = 3 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] nvmeof_conn_info_version = 1 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] nvmet_ns_id = 10 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] nvmet_port_id = 1 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] osapi_max_limit = 1000 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] osapi_volume_ext_list = [] {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] osapi_volume_listen = 0.0.0.0 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] osapi_volume_listen_port = 8776 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] osapi_volume_use_ssl = False {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] osapi_volume_workers = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] per_volume_size_limit = -1 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] periodic_fuzzy_delay = 60 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] periodic_interval = 60 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] project_id_regex = [0-9a-f\-]+ {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] public_endpoint = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] publish_errors = False {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] quota_backup_gigabytes = 1000 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] quota_backups = 10 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] quota_gigabytes = 1000 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] quota_groups = 10 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] quota_snapshots = 10 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] quota_volumes = 10 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] rate_limit_burst = 0 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] rate_limit_except_level = CRITICAL {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] rate_limit_interval = 0 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] reinit_driver_count = 3 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] replication_device = **** {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] report_discard_supported = False {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] report_interval = 120 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] reservation_clean_interval = 86400 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] reservation_expire = 86400 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] reserved_image_namespaces = [] {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] reserved_percentage = 0 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] rpc_response_timeout = 120 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] run_external_periodic_tasks = True {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] scst_target_driver = iscsi {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] scst_target_iqn_name = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] service_down_time = 720 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] shell_completion = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83289]: INFO cinder.volume.manager [None req-d5e39b28-7e51-4ae4-a461-fdc2d8cfb8b8 None None] Starting volume driver LVMVolumeDriver (3.0.0) Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] snapshot_name_template = snapshot-%s {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] snapshot_same_host = True {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] split_loggers = False {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] state_path = /opt/stack/data/cinder {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] storage_availability_zone = nova {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] storage_protocol = iSCSI {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] syslog_log_facility = LOG_USER {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] target_helper = lioadm {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83289]: DEBUG oslo_concurrency.processutils [None req-d5e39b28-7e51-4ae4-a461-fdc2d8cfb8b8 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] target_ip_address = 192.168.122.164 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] target_port = 3260 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] target_protocol = iscsi {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] target_secondary_ip_addresses = [] {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] trace_flags = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] transfer_api_class = cinder.transfer.api.API {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] transport_url = **** {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] until_refresh = 0 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] use_chap_auth = False {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] use_default_quota_class = True {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] use_journal = False {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] use_json = False {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] use_multipath_for_image_xfer = False {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] use_stderr = False {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] use_syslog = False {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] verify_glance_signatures = enabled {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] volume_api_class = cinder.volume.api.API {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] volume_backend_name = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] volume_clear = zero {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] volume_clear_ionice = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] volume_clear_size = 0 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] volume_copy_bps_limit = 0 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] volume_dd_blocksize = 1M {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] volume_name_template = volume-%s {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] volume_service_inithost_offload = False {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] volume_usage_audit_period = month {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] zoning_mode = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] oslo_concurrency.disable_process_locking = False {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] keystone_authtoken.auth_section = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] keystone_authtoken.auth_type = password {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] keystone_authtoken.auth_version = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] keystone_authtoken.cache = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] keystone_authtoken.certfile = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] keystone_authtoken.delay_auth_decision = False {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] keystone_authtoken.http_connect_timeout = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] keystone_authtoken.include_service_catalog = True {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] keystone_authtoken.insecure = False {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] keystone_authtoken.interface = public {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] keystone_authtoken.keyfile = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] keystone_authtoken.memcache_password = **** {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] keystone_authtoken.memcache_username = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] keystone_authtoken.region_name = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] keystone_authtoken.service_token_roles_required = True {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] keystone_authtoken.service_type = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] keystone_authtoken.token_cache_time = 300 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.164/identity {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] cache.backend = dogpile.cache.null {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] cache.backend_argument = **** {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] cache.backend_expiration_time = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] cache.config_prefix = cache.oslo {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] cache.debug_cache_backend = False {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] cache.enable_retry_client = False {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] cache.enable_socket_keepalive = False {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] cache.enabled = False {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] cache.expiration_time = 600 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] cache.hashclient_retry_attempts = 2 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] cache.memcache_dead_retry = 300 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] cache.memcache_pool_maxsize = 10 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] cache.memcache_sasl_enabled = False {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] cache.password = **** {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] cache.proxies = [] {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] cache.redis_db = 0 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] cache.redis_sentinel_service_name = mymaster {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] cache.redis_server = localhost:6379 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] cache.retry_attempts = 2 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] cache.retry_delay = 0.0 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] cache.socket_keepalive_count = 1 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] cache.socket_keepalive_idle = 1 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] cache.socket_keepalive_interval = 1 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] cache.socket_timeout = 1.0 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] cache.tls_allowed_ciphers = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] cache.tls_cafile = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] cache.tls_certfile = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] cache.tls_enabled = False {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] cache.tls_keyfile = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] cache.username = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] coordination.backend_url = **** {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] database.asyncio_connection = **** {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] database.asyncio_slave_connection = **** {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] database.backend = sqlalchemy {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] database.connection = **** {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] database.connection_debug = 0 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] database.connection_parameters = {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83289]: DEBUG oslo_concurrency.processutils [None req-d5e39b28-7e51-4ae4-a461-fdc2d8cfb8b8 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.054s {{(pid=83289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] database.connection_recycle_time = 3600 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] database.connection_trace = False {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] database.db_inc_retry_interval = True {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] database.db_max_retries = 20 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] database.db_max_retry_interval = 10 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] database.db_retry_interval = 1 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83289]: DEBUG oslo_concurrency.processutils [None req-d5e39b28-7e51-4ae4-a461-fdc2d8cfb8b8 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] database.max_overflow = 50 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] database.max_pool_size = 5 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] database.max_retries = 10 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] database.mysql_wsrep_sync_wait = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] database.pool_timeout = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] database.retry_interval = 10 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] database.slave_connection = **** {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] database.sqlite_synchronous = True {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] database.synchronous_reader = True {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] database.use_db_reconnect = False {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] profiler.connection_string = messaging:// {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] profiler.enabled = False {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] profiler.es_doc_type = notification {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] profiler.es_scroll_size = 10000 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] profiler.es_scroll_time = 2m {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] profiler.filter_error_trace = False {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] profiler.hmac_keys = **** {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] profiler.sentinel_service_name = mymaster {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] profiler.socket_timeout = 0.1 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] profiler.trace_requests = False {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] profiler.trace_sqlalchemy = False {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] profiler_jaeger.process_tags = {} {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] profiler_jaeger.service_name_prefix = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] profiler_otlp.service_name_prefix = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] oslo_policy.enforce_new_defaults = True {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] oslo_policy.policy_default_rule = default {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] oslo_policy.policy_file = policy.yaml {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] oslo_policy.remote_timeout = 60.0 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] privsep_osbrick.group = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] privsep_osbrick.helper_command = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] privsep_osbrick.user = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] cinder_sys_admin.group = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] cinder_sys_admin.helper_command = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] cinder_sys_admin.user = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] service_user.auth_section = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] service_user.auth_type = password {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] service_user.cafile = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] service_user.certfile = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] service_user.collect_timing = False {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] service_user.insecure = False {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] service_user.keyfile = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] service_user.send_service_user_token = True {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] service_user.split_loggers = False {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] service_user.timeout = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] glance.auth_section = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] glance.auth_type = password {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] glance.certfile = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] glance.collect_timing = False {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] glance.insecure = False {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] glance.keyfile = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] glance.region_name = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] glance.split_loggers = False {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] glance.timeout = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] backend_defaults.backend_availability_zone = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] backend_defaults.chap_password = **** {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] backend_defaults.chap_username = {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] backend_defaults.disk_geometry = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] backend_defaults.driver_client_cert = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] backend_defaults.driver_client_cert_key = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] backend_defaults.driver_data_namespace = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83289]: DEBUG oslo_concurrency.processutils [None req-d5e39b28-7e51-4ae4-a461-fdc2d8cfb8b8 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.051s {{(pid=83289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] backend_defaults.driver_use_ssl = False {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] backend_defaults.enable_unsupported_driver = False {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] backend_defaults.extra_capabilities = {} {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83289]: DEBUG oslo_concurrency.processutils [None req-d5e39b28-7e51-4ae4-a461-fdc2d8cfb8b8 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] backend_defaults.filter_function = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] backend_defaults.goodness_function = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] backend_defaults.iscsi_target_flags = {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] backend_defaults.iscsi_write_cache = on {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] backend_defaults.iser_helper = tgtadm {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] backend_defaults.iser_ip_address = 192.168.122.164 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] backend_defaults.iser_port = 3260 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] backend_defaults.lvm_mirrors = 0 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] backend_defaults.lvm_share_target = False {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] backend_defaults.lvm_type = auto {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] backend_defaults.num_shell_tries = 3 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] backend_defaults.nvmet_port_id = 1 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] backend_defaults.replication_device = **** {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] backend_defaults.report_discard_supported = False {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] backend_defaults.reserved_percentage = 0 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] backend_defaults.scst_target_driver = iscsi {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] backend_defaults.scst_target_iqn_name = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] backend_defaults.storage_protocol = iSCSI {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] backend_defaults.target_helper = tgtadm {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] backend_defaults.target_ip_address = 192.168.122.164 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] backend_defaults.target_port = 3260 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] backend_defaults.target_protocol = iscsi {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] backend_defaults.trace_flags = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] backend_defaults.unique_fqdn_network = True {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] backend_defaults.use_chap_auth = False {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] backend_defaults.volume_backend_name = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] backend_defaults.volume_clear = zero {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] backend_defaults.volume_clear_ionice = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] backend_defaults.volume_clear_size = 0 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] backend_defaults.volume_group = cinder-volumes {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] oslo_reports.file_event_handler = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] oslo_reports.log_dir = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] lvmdriver-1.backend_availability_zone = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] lvmdriver-1.backend_host = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] lvmdriver-1.chap_password = **** {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] lvmdriver-1.chap_username = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] lvmdriver-1.chiscsi_conf = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] lvmdriver-1.disk_geometry = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] lvmdriver-1.driver_client_cert = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] lvmdriver-1.driver_data_namespace = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] lvmdriver-1.driver_use_ssl = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] lvmdriver-1.extra_capabilities = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] lvmdriver-1.filter_function = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] lvmdriver-1.goodness_function = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] lvmdriver-1.iser_helper = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] lvmdriver-1.iser_ip_address = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] lvmdriver-1.iser_port = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] lvmdriver-1.iser_target_prefix = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] lvmdriver-1.lvm_conf_file = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] lvmdriver-1.lvm_mirrors = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] lvmdriver-1.lvm_share_target = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] lvmdriver-1.lvm_type = auto {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] lvmdriver-1.num_shell_tries = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] lvmdriver-1.nvmet_port_id = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] lvmdriver-1.replication_device = **** {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] lvmdriver-1.report_discard_supported = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83289]: DEBUG oslo_concurrency.processutils [None req-d5e39b28-7e51-4ae4-a461-fdc2d8cfb8b8 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.038s {{(pid=83289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] lvmdriver-1.reserved_percentage = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] lvmdriver-1.scst_target_driver = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] lvmdriver-1.storage_protocol = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] lvmdriver-1.target_helper = lioadm {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] lvmdriver-1.target_ip_address = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] lvmdriver-1.target_port = 3260 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] lvmdriver-1.target_protocol = iscsi {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] lvmdriver-1.trace_flags = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] lvmdriver-1.use_chap_auth = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83289]: DEBUG oslo_concurrency.processutils [None req-d5e39b28-7e51-4ae4-a461-fdc2d8cfb8b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=83289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] lvmdriver-1.volume_clear = zero {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] lvmdriver-1.volume_clear_size = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack sudo[83296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] lvmdriver-1.volumes_dir = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack sudo[83296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] oslo_messaging_rabbit.ssl = False {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] oslo_messaging_rabbit.ssl_version = {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] oslo_messaging_notifications.driver = [] {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] oslo_messaging_notifications.retry = -1 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] oslo_messaging_notifications.transport_url = **** {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] key_manager.fixed_key = **** {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] barbican.barbican_api_version = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] barbican.barbican_endpoint = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] barbican.barbican_endpoint_type = public {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] barbican.barbican_region_name = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] barbican.cafile = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] barbican.certfile = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] barbican.collect_timing = False {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] barbican.insecure = False {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] barbican.keyfile = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] barbican.number_of_retries = 60 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] barbican.retry_delay = 1 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] barbican.send_service_user_token = False {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] barbican.split_loggers = False {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] barbican.timeout = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] barbican.verify_ssl = True {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] barbican.verify_ssl_path = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] barbican_service_user.auth_section = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] barbican_service_user.auth_type = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] barbican_service_user.cafile = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] barbican_service_user.certfile = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] barbican_service_user.collect_timing = False {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] barbican_service_user.insecure = False {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] barbican_service_user.keyfile = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] barbican_service_user.split_loggers = False {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] barbican_service_user.timeout = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] vault.approle_role_id = **** {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] vault.approle_secret_id = **** {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] vault.auth_method = approle {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] vault.auth_path = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] vault.kv_mountpoint = secret {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] vault.kv_path = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] vault.kv_version = 2 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] vault.namespace = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] vault.root_token_id = **** {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] vault.ssl_ca_crt_file = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] vault.timeout = 60.0 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] vault.token_file = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] vault.token_role = None {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] vault.use_ssl = False {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:16:34 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] ******************************************************************************** {{(pid=83138) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Aug 26 14:16:34 devstack sudo[83296]: pam_unix(sudo:session): session closed for user root Aug 26 14:16:34 devstack cinder-volume[83289]: DEBUG oslo_concurrency.processutils [None req-d5e39b28-7e51-4ae4-a461-fdc2d8cfb8b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.325s {{(pid=83289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:16:34 devstack cinder-volume[83289]: DEBUG oslo_concurrency.processutils [None req-d5e39b28-7e51-4ae4-a461-fdc2d8cfb8b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:16:34 devstack sudo[83392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 26 14:16:34 devstack sudo[83392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:16:35 devstack sudo[83392]: pam_unix(sudo:session): session closed for user root Aug 26 14:16:35 devstack cinder-volume[83289]: DEBUG oslo_concurrency.processutils [None req-d5e39b28-7e51-4ae4-a461-fdc2d8cfb8b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.384s {{(pid=83289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:16:35 devstack cinder-volume[83289]: DEBUG oslo_concurrency.processutils [None req-d5e39b28-7e51-4ae4-a461-fdc2d8cfb8b8 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=83289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 14:16:35 devstack cinder-volume[83289]: INFO cinder.brick.local_dev.lvm [None req-d5e39b28-7e51-4ae4-a461-fdc2d8cfb8b8 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Aug 26 14:16:35 devstack cinder-volume[83289]: DEBUG oslo_concurrency.processutils [None req-d5e39b28-7e51-4ae4-a461-fdc2d8cfb8b8 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:16:35 devstack cinder-volume[83289]: DEBUG oslo_concurrency.processutils [None req-d5e39b28-7e51-4ae4-a461-fdc2d8cfb8b8 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=83289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:16:35 devstack cinder-volume[83289]: DEBUG oslo_concurrency.processutils [None req-d5e39b28-7e51-4ae4-a461-fdc2d8cfb8b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:16:35 devstack sudo[83499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 26 14:16:35 devstack sudo[83499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:16:35 devstack sudo[83499]: pam_unix(sudo:session): session closed for user root Aug 26 14:16:35 devstack cinder-volume[83289]: DEBUG oslo_concurrency.processutils [None req-d5e39b28-7e51-4ae4-a461-fdc2d8cfb8b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=83289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:16:35 devstack cinder-volume[83289]: DEBUG cinder.brick.local_dev.lvm [None req-d5e39b28-7e51-4ae4-a461-fdc2d8cfb8b8 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=83289) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Aug 26 14:16:35 devstack cinder-volume[83289]: DEBUG oslo_concurrency.processutils [None req-d5e39b28-7e51-4ae4-a461-fdc2d8cfb8b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:16:35 devstack sudo[83588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 26 14:16:35 devstack sudo[83588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:16:36 devstack sudo[83588]: pam_unix(sudo:session): session closed for user root Aug 26 14:16:36 devstack cinder-volume[83289]: DEBUG oslo_concurrency.processutils [None req-d5e39b28-7e51-4ae4-a461-fdc2d8cfb8b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.514s {{(pid=83289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:16:36 devstack cinder-volume[83289]: DEBUG oslo_concurrency.processutils [None req-d5e39b28-7e51-4ae4-a461-fdc2d8cfb8b8 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:16:36 devstack cinder-volume[83289]: DEBUG oslo_concurrency.processutils [None req-d5e39b28-7e51-4ae4-a461-fdc2d8cfb8b8 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=83289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:16:36 devstack cinder-volume[83289]: DEBUG oslo_concurrency.processutils [None req-d5e39b28-7e51-4ae4-a461-fdc2d8cfb8b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:16:36 devstack sudo[83784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 26 14:16:36 devstack sudo[83784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:16:36 devstack sudo[83784]: pam_unix(sudo:session): session closed for user root Aug 26 14:16:36 devstack cinder-volume[83289]: DEBUG oslo_concurrency.processutils [None req-d5e39b28-7e51-4ae4-a461-fdc2d8cfb8b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.305s {{(pid=83289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:16:36 devstack cinder-volume[83289]: DEBUG oslo_concurrency.processutils [None req-d5e39b28-7e51-4ae4-a461-fdc2d8cfb8b8 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:16:36 devstack cinder-volume[83289]: DEBUG oslo_concurrency.processutils [None req-d5e39b28-7e51-4ae4-a461-fdc2d8cfb8b8 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=83289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:16:36 devstack cinder-volume[83289]: DEBUG oslo_concurrency.processutils [None req-d5e39b28-7e51-4ae4-a461-fdc2d8cfb8b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=83289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:16:36 devstack sudo[83905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Aug 26 14:16:36 devstack sudo[83905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:16:36 devstack sudo[83905]: pam_unix(sudo:session): session closed for user root Aug 26 14:16:36 devstack cinder-volume[83289]: DEBUG oslo_concurrency.processutils [None req-d5e39b28-7e51-4ae4-a461-fdc2d8cfb8b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.256s {{(pid=83289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:16:36 devstack cinder-volume[83289]: DEBUG oslo_concurrency.processutils [None req-d5e39b28-7e51-4ae4-a461-fdc2d8cfb8b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:16:36 devstack sudo[83908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 26 14:16:36 devstack sudo[83908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:16:37 devstack sudo[83908]: pam_unix(sudo:session): session closed for user root Aug 26 14:16:37 devstack cinder-volume[83289]: DEBUG oslo_concurrency.processutils [None req-d5e39b28-7e51-4ae4-a461-fdc2d8cfb8b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.389s {{(pid=83289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:16:37 devstack cinder-volume[83289]: DEBUG oslo_concurrency.processutils [None req-d5e39b28-7e51-4ae4-a461-fdc2d8cfb8b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:16:37 devstack sudo[83992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 26 14:16:37 devstack sudo[83992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:16:37 devstack sudo[83992]: pam_unix(sudo:session): session closed for user root Aug 26 14:16:37 devstack cinder-volume[83289]: DEBUG oslo_concurrency.processutils [None req-d5e39b28-7e51-4ae4-a461-fdc2d8cfb8b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=83289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:16:37 devstack cinder-volume[83289]: DEBUG oslo_concurrency.processutils [None req-d5e39b28-7e51-4ae4-a461-fdc2d8cfb8b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:16:37 devstack sudo[83995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 26 14:16:37 devstack sudo[83995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:16:37 devstack sudo[83995]: pam_unix(sudo:session): session closed for user root Aug 26 14:16:37 devstack cinder-volume[83289]: DEBUG oslo_concurrency.processutils [None req-d5e39b28-7e51-4ae4-a461-fdc2d8cfb8b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.313s {{(pid=83289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:16:37 devstack cinder-volume[83289]: DEBUG oslo_concurrency.processutils [None req-d5e39b28-7e51-4ae4-a461-fdc2d8cfb8b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:16:37 devstack sudo[84048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 26 14:16:37 devstack sudo[84048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:16:38 devstack sudo[84048]: pam_unix(sudo:session): session closed for user root Aug 26 14:16:38 devstack cinder-volume[83289]: DEBUG oslo_concurrency.processutils [None req-d5e39b28-7e51-4ae4-a461-fdc2d8cfb8b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.295s {{(pid=83289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:16:38 devstack cinder-volume[83289]: DEBUG oslo_concurrency.processutils [None req-d5e39b28-7e51-4ae4-a461-fdc2d8cfb8b8 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:16:38 devstack cinder-volume[83289]: DEBUG oslo_concurrency.processutils [None req-d5e39b28-7e51-4ae4-a461-fdc2d8cfb8b8 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=83289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:16:38 devstack cinder-volume[83289]: DEBUG oslo_concurrency.processutils [None req-d5e39b28-7e51-4ae4-a461-fdc2d8cfb8b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:16:38 devstack sudo[84094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 26 14:16:38 devstack sudo[84094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:16:38 devstack sudo[84094]: pam_unix(sudo:session): session closed for user root Aug 26 14:16:38 devstack cinder-volume[83289]: DEBUG oslo_concurrency.processutils [None req-d5e39b28-7e51-4ae4-a461-fdc2d8cfb8b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.259s {{(pid=83289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:16:38 devstack cinder-volume[83289]: INFO cinder.volume.drivers.lvm [None req-d5e39b28-7e51-4ae4-a461-fdc2d8cfb8b8 None None] Enabling LVM thin provisioning by default because a thin pool exists. Aug 26 14:16:38 devstack cinder-volume[83289]: DEBUG oslo_concurrency.processutils [None req-d5e39b28-7e51-4ae4-a461-fdc2d8cfb8b8 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:16:38 devstack cinder-volume[83289]: DEBUG oslo_concurrency.processutils [None req-d5e39b28-7e51-4ae4-a461-fdc2d8cfb8b8 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=83289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:16:38 devstack cinder-volume[83289]: DEBUG oslo_concurrency.processutils [None req-d5e39b28-7e51-4ae4-a461-fdc2d8cfb8b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:16:38 devstack sudo[84098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 26 14:16:38 devstack sudo[84098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:16:38 devstack sudo[84098]: pam_unix(sudo:session): session closed for user root Aug 26 14:16:38 devstack cinder-volume[83289]: DEBUG oslo_concurrency.processutils [None req-d5e39b28-7e51-4ae4-a461-fdc2d8cfb8b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.248s {{(pid=83289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:16:38 devstack cinder-volume[83289]: DEBUG cinder.volume.drivers.lvm [None req-d5e39b28-7e51-4ae4-a461-fdc2d8cfb8b8 None None] Updating volume stats {{(pid=83289) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 26 14:16:38 devstack cinder-volume[83289]: DEBUG oslo_concurrency.processutils [None req-d5e39b28-7e51-4ae4-a461-fdc2d8cfb8b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:16:38 devstack sudo[84101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 26 14:16:38 devstack sudo[84101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:16:38 devstack sudo[84101]: pam_unix(sudo:session): session closed for user root Aug 26 14:16:38 devstack cinder-volume[83289]: DEBUG oslo_concurrency.processutils [None req-d5e39b28-7e51-4ae4-a461-fdc2d8cfb8b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.245s {{(pid=83289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:16:38 devstack cinder-volume[83289]: DEBUG oslo_concurrency.processutils [None req-d5e39b28-7e51-4ae4-a461-fdc2d8cfb8b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:16:38 devstack sudo[84104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 26 14:16:38 devstack sudo[84104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:16:39 devstack sudo[84104]: pam_unix(sudo:session): session closed for user root Aug 26 14:16:39 devstack cinder-volume[83289]: DEBUG oslo_concurrency.processutils [None req-d5e39b28-7e51-4ae4-a461-fdc2d8cfb8b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=83289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:16:39 devstack cinder-volume[83289]: DEBUG oslo_concurrency.processutils [None req-d5e39b28-7e51-4ae4-a461-fdc2d8cfb8b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:16:39 devstack sudo[84108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 26 14:16:39 devstack sudo[84108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:16:39 devstack sudo[84108]: pam_unix(sudo:session): session closed for user root Aug 26 14:16:39 devstack cinder-volume[83289]: DEBUG oslo_concurrency.processutils [None req-d5e39b28-7e51-4ae4-a461-fdc2d8cfb8b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.255s {{(pid=83289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:16:39 devstack cinder-volume[83289]: DEBUG oslo_concurrency.processutils [None req-d5e39b28-7e51-4ae4-a461-fdc2d8cfb8b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:16:39 devstack sudo[84111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 26 14:16:39 devstack sudo[84111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:16:39 devstack sudo[84111]: pam_unix(sudo:session): session closed for user root Aug 26 14:16:39 devstack cinder-volume[83289]: DEBUG oslo_concurrency.processutils [None req-d5e39b28-7e51-4ae4-a461-fdc2d8cfb8b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.283s {{(pid=83289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:16:39 devstack cinder-volume[83289]: INFO cinder.volume.driver [None req-d5e39b28-7e51-4ae4-a461-fdc2d8cfb8b8 None None] Driver hasn't implemented _init_vendor_properties() Aug 26 14:16:39 devstack cinder-volume[83289]: DEBUG cinder.volume.driver [None req-d5e39b28-7e51-4ae4-a461-fdc2d8cfb8b8 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83289) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Aug 26 14:16:39 devstack cinder-volume[83289]: DEBUG oslo_db.sqlalchemy.engines [None req-d5e39b28-7e51-4ae4-a461-fdc2d8cfb8b8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83289) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 26 14:16:39 devstack cinder-volume[83289]: DEBUG dbcounter [-] [83289] Writer thread running {{(pid=83289) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 26 14:16:39 devstack cinder-volume[83289]: DEBUG cinder.db.api [None req-d5e39b28-7e51-4ae4-a461-fdc2d8cfb8b8 None None] Building query based on filter {{(pid=83289) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Aug 26 14:16:39 devstack cinder-volume[83289]: DEBUG cinder.image.image_utils [None req-d5e39b28-7e51-4ae4-a461-fdc2d8cfb8b8 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=83289) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Aug 26 14:16:39 devstack cinder-volume[83289]: INFO cinder.keymgr.migration [None req-6a8bde5c-fd25-4ae1-9d2f-7145428cae5f None None] Not migrating encryption keys because the ConfKeyManager is still in use. Aug 26 14:16:39 devstack cinder-volume[83289]: DEBUG cinder.volume.drivers.lvm [None req-d5e39b28-7e51-4ae4-a461-fdc2d8cfb8b8 None None] Updating volume stats {{(pid=83289) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 26 14:16:39 devstack cinder-volume[83289]: DEBUG oslo_concurrency.processutils [None req-d5e39b28-7e51-4ae4-a461-fdc2d8cfb8b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:16:39 devstack sudo[84121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 26 14:16:39 devstack sudo[84121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:16:40 devstack sudo[84121]: pam_unix(sudo:session): session closed for user root Aug 26 14:16:40 devstack cinder-volume[83289]: DEBUG oslo_concurrency.processutils [None req-d5e39b28-7e51-4ae4-a461-fdc2d8cfb8b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=83289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:16:40 devstack cinder-volume[83289]: DEBUG oslo_concurrency.processutils [None req-d5e39b28-7e51-4ae4-a461-fdc2d8cfb8b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:16:40 devstack sudo[84125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 26 14:16:40 devstack sudo[84125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:16:40 devstack sudo[84125]: pam_unix(sudo:session): session closed for user root Aug 26 14:16:40 devstack cinder-volume[83289]: DEBUG oslo_concurrency.processutils [None req-d5e39b28-7e51-4ae4-a461-fdc2d8cfb8b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.247s {{(pid=83289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:16:40 devstack cinder-volume[83289]: DEBUG oslo_concurrency.processutils [None req-d5e39b28-7e51-4ae4-a461-fdc2d8cfb8b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:16:40 devstack sudo[84128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 26 14:16:40 devstack sudo[84128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:16:40 devstack sudo[84128]: pam_unix(sudo:session): session closed for user root Aug 26 14:16:40 devstack cinder-volume[83289]: DEBUG oslo_concurrency.processutils [None req-d5e39b28-7e51-4ae4-a461-fdc2d8cfb8b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.269s {{(pid=83289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:16:40 devstack cinder-volume[83289]: DEBUG oslo_concurrency.processutils [None req-d5e39b28-7e51-4ae4-a461-fdc2d8cfb8b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:16:40 devstack sudo[84132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 26 14:16:40 devstack sudo[84132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:16:40 devstack sudo[84132]: pam_unix(sudo:session): session closed for user root Aug 26 14:16:40 devstack cinder-volume[83289]: DEBUG oslo_concurrency.processutils [None req-d5e39b28-7e51-4ae4-a461-fdc2d8cfb8b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.272s {{(pid=83289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:16:40 devstack cinder-volume[83289]: DEBUG cinder.manager [None req-d5e39b28-7e51-4ae4-a461-fdc2d8cfb8b8 None None] Notifying Schedulers of capabilities ... {{(pid=83289) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:16:40 devstack cinder-volume[83289]: INFO cinder.volume.manager [None req-d5e39b28-7e51-4ae4-a461-fdc2d8cfb8b8 None None] Driver initialization completed successfully. Aug 26 14:16:40 devstack cinder-volume[83289]: INFO cinder.manager [None req-d5e39b28-7e51-4ae4-a461-fdc2d8cfb8b8 None None] Initiating service 2 cleanup Aug 26 14:16:40 devstack cinder-volume[83289]: INFO cinder.manager [None req-d5e39b28-7e51-4ae4-a461-fdc2d8cfb8b8 None None] Service 2 cleanup completed. Aug 26 14:16:40 devstack cinder-volume[83289]: DEBUG cinder.service [None req-d5e39b28-7e51-4ae4-a461-fdc2d8cfb8b8 None None] Creating RPC server for service cinder-volume {{(pid=83289) start /opt/stack/cinder/cinder/service.py:231}} Aug 26 14:16:40 devstack cinder-volume[83289]: DEBUG cinder.service [None req-d5e39b28-7e51-4ae4-a461-fdc2d8cfb8b8 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=83289) start /opt/stack/cinder/cinder/service.py:237}} Aug 26 14:16:41 devstack cinder-volume[83289]: INFO cinder.volume.manager [None req-d5e39b28-7e51-4ae4-a461-fdc2d8cfb8b8 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Aug 26 14:16:41 devstack cinder-volume[83289]: DEBUG cinder.volume.drivers.lvm [None req-d5e39b28-7e51-4ae4-a461-fdc2d8cfb8b8 None None] Updating volume stats {{(pid=83289) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 26 14:16:41 devstack cinder-volume[83289]: DEBUG oslo_concurrency.processutils [None req-d5e39b28-7e51-4ae4-a461-fdc2d8cfb8b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:16:41 devstack sudo[84135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 26 14:16:41 devstack sudo[84135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:16:41 devstack sudo[84135]: pam_unix(sudo:session): session closed for user root Aug 26 14:16:41 devstack cinder-volume[83289]: DEBUG oslo_concurrency.processutils [None req-d5e39b28-7e51-4ae4-a461-fdc2d8cfb8b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.282s {{(pid=83289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:16:41 devstack cinder-volume[83289]: DEBUG oslo_concurrency.processutils [None req-d5e39b28-7e51-4ae4-a461-fdc2d8cfb8b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:16:41 devstack sudo[84143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 26 14:16:41 devstack sudo[84143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:16:41 devstack sudo[84143]: pam_unix(sudo:session): session closed for user root Aug 26 14:16:41 devstack cinder-volume[83289]: DEBUG oslo_concurrency.processutils [None req-d5e39b28-7e51-4ae4-a461-fdc2d8cfb8b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=83289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:16:41 devstack cinder-volume[83289]: DEBUG oslo_concurrency.processutils [None req-d5e39b28-7e51-4ae4-a461-fdc2d8cfb8b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:16:41 devstack sudo[84146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 26 14:16:41 devstack sudo[84146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:16:41 devstack sudo[84146]: pam_unix(sudo:session): session closed for user root Aug 26 14:16:41 devstack cinder-volume[83289]: DEBUG oslo_concurrency.processutils [None req-d5e39b28-7e51-4ae4-a461-fdc2d8cfb8b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.247s {{(pid=83289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:16:41 devstack cinder-volume[83289]: DEBUG oslo_concurrency.processutils [None req-d5e39b28-7e51-4ae4-a461-fdc2d8cfb8b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:16:41 devstack sudo[84149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 26 14:16:41 devstack sudo[84149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:16:42 devstack sudo[84149]: pam_unix(sudo:session): session closed for user root Aug 26 14:16:42 devstack cinder-volume[83289]: DEBUG oslo_concurrency.processutils [None req-d5e39b28-7e51-4ae4-a461-fdc2d8cfb8b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=83289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:16:42 devstack cinder-volume[83289]: INFO cinder.volume.manager [None req-d5e39b28-7e51-4ae4-a461-fdc2d8cfb8b8 None None] Driver post RPC initialization completed successfully. Aug 26 14:16:44 devstack cinder-volume[83138]: DEBUG dbcounter [-] [83138] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=83138) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 14:16:52 devstack cinder-volume[83289]: DEBUG dbcounter [-] [83289] Writing DB stats cinder:SELECT=3 {{(pid=83289) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 14:16:52 devstack cinder-volume[83289]: DEBUG dbcounter [-] [83289] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=83289) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 14:17:42 devstack cinder-volume[83289]: DEBUG oslo_service.periodic_task [None req-006d7708-0c01-4c91-81a0-8d363aeac692 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 14:17:42 devstack cinder-volume[83289]: DEBUG cinder.volume.drivers.lvm [None req-006d7708-0c01-4c91-81a0-8d363aeac692 None None] Updating volume stats {{(pid=83289) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 26 14:17:42 devstack cinder-volume[83289]: DEBUG oslo_concurrency.processutils [None req-006d7708-0c01-4c91-81a0-8d363aeac692 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:17:42 devstack sudo[86175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 26 14:17:42 devstack sudo[86175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:17:42 devstack sudo[86175]: pam_unix(sudo:session): session closed for user root Aug 26 14:17:42 devstack cinder-volume[83289]: DEBUG oslo_concurrency.processutils [None req-006d7708-0c01-4c91-81a0-8d363aeac692 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=83289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:17:42 devstack cinder-volume[83289]: DEBUG oslo_concurrency.processutils [None req-006d7708-0c01-4c91-81a0-8d363aeac692 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:17:42 devstack sudo[86178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 26 14:17:42 devstack sudo[86178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:17:42 devstack sudo[86178]: pam_unix(sudo:session): session closed for user root Aug 26 14:17:42 devstack cinder-volume[83289]: DEBUG oslo_concurrency.processutils [None req-006d7708-0c01-4c91-81a0-8d363aeac692 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=83289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:17:42 devstack cinder-volume[83289]: DEBUG oslo_concurrency.processutils [None req-006d7708-0c01-4c91-81a0-8d363aeac692 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:17:42 devstack sudo[86181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 26 14:17:42 devstack sudo[86181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:17:42 devstack sudo[86181]: pam_unix(sudo:session): session closed for user root Aug 26 14:17:42 devstack cinder-volume[83289]: DEBUG oslo_concurrency.processutils [None req-006d7708-0c01-4c91-81a0-8d363aeac692 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.247s {{(pid=83289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:17:42 devstack cinder-volume[83289]: DEBUG oslo_concurrency.processutils [None req-006d7708-0c01-4c91-81a0-8d363aeac692 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:17:42 devstack sudo[86184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 26 14:17:42 devstack sudo[86184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:17:43 devstack sudo[86184]: pam_unix(sudo:session): session closed for user root Aug 26 14:17:43 devstack cinder-volume[83289]: DEBUG oslo_concurrency.processutils [None req-006d7708-0c01-4c91-81a0-8d363aeac692 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=83289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:17:43 devstack cinder-volume[83289]: DEBUG cinder.manager [None req-006d7708-0c01-4c91-81a0-8d363aeac692 None None] Notifying Schedulers of capabilities ... {{(pid=83289) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:17:43 devstack cinder-volume[83289]: DEBUG oslo_service.periodic_task [None req-006d7708-0c01-4c91-81a0-8d363aeac692 None None] Running periodic task VolumeManager._thread_info {{(pid=83289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 14:17:43 devstack cinder-volume[83289]: DEBUG cinder.volume.manager [None req-006d7708-0c01-4c91-81a0-8d363aeac692 None None] thread count: 6 {{(pid=83289) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 14:17:43 devstack cinder-volume[83289]: DEBUG cinder.volume.manager [None req-006d7708-0c01-4c91-81a0-8d363aeac692 None None] thread info: [<_MainThread(MainThread, started 126357515718784)>, , , , , ] {{(pid=83289) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 14:18:42 devstack cinder-volume[83289]: DEBUG oslo_service.periodic_task [None req-006d7708-0c01-4c91-81a0-8d363aeac692 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 14:18:42 devstack cinder-volume[83289]: DEBUG cinder.volume.drivers.lvm [None req-006d7708-0c01-4c91-81a0-8d363aeac692 None None] Updating volume stats {{(pid=83289) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 26 14:18:42 devstack cinder-volume[83289]: DEBUG oslo_concurrency.processutils [None req-006d7708-0c01-4c91-81a0-8d363aeac692 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:18:42 devstack sudo[89536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 26 14:18:42 devstack sudo[89536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:18:42 devstack sudo[89536]: pam_unix(sudo:session): session closed for user root Aug 26 14:18:42 devstack cinder-volume[83289]: DEBUG oslo_concurrency.processutils [None req-006d7708-0c01-4c91-81a0-8d363aeac692 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=83289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:18:42 devstack cinder-volume[83289]: DEBUG oslo_concurrency.processutils [None req-006d7708-0c01-4c91-81a0-8d363aeac692 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:18:42 devstack sudo[89539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 26 14:18:42 devstack sudo[89539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:18:42 devstack sudo[89539]: pam_unix(sudo:session): session closed for user root Aug 26 14:18:42 devstack cinder-volume[83289]: DEBUG oslo_concurrency.processutils [None req-006d7708-0c01-4c91-81a0-8d363aeac692 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.247s {{(pid=83289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:18:42 devstack cinder-volume[83289]: DEBUG oslo_concurrency.processutils [None req-006d7708-0c01-4c91-81a0-8d363aeac692 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:18:42 devstack sudo[89558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 26 14:18:42 devstack sudo[89558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:18:42 devstack sudo[89558]: pam_unix(sudo:session): session closed for user root Aug 26 14:18:42 devstack cinder-volume[83289]: DEBUG oslo_concurrency.processutils [None req-006d7708-0c01-4c91-81a0-8d363aeac692 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.240s {{(pid=83289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:18:42 devstack cinder-volume[83289]: DEBUG oslo_concurrency.processutils [None req-006d7708-0c01-4c91-81a0-8d363aeac692 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:18:42 devstack sudo[89561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 26 14:18:42 devstack sudo[89561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:18:43 devstack sudo[89561]: pam_unix(sudo:session): session closed for user root Aug 26 14:18:43 devstack cinder-volume[83289]: DEBUG oslo_concurrency.processutils [None req-006d7708-0c01-4c91-81a0-8d363aeac692 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=83289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:18:43 devstack cinder-volume[83289]: DEBUG cinder.manager [None req-006d7708-0c01-4c91-81a0-8d363aeac692 None None] Notifying Schedulers of capabilities ... {{(pid=83289) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:18:52 devstack cinder-volume[83289]: DEBUG dbcounter [-] [83289] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=83289) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 14:19:42 devstack cinder-volume[83289]: DEBUG oslo_service.periodic_task [None req-006d7708-0c01-4c91-81a0-8d363aeac692 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 14:19:42 devstack cinder-volume[83289]: DEBUG cinder.volume.drivers.lvm [None req-006d7708-0c01-4c91-81a0-8d363aeac692 None None] Updating volume stats {{(pid=83289) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 26 14:19:42 devstack cinder-volume[83289]: DEBUG oslo_concurrency.processutils [None req-006d7708-0c01-4c91-81a0-8d363aeac692 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:19:42 devstack sudo[91575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 26 14:19:42 devstack sudo[91575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:19:42 devstack sudo[91575]: pam_unix(sudo:session): session closed for user root Aug 26 14:19:42 devstack cinder-volume[83289]: DEBUG oslo_concurrency.processutils [None req-006d7708-0c01-4c91-81a0-8d363aeac692 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=83289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:19:42 devstack cinder-volume[83289]: DEBUG oslo_concurrency.processutils [None req-006d7708-0c01-4c91-81a0-8d363aeac692 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:19:42 devstack sudo[91579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 26 14:19:42 devstack sudo[91579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:19:42 devstack sudo[91579]: pam_unix(sudo:session): session closed for user root Aug 26 14:19:42 devstack cinder-volume[83289]: DEBUG oslo_concurrency.processutils [None req-006d7708-0c01-4c91-81a0-8d363aeac692 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=83289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:19:42 devstack cinder-volume[83289]: DEBUG oslo_concurrency.processutils [None req-006d7708-0c01-4c91-81a0-8d363aeac692 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:19:42 devstack sudo[91604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 26 14:19:42 devstack sudo[91604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:19:42 devstack sudo[91604]: pam_unix(sudo:session): session closed for user root Aug 26 14:19:42 devstack cinder-volume[83289]: DEBUG oslo_concurrency.processutils [None req-006d7708-0c01-4c91-81a0-8d363aeac692 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.245s {{(pid=83289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:19:42 devstack cinder-volume[83289]: DEBUG oslo_concurrency.processutils [None req-006d7708-0c01-4c91-81a0-8d363aeac692 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:19:42 devstack sudo[91607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 26 14:19:42 devstack sudo[91607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:19:43 devstack sudo[91607]: pam_unix(sudo:session): session closed for user root Aug 26 14:19:43 devstack cinder-volume[83289]: DEBUG oslo_concurrency.processutils [None req-006d7708-0c01-4c91-81a0-8d363aeac692 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.241s {{(pid=83289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:19:43 devstack cinder-volume[83289]: DEBUG cinder.manager [None req-006d7708-0c01-4c91-81a0-8d363aeac692 None None] Notifying Schedulers of capabilities ... {{(pid=83289) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:19:43 devstack cinder-volume[83289]: DEBUG oslo_service.periodic_task [None req-006d7708-0c01-4c91-81a0-8d363aeac692 None None] Running periodic task VolumeManager._thread_info {{(pid=83289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 14:19:43 devstack cinder-volume[83289]: DEBUG cinder.volume.manager [None req-006d7708-0c01-4c91-81a0-8d363aeac692 None None] thread count: 6 {{(pid=83289) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 14:19:43 devstack cinder-volume[83289]: DEBUG cinder.volume.manager [None req-006d7708-0c01-4c91-81a0-8d363aeac692 None None] thread info: [<_MainThread(MainThread, started 126357515718784)>, , , , , ] {{(pid=83289) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 14:20:42 devstack cinder-volume[83289]: DEBUG oslo_service.periodic_task [None req-006d7708-0c01-4c91-81a0-8d363aeac692 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 14:20:42 devstack cinder-volume[83289]: DEBUG cinder.volume.drivers.lvm [None req-006d7708-0c01-4c91-81a0-8d363aeac692 None None] Updating volume stats {{(pid=83289) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 26 14:20:42 devstack cinder-volume[83289]: DEBUG oslo_concurrency.processutils [None req-006d7708-0c01-4c91-81a0-8d363aeac692 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:20:42 devstack sudo[92699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 26 14:20:42 devstack sudo[92699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:20:42 devstack sudo[92699]: pam_unix(sudo:session): session closed for user root Aug 26 14:20:42 devstack cinder-volume[83289]: DEBUG oslo_concurrency.processutils [None req-006d7708-0c01-4c91-81a0-8d363aeac692 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=83289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:20:42 devstack cinder-volume[83289]: DEBUG oslo_concurrency.processutils [None req-006d7708-0c01-4c91-81a0-8d363aeac692 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:20:42 devstack sudo[92702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 26 14:20:42 devstack sudo[92702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:20:42 devstack sudo[92702]: pam_unix(sudo:session): session closed for user root Aug 26 14:20:42 devstack cinder-volume[83289]: DEBUG oslo_concurrency.processutils [None req-006d7708-0c01-4c91-81a0-8d363aeac692 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=83289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:20:42 devstack cinder-volume[83289]: DEBUG oslo_concurrency.processutils [None req-006d7708-0c01-4c91-81a0-8d363aeac692 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:20:42 devstack sudo[92723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 26 14:20:42 devstack sudo[92723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:20:42 devstack sudo[92723]: pam_unix(sudo:session): session closed for user root Aug 26 14:20:42 devstack cinder-volume[83289]: DEBUG oslo_concurrency.processutils [None req-006d7708-0c01-4c91-81a0-8d363aeac692 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.262s {{(pid=83289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:20:42 devstack cinder-volume[83289]: DEBUG oslo_concurrency.processutils [None req-006d7708-0c01-4c91-81a0-8d363aeac692 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:20:42 devstack sudo[92731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 26 14:20:42 devstack sudo[92731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:20:43 devstack sudo[92731]: pam_unix(sudo:session): session closed for user root Aug 26 14:20:43 devstack cinder-volume[83289]: DEBUG oslo_concurrency.processutils [None req-006d7708-0c01-4c91-81a0-8d363aeac692 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=83289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:20:43 devstack cinder-volume[83289]: DEBUG cinder.manager [None req-006d7708-0c01-4c91-81a0-8d363aeac692 None None] Notifying Schedulers of capabilities ... {{(pid=83289) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:20:52 devstack cinder-volume[83289]: DEBUG dbcounter [-] [83289] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=83289) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 14:21:10 devstack cinder-volume[83138]: INFO oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] Caught SIGTERM, stopping children Aug 26 14:21:10 devstack cinder-volume[83138]: DEBUG oslo_concurrency.lockutils [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] Acquiring lock "singleton_lock" {{(pid=83138) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 26 14:21:10 devstack cinder-volume[83138]: DEBUG oslo_concurrency.lockutils [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] Acquired lock "singleton_lock" {{(pid=83138) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 26 14:21:10 devstack cinder-volume[83138]: DEBUG oslo_concurrency.lockutils [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] Releasing lock "singleton_lock" {{(pid=83138) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 26 14:21:10 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] Stop services. {{(pid=83138) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Aug 26 14:21:10 devstack cinder-volume[83138]: DEBUG oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] Killing children. {{(pid=83138) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Aug 26 14:21:10 devstack cinder-volume[83138]: INFO oslo_service.backend._eventlet.service [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] Waiting on 1 children to exit Aug 26 14:21:15 devstack cinder-volume[83289]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Aug 26 14:21:15 devstack cinder-volume[93381]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Aug 26 14:21:15 devstack cinder-volume[93381]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 26 14:21:15 devstack cinder-volume[93381]: we strongly recommend against using it for new projects. Aug 26 14:21:15 devstack cinder-volume[93381]: If you are already using Eventlet, we recommend migrating to a different Aug 26 14:21:15 devstack cinder-volume[93381]: framework. For more detail see Aug 26 14:21:15 devstack cinder-volume[93381]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 26 14:21:15 devstack cinder-volume[93381]: import eventlet # noqa Aug 26 14:21:16 devstack cinder-volume[83289]: DEBUG oslo_concurrency.lockutils [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] Acquiring lock "singleton_lock" {{(pid=83289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 26 14:21:16 devstack cinder-volume[83289]: DEBUG oslo_concurrency.lockutils [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] Acquired lock "singleton_lock" {{(pid=83289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 26 14:21:16 devstack cinder-volume[83289]: DEBUG oslo_concurrency.lockutils [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] Releasing lock "singleton_lock" {{(pid=83289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 26 14:21:16 devstack cinder-volume[83289]: WARNING amqp [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 26 14:21:16 devstack cinder-volume[83289]: WARNING amqp [None req-ecc97906-c10b-4c5f-90ac-d210101b26a2 None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 26 14:21:17 devstack cinder-volume[93381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=93381) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 26 14:21:17 devstack cinder-volume[93381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=93381) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 26 14:21:17 devstack cinder-volume[93381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=93381) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 26 14:21:18 devstack cinder-volume[93381]: INFO dbcounter [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] Registered counter for database cinder Aug 26 14:21:18 devstack cinder-volume[93381]: DEBUG oslo_db.sqlalchemy.engines [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93381) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 26 14:21:18 devstack cinder-volume[93381]: DEBUG dbcounter [-] [93381] Writer thread running {{(pid=93381) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 26 14:21:18 devstack cinder-volume[93381]: INFO cinder.rpc [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Aug 26 14:21:18 devstack cinder-volume[93381]: INFO cinder.rpc [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_db.sqlalchemy.engines [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93381) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 26 14:21:19 devstack cinder-volume[93381]: INFO cinder.volume.manager [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] Determined volume DB was empty at startup. Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG cinder.volume.manager [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=93381) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Aug 26 14:21:19 devstack cinder-volume[93381]: INFO cinder.volume.manager [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] Service not found for updating active_backend_id, assuming default for driver init. Aug 26 14:21:19 devstack cinder-volume[93381]: WARNING stevedore.named [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 26 14:21:19 devstack cinder-volume[93381]: WARNING castellan.key_manager [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 26 14:21:19 devstack cinder-volume[93381]: WARNING cinder.keymgr.conf_key_mgr [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 26 14:21:19 devstack cinder-volume[93381]: INFO cinder.volume.manager [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] Image-volume cache disabled for host devstack@QuobyteHD. Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_db.sqlalchemy.engines [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93381) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 26 14:21:19 devstack cinder-volume[93381]: INFO oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] Starting 1 workers Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] Started child 93644 {{(pid=93381) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Aug 26 14:21:19 devstack cinder-volume[93644]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] Full set of CONF: {{(pid=93381) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] ******************************************************************************** {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] Configuration options gathered from: {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] ================================================================================ {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] allow_availability_zone_fallback = False {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] allow_compression_on_image_upload = False {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] allowed_direct_url_schemes = [] {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] api_rate_limit = True {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] auth_strategy = keystone {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] backend_availability_zone = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] backend_host = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] backend_name = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] backend_stats_polling_interval = 60 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] backup_api_class = cinder.backup.api.API {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] backup_name_template = backup-%s {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] backup_use_same_host = False {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] backup_use_temp_snapshot = False {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] chap_password = **** {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] chap_username = {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] cinder_internal_tenant_project_id = 74cd0dea6428401d898b8535eb1abbbf {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] cinder_internal_tenant_user_id = 2cf395441d19444ea88d57af1aa42cdb {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] cluster = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] compression_format = gzip {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] compute_api_class = cinder.compute.nova.API {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] config_dir = [] {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] config_source = [] {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] control_exchange = openstack {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] debug = True {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] default_availability_zone = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] default_group_type = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] default_volume_type = QuobyteHD {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] disk_geometry = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] driver_client_cert = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] driver_client_cert_key = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] driver_data_namespace = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] driver_ssl_cert_path = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] driver_ssl_cert_verify = False {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] driver_use_ssl = False {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] enable_new_services = True {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] enable_unsupported_driver = False {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] enabled_backends = ['QuobyteHD'] {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] enforce_multipath_for_image_xfer = False {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] filter_function = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] glance_api_insecure = False {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] glance_api_servers = ['http://192.168.122.164/image'] {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] glance_api_ssl_compression = False {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] glance_ca_certificates_file = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] glance_catalog_info = image:glance:publicURL {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] glance_certfile = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] glance_keyfile = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] glance_num_retries = 3 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] glance_request_timeout = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] goodness_function = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] graceful_shutdown_timeout = 5 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] group_api_class = cinder.group.api.API {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] host = devstack {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] image_compress_on_upload = True {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] image_conversion_address_space_limit = 1 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] image_conversion_cpu_limit = 60 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] image_conversion_disable = False {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93644]: INFO cinder.volume.manager [None req-ae32b044-6133-4070-99a1-02f001ac083e None None] Starting volume driver QuobyteDriver (1.2.1) Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] image_upload_use_cinder_backend = False {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93644]: DEBUG cinder.volume.drivers.remotefs [None req-ae32b044-6133-4070-99a1-02f001ac083e None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=93644) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] image_upload_use_internal_tenant = False {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] image_volume_cache_enabled = False {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] image_volume_cache_max_count = 0 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] image_volume_cache_max_size_gb = 0 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] init_host_max_objects_retrieval = 0 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] instance_format = [instance: %(uuid)s] {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] iscsi_target_flags = {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] iscsi_write_cache = on {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] iser_helper = tgtadm {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] iser_ip_address = 192.168.122.164 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] iser_port = 3260 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] log_color = False {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] log_config_append = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] log_dir = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] log_file = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] log_options = True {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] log_rotate_interval = 1 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] log_rotate_interval_type = days {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] log_rotation_type = none {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] max_age = 0 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] max_logfile_count = 30 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] max_logfile_size_mb = 200 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] max_over_subscription_ratio = 20.0 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] message_reap_interval = 86400 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] message_ttl = 2592000 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] migration_create_volume_timeout_secs = 300 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] monkey_patch = False {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] monkey_patch_modules = [] {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] my_ip = 192.168.122.164 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] no_snapshot_gb_quota = False {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] num_iser_scan_tries = 3 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] num_shell_tries = 3 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] num_volume_device_scan_tries = 3 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] nvmeof_conn_info_version = 1 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] nvmet_ns_id = 10 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] nvmet_port_id = 1 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] osapi_max_limit = 1000 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] osapi_volume_ext_list = [] {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] osapi_volume_listen = 0.0.0.0 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] osapi_volume_listen_port = 8776 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] osapi_volume_use_ssl = False {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] osapi_volume_workers = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] per_volume_size_limit = -1 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] periodic_fuzzy_delay = 60 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] periodic_interval = 60 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] project_id_regex = [0-9a-f\-]+ {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] public_endpoint = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] publish_errors = False {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] quota_backup_gigabytes = 1000 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] quota_backups = 10 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] quota_gigabytes = 1000 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] quota_groups = 10 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] quota_snapshots = 10 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] quota_volumes = 10 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] rate_limit_burst = 0 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] rate_limit_except_level = CRITICAL {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] rate_limit_interval = 0 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] reinit_driver_count = 3 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] replication_device = **** {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] report_discard_supported = False {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] report_interval = 120 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] reservation_clean_interval = 86400 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] reservation_expire = 86400 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] reserved_image_namespaces = [] {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] reserved_percentage = 0 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] rpc_response_timeout = 120 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] run_external_periodic_tasks = True {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] scst_target_driver = iscsi {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] scst_target_iqn_name = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] service_down_time = 720 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] shell_completion = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] snapshot_name_template = snapshot-%s {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] split_loggers = False {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] state_path = /opt/stack/data/cinder {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] storage_availability_zone = nova {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] storage_protocol = iSCSI {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] syslog_log_facility = LOG_USER {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] target_helper = lioadm {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] target_ip_address = 192.168.122.164 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] target_port = 3260 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] target_protocol = iscsi {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] target_secondary_ip_addresses = [] {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] trace_flags = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] transfer_api_class = cinder.transfer.api.API {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] transport_url = **** {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] until_refresh = 0 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] use_chap_auth = False {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] use_default_quota_class = True {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] use_journal = False {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] use_json = False {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] use_multipath_for_image_xfer = False {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] use_stderr = False {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] use_syslog = False {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] verify_glance_signatures = enabled {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] volume_api_class = cinder.volume.api.API {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] volume_backend_name = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] volume_clear = zero {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] volume_clear_ionice = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] volume_clear_size = 0 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] volume_copy_bps_limit = 0 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] volume_dd_blocksize = 1M {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] volume_name_template = volume-%s {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] volume_service_inithost_offload = False {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] volume_usage_audit_period = month {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] zoning_mode = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] oslo_concurrency.disable_process_locking = False {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] keystone_authtoken.auth_section = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] keystone_authtoken.auth_type = password {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] keystone_authtoken.auth_version = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] keystone_authtoken.cache = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] keystone_authtoken.certfile = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] keystone_authtoken.delay_auth_decision = False {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] keystone_authtoken.http_connect_timeout = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] keystone_authtoken.include_service_catalog = True {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] keystone_authtoken.insecure = False {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] keystone_authtoken.interface = public {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] keystone_authtoken.keyfile = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] keystone_authtoken.memcache_password = **** {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] keystone_authtoken.memcache_username = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] keystone_authtoken.region_name = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] keystone_authtoken.service_token_roles_required = True {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] keystone_authtoken.service_type = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] keystone_authtoken.token_cache_time = 300 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.164/identity {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] cache.backend = dogpile.cache.null {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] cache.backend_argument = **** {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] cache.backend_expiration_time = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93644]: DEBUG cinder.volume.drivers.quobyte [None req-ae32b044-6133-4070-99a1-02f001ac083e None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=93644) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Aug 26 14:21:19 devstack cinder-volume[93644]: WARNING cinder.volume.drivers.quobyte [None req-ae32b044-6133-4070-99a1-02f001ac083e None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Aug 26 14:21:19 devstack cinder-volume[93644]: WARNING cinder.volume.drivers.quobyte [None req-ae32b044-6133-4070-99a1-02f001ac083e None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] cache.config_prefix = cache.oslo {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] cache.debug_cache_backend = False {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] cache.enable_retry_client = False {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] cache.enable_socket_keepalive = False {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] cache.enabled = False {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] cache.expiration_time = 600 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] cache.hashclient_retry_attempts = 2 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] cache.memcache_dead_retry = 300 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] cache.memcache_pool_maxsize = 10 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] cache.memcache_sasl_enabled = False {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93644]: DEBUG oslo_concurrency.processutils [None req-ae32b044-6133-4070-99a1-02f001ac083e None None] Running cmd (subprocess): mount.quobyte {{(pid=93644) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] cache.password = **** {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] cache.proxies = [] {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] cache.redis_db = 0 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] cache.redis_sentinel_service_name = mymaster {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] cache.redis_server = localhost:6379 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] cache.retry_attempts = 2 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] cache.retry_delay = 0.0 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] cache.socket_keepalive_count = 1 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] cache.socket_keepalive_idle = 1 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] cache.socket_keepalive_interval = 1 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] cache.socket_timeout = 1.0 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] cache.tls_allowed_ciphers = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] cache.tls_cafile = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] cache.tls_certfile = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] cache.tls_enabled = False {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] cache.tls_keyfile = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] cache.username = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] coordination.backend_url = **** {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] database.asyncio_connection = **** {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] database.asyncio_slave_connection = **** {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] database.backend = sqlalchemy {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] database.connection = **** {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] database.connection_debug = 0 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] database.connection_parameters = {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] database.connection_recycle_time = 3600 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] database.connection_trace = False {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] database.db_inc_retry_interval = True {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] database.db_max_retries = 20 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] database.db_max_retry_interval = 10 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] database.db_retry_interval = 1 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] database.max_overflow = 50 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] database.max_pool_size = 5 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] database.max_retries = 10 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] database.mysql_wsrep_sync_wait = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] database.pool_timeout = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] database.retry_interval = 10 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] database.slave_connection = **** {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] database.sqlite_synchronous = True {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] database.synchronous_reader = True {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] database.use_db_reconnect = False {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] profiler.connection_string = messaging:// {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] profiler.enabled = False {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] profiler.es_doc_type = notification {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] profiler.es_scroll_size = 10000 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] profiler.es_scroll_time = 2m {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] profiler.filter_error_trace = False {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] profiler.hmac_keys = **** {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] profiler.sentinel_service_name = mymaster {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] profiler.socket_timeout = 0.1 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] profiler.trace_requests = False {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] profiler.trace_sqlalchemy = False {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] profiler_jaeger.process_tags = {} {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] profiler_jaeger.service_name_prefix = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] profiler_otlp.service_name_prefix = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] oslo_policy.enforce_new_defaults = True {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] oslo_policy.policy_default_rule = default {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] oslo_policy.policy_file = policy.yaml {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] oslo_policy.remote_timeout = 60.0 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] privsep_osbrick.group = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] privsep_osbrick.helper_command = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] privsep_osbrick.user = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] cinder_sys_admin.group = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] cinder_sys_admin.helper_command = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] cinder_sys_admin.user = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] service_user.auth_section = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] service_user.auth_type = password {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] service_user.cafile = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] service_user.certfile = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] service_user.collect_timing = False {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] service_user.insecure = False {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] service_user.keyfile = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] service_user.send_service_user_token = True {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] service_user.split_loggers = False {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] service_user.timeout = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] glance.auth_section = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] glance.auth_type = password {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] glance.certfile = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] glance.collect_timing = False {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] glance.insecure = False {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] glance.keyfile = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] glance.region_name = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] glance.split_loggers = False {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] glance.timeout = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] backend_defaults.backend_availability_zone = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] backend_defaults.chap_password = **** {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] backend_defaults.chap_username = {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] backend_defaults.disk_geometry = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] backend_defaults.driver_client_cert = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] backend_defaults.driver_client_cert_key = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] backend_defaults.driver_data_namespace = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] backend_defaults.driver_use_ssl = False {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] backend_defaults.enable_unsupported_driver = False {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] backend_defaults.extra_capabilities = {} {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] backend_defaults.filter_function = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] backend_defaults.goodness_function = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] backend_defaults.iscsi_target_flags = {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] backend_defaults.iscsi_write_cache = on {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] backend_defaults.iser_helper = tgtadm {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] backend_defaults.iser_ip_address = 192.168.122.164 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] backend_defaults.iser_port = 3260 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] backend_defaults.nas_host = {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] backend_defaults.nas_login = admin {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] backend_defaults.nas_mount_options = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] backend_defaults.nas_password = **** {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] backend_defaults.nas_private_key = {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] backend_defaults.nas_share_path = {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] backend_defaults.nas_ssh_port = 22 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] backend_defaults.num_shell_tries = 3 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] backend_defaults.nvmet_port_id = 1 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] backend_defaults.quobyte_client_cfg = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] backend_defaults.quobyte_volume_url = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] backend_defaults.replication_device = **** {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] backend_defaults.report_discard_supported = False {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] backend_defaults.reserved_percentage = 0 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] backend_defaults.scst_target_driver = iscsi {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] backend_defaults.scst_target_iqn_name = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] backend_defaults.storage_protocol = iSCSI {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] backend_defaults.target_helper = tgtadm {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] backend_defaults.target_ip_address = 192.168.122.164 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] backend_defaults.target_port = 3260 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] backend_defaults.target_protocol = iscsi {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] backend_defaults.trace_flags = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] backend_defaults.unique_fqdn_network = True {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] backend_defaults.use_chap_auth = False {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] backend_defaults.volume_backend_name = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] backend_defaults.volume_clear = zero {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] backend_defaults.volume_clear_ionice = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] backend_defaults.volume_clear_size = 0 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] oslo_reports.file_event_handler = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] oslo_reports.log_dir = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] QuobyteHD.backend_availability_zone = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] QuobyteHD.backend_host = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] QuobyteHD.chap_password = **** {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] QuobyteHD.chap_username = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] QuobyteHD.chiscsi_conf = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] QuobyteHD.disk_geometry = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] QuobyteHD.driver_client_cert = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] QuobyteHD.driver_client_cert_key = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] QuobyteHD.driver_data_namespace = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] QuobyteHD.driver_use_ssl = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] QuobyteHD.extra_capabilities = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] QuobyteHD.filter_function = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] QuobyteHD.goodness_function = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] QuobyteHD.iscsi_target_flags = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] QuobyteHD.iscsi_write_cache = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] QuobyteHD.iser_helper = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] QuobyteHD.iser_ip_address = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] QuobyteHD.iser_port = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] QuobyteHD.iser_target_prefix = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] QuobyteHD.nas_host = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] QuobyteHD.nas_login = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] QuobyteHD.nas_mount_options = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] QuobyteHD.nas_password = **** {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] QuobyteHD.nas_private_key = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] QuobyteHD.nas_share_path = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] QuobyteHD.nas_ssh_port = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] QuobyteHD.num_shell_tries = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] QuobyteHD.nvmet_ns_id = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] QuobyteHD.nvmet_port_id = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] QuobyteHD.replication_device = **** {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] QuobyteHD.report_discard_supported = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] QuobyteHD.reserved_percentage = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] QuobyteHD.scst_target_driver = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] QuobyteHD.storage_protocol = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] QuobyteHD.target_helper = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] QuobyteHD.target_ip_address = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] QuobyteHD.target_port = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] QuobyteHD.target_prefix = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack quobyte-client[93657]: Reading configuration file: /etc/quobyte/client.cfg Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] QuobyteHD.target_protocol = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] QuobyteHD.trace_flags = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] QuobyteHD.unique_fqdn_network = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] QuobyteHD.use_chap_auth = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack quobyte-client[93657]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] QuobyteHD.volume_clear = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] QuobyteHD.volume_clear_ionice = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] QuobyteHD.volume_clear_size = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] QuobyteHD.volumes_dir = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] oslo_messaging_rabbit.ssl = False {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] oslo_messaging_rabbit.ssl_version = {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] oslo_messaging_notifications.driver = [] {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] oslo_messaging_notifications.retry = -1 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] oslo_messaging_notifications.transport_url = **** {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] key_manager.fixed_key = **** {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] barbican.barbican_api_version = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] barbican.barbican_endpoint = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] barbican.barbican_endpoint_type = public {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] barbican.barbican_region_name = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] barbican.cafile = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] barbican.certfile = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] barbican.collect_timing = False {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] barbican.insecure = False {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] barbican.keyfile = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] barbican.number_of_retries = 60 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] barbican.retry_delay = 1 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] barbican.send_service_user_token = False {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] barbican.split_loggers = False {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] barbican.timeout = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93644]: DEBUG oslo_concurrency.processutils [None req-ae32b044-6133-4070-99a1-02f001ac083e None None] CMD "mount.quobyte" returned: 1 in 0.149s {{(pid=93644) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:21:19 devstack cinder-volume[93644]: DEBUG oslo_concurrency.lockutils [None req-ae32b044-6133-4070-99a1-02f001ac083e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93644) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:21:19 devstack cinder-volume[93644]: DEBUG oslo_concurrency.lockutils [None req-ae32b044-6133-4070-99a1-02f001ac083e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93644) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] barbican.verify_ssl = True {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] barbican.verify_ssl_path = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] barbican_service_user.auth_section = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] barbican_service_user.auth_type = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93644]: DEBUG cinder.volume.drivers.quobyte [None req-ae32b044-6133-4070-99a1-02f001ac083e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=93644) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:21:19 devstack cinder-volume[93644]: INFO cinder.volume.drivers.quobyte [None req-ae32b044-6133-4070-99a1-02f001ac083e None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b ... Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] barbican_service_user.cafile = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] barbican_service_user.certfile = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] barbican_service_user.collect_timing = False {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] barbican_service_user.insecure = False {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] barbican_service_user.keyfile = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] barbican_service_user.split_loggers = False {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] barbican_service_user.timeout = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] vault.approle_role_id = **** {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] vault.approle_secret_id = **** {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93644]: DEBUG oslo_concurrency.processutils [None req-ae32b044-6133-4070-99a1-02f001ac083e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 -c /etc/quobyte/client-cinder.cfg {{(pid=93644) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] vault.auth_method = approle {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] vault.auth_path = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] vault.kv_mountpoint = secret {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] vault.kv_path = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] vault.kv_version = 2 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] vault.namespace = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] vault.root_token_id = **** {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] vault.ssl_ca_crt_file = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] vault.timeout = 60.0 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] vault.token_file = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] vault.token_role = None {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] vault.use_ssl = False {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:19 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] ******************************************************************************** {{(pid=93381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Aug 26 14:21:19 devstack sudo[93658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 -c /etc/quobyte/client-cinder.cfg Aug 26 14:21:19 devstack sudo[93658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:21:20 devstack sudo[93658]: pam_unix(sudo:session): session closed for user root Aug 26 14:21:20 devstack cinder-volume[93644]: DEBUG oslo_concurrency.processutils [None req-ae32b044-6133-4070-99a1-02f001ac083e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.429s {{(pid=93644) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:21:20 devstack cinder-volume[93644]: INFO cinder.volume.drivers.quobyte [None req-ae32b044-6133-4070-99a1-02f001ac083e None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b succeeded Aug 26 14:21:20 devstack cinder-volume[93644]: DEBUG cinder.volume.drivers.quobyte [None req-ae32b044-6133-4070-99a1-02f001ac083e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=93644) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:21:20 devstack cinder-volume[93644]: DEBUG oslo_concurrency.lockutils [None req-ae32b044-6133-4070-99a1-02f001ac083e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.448s {{(pid=93644) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:21:20 devstack cinder-volume[93644]: DEBUG oslo_concurrency.processutils [None req-ae32b044-6133-4070-99a1-02f001ac083e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=93644) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:21:20 devstack sudo[93735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:21:20 devstack sudo[93735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:21:20 devstack sudo[93735]: pam_unix(sudo:session): session closed for user root Aug 26 14:21:20 devstack cinder-volume[93644]: DEBUG oslo_concurrency.processutils [None req-ae32b044-6133-4070-99a1-02f001ac083e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.254s {{(pid=93644) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:21:20 devstack cinder-volume[93644]: INFO cinder.volume.driver [None req-ae32b044-6133-4070-99a1-02f001ac083e None None] Driver hasn't implemented _init_vendor_properties() Aug 26 14:21:20 devstack cinder-volume[93644]: DEBUG cinder.volume.driver [None req-ae32b044-6133-4070-99a1-02f001ac083e None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.8208618164062, 'free_capacity_gb': 1774.8208618164062, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93644) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Aug 26 14:21:20 devstack cinder-volume[93644]: DEBUG oslo_db.sqlalchemy.engines [None req-ae32b044-6133-4070-99a1-02f001ac083e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93644) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 26 14:21:20 devstack cinder-volume[93644]: DEBUG dbcounter [-] [93644] Writer thread running {{(pid=93644) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 26 14:21:20 devstack cinder-volume[93644]: DEBUG cinder.db.api [None req-ae32b044-6133-4070-99a1-02f001ac083e None None] Building query based on filter {{(pid=93644) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Aug 26 14:21:20 devstack cinder-volume[93644]: DEBUG cinder.image.image_utils [None req-ae32b044-6133-4070-99a1-02f001ac083e None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=93644) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Aug 26 14:21:20 devstack cinder-volume[93644]: INFO cinder.keymgr.migration [None req-5810d849-cb80-4160-8a01-8298700dd148 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Aug 26 14:21:20 devstack cinder-volume[93644]: DEBUG oslo_concurrency.lockutils [None req-ae32b044-6133-4070-99a1-02f001ac083e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93644) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:21:20 devstack cinder-volume[93644]: DEBUG oslo_concurrency.lockutils [None req-ae32b044-6133-4070-99a1-02f001ac083e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93644) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:21:20 devstack cinder-volume[93644]: DEBUG cinder.volume.drivers.quobyte [None req-ae32b044-6133-4070-99a1-02f001ac083e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=93644) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:21:20 devstack cinder-volume[93644]: DEBUG cinder.volume.drivers.quobyte [None req-ae32b044-6133-4070-99a1-02f001ac083e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=93644) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:21:20 devstack cinder-volume[93644]: DEBUG oslo_concurrency.lockutils [None req-ae32b044-6133-4070-99a1-02f001ac083e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93644) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:21:20 devstack cinder-volume[93644]: DEBUG oslo_concurrency.processutils [None req-ae32b044-6133-4070-99a1-02f001ac083e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=93644) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:21:20 devstack sudo[93746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:21:20 devstack sudo[93746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:21:20 devstack sudo[93746]: pam_unix(sudo:session): session closed for user root Aug 26 14:21:20 devstack cinder-volume[93644]: DEBUG oslo_concurrency.processutils [None req-ae32b044-6133-4070-99a1-02f001ac083e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.227s {{(pid=93644) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:21:20 devstack cinder-volume[93644]: DEBUG cinder.manager [None req-ae32b044-6133-4070-99a1-02f001ac083e None None] Notifying Schedulers of capabilities ... {{(pid=93644) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:21:20 devstack cinder-volume[93644]: INFO cinder.volume.manager [None req-ae32b044-6133-4070-99a1-02f001ac083e None None] Driver initialization completed successfully. Aug 26 14:21:20 devstack cinder-volume[93644]: INFO cinder.manager [None req-ae32b044-6133-4070-99a1-02f001ac083e None None] Initiating service 3 cleanup Aug 26 14:21:20 devstack cinder-volume[93644]: INFO cinder.manager [None req-ae32b044-6133-4070-99a1-02f001ac083e None None] Service 3 cleanup completed. Aug 26 14:21:20 devstack cinder-volume[93644]: DEBUG cinder.service [None req-ae32b044-6133-4070-99a1-02f001ac083e None None] Creating RPC server for service cinder-volume {{(pid=93644) start /opt/stack/cinder/cinder/service.py:231}} Aug 26 14:21:20 devstack cinder-volume[93644]: DEBUG cinder.service [None req-ae32b044-6133-4070-99a1-02f001ac083e None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=93644) start /opt/stack/cinder/cinder/service.py:237}} Aug 26 14:21:21 devstack cinder-volume[93644]: INFO cinder.volume.manager [None req-ae32b044-6133-4070-99a1-02f001ac083e None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Aug 26 14:21:21 devstack cinder-volume[93644]: DEBUG oslo_concurrency.lockutils [None req-ae32b044-6133-4070-99a1-02f001ac083e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93644) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:21:21 devstack cinder-volume[93644]: DEBUG oslo_concurrency.lockutils [None req-ae32b044-6133-4070-99a1-02f001ac083e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93644) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:21:21 devstack cinder-volume[93644]: DEBUG cinder.volume.drivers.quobyte [None req-ae32b044-6133-4070-99a1-02f001ac083e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=93644) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:21:21 devstack cinder-volume[93644]: DEBUG cinder.volume.drivers.quobyte [None req-ae32b044-6133-4070-99a1-02f001ac083e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=93644) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:21:21 devstack cinder-volume[93644]: DEBUG oslo_concurrency.lockutils [None req-ae32b044-6133-4070-99a1-02f001ac083e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93644) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:21:21 devstack cinder-volume[93644]: DEBUG oslo_concurrency.processutils [None req-ae32b044-6133-4070-99a1-02f001ac083e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=93644) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:21:21 devstack sudo[93757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:21:21 devstack sudo[93757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:21:21 devstack sudo[93757]: pam_unix(sudo:session): session closed for user root Aug 26 14:21:21 devstack cinder-volume[93644]: DEBUG oslo_concurrency.processutils [None req-ae32b044-6133-4070-99a1-02f001ac083e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.269s {{(pid=93644) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:21:21 devstack cinder-volume[93644]: INFO cinder.volume.manager [None req-ae32b044-6133-4070-99a1-02f001ac083e None None] Driver post RPC initialization completed successfully. Aug 26 14:21:26 devstack cinder-volume[93644]: DEBUG oslo_concurrency.lockutils [None req-f3443fad-035c-47d8-b274-c00e7dfcbe8b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93644) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:21:26 devstack cinder-volume[93644]: DEBUG oslo_concurrency.lockutils [None req-f3443fad-035c-47d8-b274-c00e7dfcbe8b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93644) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:21:26 devstack cinder-volume[93644]: DEBUG cinder.volume.drivers.quobyte [None req-f3443fad-035c-47d8-b274-c00e7dfcbe8b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=93644) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:21:26 devstack cinder-volume[93644]: DEBUG cinder.volume.drivers.quobyte [None req-f3443fad-035c-47d8-b274-c00e7dfcbe8b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=93644) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:21:26 devstack cinder-volume[93644]: DEBUG oslo_concurrency.lockutils [None req-f3443fad-035c-47d8-b274-c00e7dfcbe8b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93644) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:21:26 devstack cinder-volume[93644]: DEBUG oslo_concurrency.processutils [None req-f3443fad-035c-47d8-b274-c00e7dfcbe8b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=93644) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:21:26 devstack sudo[93983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:21:26 devstack sudo[93983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:21:26 devstack sudo[93983]: pam_unix(sudo:session): session closed for user root Aug 26 14:21:26 devstack cinder-volume[93644]: DEBUG oslo_concurrency.processutils [None req-f3443fad-035c-47d8-b274-c00e7dfcbe8b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.242s {{(pid=93644) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:21:26 devstack cinder-volume[93644]: DEBUG cinder.manager [None req-f3443fad-035c-47d8-b274-c00e7dfcbe8b None None] Notifying Schedulers of capabilities ... {{(pid=93644) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:21:26 devstack cinder-volume[93381]: INFO oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] Caught SIGTERM, stopping children Aug 26 14:21:26 devstack cinder-volume[93381]: DEBUG oslo_concurrency.lockutils [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] Acquiring lock "singleton_lock" {{(pid=93381) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 26 14:21:26 devstack cinder-volume[93381]: DEBUG oslo_concurrency.lockutils [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] Acquired lock "singleton_lock" {{(pid=93381) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 26 14:21:26 devstack cinder-volume[93381]: DEBUG oslo_concurrency.lockutils [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] Releasing lock "singleton_lock" {{(pid=93381) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 26 14:21:26 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] Stop services. {{(pid=93381) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Aug 26 14:21:26 devstack cinder-volume[93381]: DEBUG oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] Killing children. {{(pid=93381) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Aug 26 14:21:26 devstack cinder-volume[93381]: INFO oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] Waiting on 1 children to exit Aug 26 14:21:29 devstack cinder-volume[93644]: DEBUG oslo_concurrency.lockutils [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] Acquiring lock "singleton_lock" {{(pid=93644) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 26 14:21:29 devstack cinder-volume[93644]: DEBUG oslo_concurrency.lockutils [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] Acquired lock "singleton_lock" {{(pid=93644) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 26 14:21:29 devstack cinder-volume[93644]: DEBUG oslo_concurrency.lockutils [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] Releasing lock "singleton_lock" {{(pid=93644) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 26 14:21:29 devstack cinder-volume[93644]: WARNING amqp [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 26 14:21:29 devstack cinder-volume[93644]: WARNING amqp [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 26 14:21:29 devstack cinder-volume[93381]: INFO oslo_service.backend._eventlet.service [None req-8e9df691-f4ac-4bfe-a53c-4bb97bb391e3 None None] Child 93644 exited with status 0 Aug 26 14:21:30 devstack cinder-volume[94082]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Aug 26 14:21:30 devstack cinder-volume[94082]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 26 14:21:30 devstack cinder-volume[94082]: we strongly recommend against using it for new projects. Aug 26 14:21:30 devstack cinder-volume[94082]: If you are already using Eventlet, we recommend migrating to a different Aug 26 14:21:30 devstack cinder-volume[94082]: framework. For more detail see Aug 26 14:21:30 devstack cinder-volume[94082]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 26 14:21:30 devstack cinder-volume[94082]: import eventlet # noqa Aug 26 14:21:33 devstack cinder-volume[94082]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=94082) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 26 14:21:33 devstack cinder-volume[94082]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=94082) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 26 14:21:33 devstack cinder-volume[94082]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=94082) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 26 14:21:33 devstack cinder-volume[94082]: INFO dbcounter [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] Registered counter for database cinder Aug 26 14:21:34 devstack cinder-volume[94082]: DEBUG oslo_db.sqlalchemy.engines [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94082) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 26 14:21:34 devstack cinder-volume[94082]: DEBUG dbcounter [-] [94082] Writer thread running {{(pid=94082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 26 14:21:34 devstack cinder-volume[94082]: INFO cinder.rpc [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Aug 26 14:21:34 devstack cinder-volume[94082]: INFO cinder.rpc [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Aug 26 14:21:34 devstack cinder-volume[94082]: DEBUG oslo_db.sqlalchemy.engines [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94082) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 26 14:21:34 devstack cinder-volume[94082]: INFO cinder.volume.manager [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] Determined volume DB was empty at startup. Aug 26 14:21:34 devstack cinder-volume[94082]: DEBUG cinder.volume.manager [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] Cinder Volume DB check: vol_db_empty=True {{(pid=94082) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Aug 26 14:21:35 devstack cinder-volume[94082]: WARNING stevedore.named [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 26 14:21:35 devstack cinder-volume[94082]: WARNING castellan.key_manager [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 26 14:21:35 devstack cinder-volume[94082]: WARNING cinder.keymgr.conf_key_mgr [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 26 14:21:35 devstack cinder-volume[94082]: INFO cinder.volume.manager [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] Image-volume cache disabled for host devstack@QuobyteHD. Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_db.sqlalchemy.engines [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94082) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 26 14:21:35 devstack cinder-volume[94082]: INFO oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] Starting 1 workers Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] Started child 94394 {{(pid=94082) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] Full set of CONF: {{(pid=94082) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] ******************************************************************************** {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] Configuration options gathered from: {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] ================================================================================ {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] allow_availability_zone_fallback = False {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] allow_compression_on_image_upload = False {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] allowed_direct_url_schemes = [] {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] api_rate_limit = True {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] auth_strategy = keystone {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] backend_availability_zone = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] backend_host = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] backend_name = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] backend_stats_polling_interval = 60 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] backup_api_class = cinder.backup.api.API {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] backup_name_template = backup-%s {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] backup_use_same_host = False {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] backup_use_temp_snapshot = False {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94394]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] chap_password = **** {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] chap_username = {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] cinder_internal_tenant_project_id = 74cd0dea6428401d898b8535eb1abbbf {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] cinder_internal_tenant_user_id = 2cf395441d19444ea88d57af1aa42cdb {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] cluster = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] compression_format = gzip {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] compute_api_class = cinder.compute.nova.API {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] config_dir = [] {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] config_source = [] {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] control_exchange = openstack {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] debug = True {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] default_availability_zone = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] default_group_type = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] default_volume_type = QuobyteHD {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] disk_geometry = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] driver_client_cert = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] driver_client_cert_key = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] driver_data_namespace = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] driver_ssl_cert_path = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] driver_ssl_cert_verify = False {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] driver_use_ssl = False {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] enable_new_services = True {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] enable_unsupported_driver = False {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] enabled_backends = ['QuobyteHD'] {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] enforce_multipath_for_image_xfer = False {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] filter_function = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] glance_api_insecure = False {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] glance_api_servers = ['http://192.168.122.164/image'] {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] glance_api_ssl_compression = False {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] glance_ca_certificates_file = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] glance_catalog_info = image:glance:publicURL {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] glance_certfile = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] glance_keyfile = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] glance_num_retries = 3 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] glance_request_timeout = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] goodness_function = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] graceful_shutdown_timeout = 5 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] group_api_class = cinder.group.api.API {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] host = devstack {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] image_compress_on_upload = True {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] image_conversion_address_space_limit = 1 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] image_conversion_cpu_limit = 60 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] image_conversion_disable = False {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] image_upload_use_cinder_backend = False {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] image_upload_use_internal_tenant = False {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] image_volume_cache_enabled = False {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] image_volume_cache_max_count = 0 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] image_volume_cache_max_size_gb = 0 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] init_host_max_objects_retrieval = 0 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] instance_format = [instance: %(uuid)s] {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] iscsi_target_flags = {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] iscsi_write_cache = on {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] iser_helper = tgtadm {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] iser_ip_address = 192.168.122.164 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] iser_port = 3260 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] log_color = False {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] log_config_append = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] log_dir = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] log_file = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] log_options = True {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] log_rotate_interval = 1 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] log_rotate_interval_type = days {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] log_rotation_type = none {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack sudo[94399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] max_age = 0 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] max_logfile_count = 30 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] max_logfile_size_mb = 200 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] max_over_subscription_ratio = 20.0 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] message_reap_interval = 86400 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] message_ttl = 2592000 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] migration_create_volume_timeout_secs = 300 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack sudo[94399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] monkey_patch = False {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] monkey_patch_modules = [] {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] my_ip = 192.168.122.164 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] no_snapshot_gb_quota = False {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] num_iser_scan_tries = 3 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] num_shell_tries = 3 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] num_volume_device_scan_tries = 3 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] nvmeof_conn_info_version = 1 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] nvmet_ns_id = 10 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] nvmet_port_id = 1 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] osapi_max_limit = 1000 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] osapi_volume_ext_list = [] {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] osapi_volume_listen = 0.0.0.0 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] osapi_volume_listen_port = 8776 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] osapi_volume_use_ssl = False {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] osapi_volume_workers = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] per_volume_size_limit = -1 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] periodic_fuzzy_delay = 60 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] periodic_interval = 60 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] project_id_regex = [0-9a-f\-]+ {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] public_endpoint = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] publish_errors = False {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] quota_backup_gigabytes = 1000 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] quota_backups = 10 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] quota_gigabytes = 1000 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] quota_groups = 10 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] quota_snapshots = 10 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] quota_volumes = 10 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] rate_limit_burst = 0 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] rate_limit_except_level = CRITICAL {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] rate_limit_interval = 0 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] reinit_driver_count = 3 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] replication_device = **** {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] report_discard_supported = False {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] report_interval = 120 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] reservation_clean_interval = 86400 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] reservation_expire = 86400 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] reserved_image_namespaces = [] {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] reserved_percentage = 0 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-115faf15-1997-40dc-a6fa-aaba6693aefb None None] Starting volume driver QuobyteDriver (1.2.1) Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-115faf15-1997-40dc-a6fa-aaba6693aefb None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=94394) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] rpc_response_timeout = 120 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] run_external_periodic_tasks = True {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] scst_target_driver = iscsi {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] scst_target_iqn_name = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] service_down_time = 720 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] shell_completion = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] snapshot_name_template = snapshot-%s {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] split_loggers = False {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] state_path = /opt/stack/data/cinder {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] storage_availability_zone = nova {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] storage_protocol = iSCSI {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] syslog_log_facility = LOG_USER {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] target_helper = lioadm {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] target_ip_address = 192.168.122.164 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] target_port = 3260 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] target_protocol = iscsi {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] target_secondary_ip_addresses = [] {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] trace_flags = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] transfer_api_class = cinder.transfer.api.API {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] transport_url = **** {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] until_refresh = 0 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] use_chap_auth = False {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] use_default_quota_class = True {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] use_journal = False {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] use_json = False {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] use_multipath_for_image_xfer = False {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] use_stderr = False {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] use_syslog = False {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] verify_glance_signatures = enabled {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] volume_api_class = cinder.volume.api.API {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] volume_backend_name = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] volume_clear = zero {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] volume_clear_ionice = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] volume_clear_size = 0 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] volume_copy_bps_limit = 0 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] volume_dd_blocksize = 1M {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] volume_name_template = volume-%s {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] volume_service_inithost_offload = False {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] volume_usage_audit_period = month {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] zoning_mode = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] oslo_concurrency.disable_process_locking = False {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] os_brick.lightos_discovery_client_address = localhost {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] os_brick.wait_mpath_device_interval = 1 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] keystone_authtoken.auth_section = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] keystone_authtoken.auth_type = password {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] keystone_authtoken.auth_version = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] keystone_authtoken.cache = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] keystone_authtoken.certfile = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] keystone_authtoken.delay_auth_decision = False {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] keystone_authtoken.http_connect_timeout = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] keystone_authtoken.include_service_catalog = True {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] keystone_authtoken.insecure = False {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] keystone_authtoken.interface = public {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] keystone_authtoken.keyfile = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] keystone_authtoken.memcache_password = **** {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] keystone_authtoken.memcache_secret_key = **** {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] keystone_authtoken.memcache_security_strategy = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] keystone_authtoken.memcache_username = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] keystone_authtoken.region_name = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] keystone_authtoken.service_token_roles_required = True {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] keystone_authtoken.service_type = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] keystone_authtoken.token_cache_time = 300 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.164/identity {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] cache.backend = dogpile.cache.null {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] cache.backend_argument = **** {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] cache.backend_expiration_time = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] cache.config_prefix = cache.oslo {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] cache.debug_cache_backend = False {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] cache.enable_retry_client = False {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] cache.enable_socket_keepalive = False {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] cache.enabled = False {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] cache.expiration_time = 600 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] cache.hashclient_dead_timeout = 60.0 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] cache.hashclient_retry_attempts = 2 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] cache.hashclient_retry_timeout = 1.0 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] cache.memcache_dead_retry = 300 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] cache.memcache_pool_maxsize = 10 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] cache.memcache_pool_unused_timeout = 60 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] cache.memcache_sasl_enabled = False {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] cache.memcache_servers = ['localhost:11211'] {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] cache.password = **** {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] cache.proxies = [] {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] cache.redis_db = 0 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] cache.redis_sentinel_service_name = mymaster {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] cache.redis_server = localhost:6379 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] cache.retry_attempts = 2 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] cache.retry_delay = 0.0 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] cache.socket_keepalive_count = 1 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] cache.socket_keepalive_idle = 1 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] cache.socket_keepalive_interval = 1 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] cache.socket_timeout = 1.0 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] cache.tls_allowed_ciphers = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] cache.tls_cafile = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] cache.tls_certfile = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] cache.tls_enabled = False {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] cache.tls_keyfile = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] cache.username = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] coordination.backend_url = **** {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] database.asyncio_connection = **** {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] database.asyncio_slave_connection = **** {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] database.backend = sqlalchemy {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] database.connection = **** {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] database.connection_debug = 0 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] database.connection_parameters = {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] database.connection_recycle_time = 3600 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] database.connection_trace = False {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] database.db_inc_retry_interval = True {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] database.db_max_retries = 20 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] database.db_max_retry_interval = 10 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] database.db_retry_interval = 1 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] database.max_overflow = 50 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] database.max_pool_size = 5 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] database.max_retries = 10 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] database.mysql_sql_mode = TRADITIONAL {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] database.mysql_wsrep_sync_wait = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] database.pool_timeout = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] database.retry_interval = 10 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] database.slave_connection = **** {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] database.sqlite_synchronous = True {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] database.synchronous_reader = True {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] database.use_db_reconnect = False {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] oslo_messaging_metrics.metrics_process_name = {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] profiler.connection_string = messaging:// {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] profiler.enabled = False {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] profiler.es_doc_type = notification {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] profiler.es_scroll_size = 10000 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] profiler.es_scroll_time = 2m {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] profiler.filter_error_trace = False {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] profiler.hmac_keys = **** {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] profiler.sentinel_service_name = mymaster {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] profiler.socket_timeout = 0.1 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] profiler.trace_requests = False {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] profiler.trace_sqlalchemy = False {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] profiler_jaeger.process_tags = {} {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] profiler_jaeger.service_name_prefix = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] profiler_otlp.service_name_prefix = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] oslo_policy.enforce_new_defaults = True {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] oslo_policy.policy_default_rule = default {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] oslo_policy.policy_file = policy.yaml {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] oslo_policy.remote_timeout = 60.0 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] privsep_osbrick.capabilities = [21, 2] {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] privsep_osbrick.group = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] privsep_osbrick.helper_command = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] privsep_osbrick.log_daemon_traceback = False {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] privsep_osbrick.thread_pool_size = 4 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] privsep_osbrick.user = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] cinder_sys_admin.group = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] cinder_sys_admin.helper_command = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] cinder_sys_admin.user = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] service_user.auth_section = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] service_user.auth_type = password {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] service_user.cafile = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] service_user.certfile = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] service_user.collect_timing = False {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] service_user.insecure = False {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] service_user.keyfile = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] service_user.send_service_user_token = True {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] service_user.split_loggers = False {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] service_user.timeout = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] glance.auth_section = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] glance.auth_type = password {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] glance.certfile = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] glance.collect_timing = False {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] glance.insecure = False {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] glance.keyfile = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] glance.region_name = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] glance.split_loggers = False {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] glance.timeout = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] backend_defaults.backend_availability_zone = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] backend_defaults.chap_password = **** {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] backend_defaults.chap_username = {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] backend_defaults.disk_geometry = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] backend_defaults.driver_client_cert = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] backend_defaults.driver_client_cert_key = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] backend_defaults.driver_data_namespace = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] backend_defaults.driver_ssl_cert_path = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] backend_defaults.driver_use_ssl = False {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] backend_defaults.enable_unsupported_driver = False {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] backend_defaults.extra_capabilities = {} {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] backend_defaults.filter_function = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] backend_defaults.goodness_function = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] backend_defaults.image_volume_cache_enabled = False {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] backend_defaults.iscsi_target_flags = {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] backend_defaults.iscsi_write_cache = on {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] backend_defaults.iser_helper = tgtadm {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] backend_defaults.iser_ip_address = 192.168.122.164 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] backend_defaults.iser_port = 3260 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] backend_defaults.nas_host = {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] backend_defaults.nas_login = admin {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] backend_defaults.nas_mount_options = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] backend_defaults.nas_password = **** {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] backend_defaults.nas_private_key = {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] backend_defaults.nas_secure_file_operations = auto {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] backend_defaults.nas_share_path = {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] backend_defaults.nas_ssh_port = 22 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] backend_defaults.nas_volume_prov_type = thin {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] backend_defaults.num_shell_tries = 3 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] backend_defaults.nvmet_ns_id = 10 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] backend_defaults.nvmet_port_id = 1 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] backend_defaults.quobyte_client_cfg = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] backend_defaults.quobyte_volume_url = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] backend_defaults.replication_device = **** {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] backend_defaults.report_discard_supported = False {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] backend_defaults.reserved_percentage = 0 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] backend_defaults.scst_target_driver = iscsi {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] backend_defaults.scst_target_iqn_name = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] backend_defaults.storage_protocol = iSCSI {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] backend_defaults.target_helper = tgtadm {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] backend_defaults.target_ip_address = 192.168.122.164 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] backend_defaults.target_port = 3260 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] backend_defaults.target_protocol = iscsi {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] backend_defaults.trace_flags = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] backend_defaults.unique_fqdn_network = True {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] backend_defaults.use_chap_auth = False {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] backend_defaults.volume_backend_name = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] backend_defaults.volume_clear = zero {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] backend_defaults.volume_clear_ionice = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] backend_defaults.volume_clear_size = 0 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] oslo_reports.file_event_handler = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] oslo_reports.file_event_handler_interval = 1 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] oslo_reports.log_dir = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] QuobyteHD.backend_availability_zone = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] QuobyteHD.backend_host = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] QuobyteHD.chap_password = **** {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] QuobyteHD.chap_username = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] QuobyteHD.chiscsi_conf = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] QuobyteHD.disk_geometry = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] QuobyteHD.driver_client_cert = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] QuobyteHD.driver_client_cert_key = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] QuobyteHD.driver_data_namespace = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] QuobyteHD.driver_use_ssl = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] QuobyteHD.enable_unsupported_driver = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] QuobyteHD.extra_capabilities = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] QuobyteHD.filter_function = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] QuobyteHD.goodness_function = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] QuobyteHD.iscsi_target_flags = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] QuobyteHD.iscsi_write_cache = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-115faf15-1997-40dc-a6fa-aaba6693aefb None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=94394) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Aug 26 14:21:35 devstack cinder-volume[94394]: WARNING cinder.volume.drivers.quobyte [None req-115faf15-1997-40dc-a6fa-aaba6693aefb None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Aug 26 14:21:35 devstack cinder-volume[94394]: WARNING cinder.volume.drivers.quobyte [None req-115faf15-1997-40dc-a6fa-aaba6693aefb None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] QuobyteHD.iser_helper = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] QuobyteHD.iser_ip_address = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] QuobyteHD.iser_port = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] QuobyteHD.iser_target_prefix = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] QuobyteHD.nas_host = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] QuobyteHD.nas_login = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] QuobyteHD.nas_mount_options = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] QuobyteHD.nas_password = **** {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] QuobyteHD.nas_private_key = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-115faf15-1997-40dc-a6fa-aaba6693aefb None None] Running cmd (subprocess): mount.quobyte {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] QuobyteHD.nas_secure_file_operations = false {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] QuobyteHD.nas_share_path = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] QuobyteHD.nas_ssh_port = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] QuobyteHD.nas_volume_prov_type = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] QuobyteHD.num_iser_scan_tries = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] QuobyteHD.num_shell_tries = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] QuobyteHD.nvmet_ns_id = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] QuobyteHD.nvmet_port_id = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] QuobyteHD.replication_device = **** {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] QuobyteHD.report_discard_supported = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] QuobyteHD.reserved_percentage = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] QuobyteHD.scst_target_driver = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] QuobyteHD.scst_target_iqn_name = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] QuobyteHD.storage_protocol = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] QuobyteHD.target_helper = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] QuobyteHD.target_ip_address = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] QuobyteHD.target_port = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] QuobyteHD.target_prefix = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] QuobyteHD.target_protocol = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] QuobyteHD.trace_flags = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] QuobyteHD.unique_fqdn_network = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] QuobyteHD.use_chap_auth = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] QuobyteHD.volume_clear = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] QuobyteHD.volume_clear_ionice = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] QuobyteHD.volume_clear_size = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] QuobyteHD.volume_dd_blocksize = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] QuobyteHD.volumes_dir = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] oslo_messaging_rabbit.hostname = devstack {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] oslo_messaging_rabbit.ssl = False {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] oslo_messaging_rabbit.ssl_version = {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] oslo_messaging_notifications.driver = [] {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] oslo_messaging_notifications.retry = -1 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] oslo_messaging_notifications.transport_url = **** {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] key_manager.fixed_key = **** {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] barbican.barbican_api_version = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] barbican.barbican_endpoint = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] barbican.barbican_endpoint_type = public {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] barbican.barbican_region_name = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] barbican.cafile = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] barbican.certfile = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] barbican.collect_timing = False {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] barbican.insecure = False {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] barbican.keyfile = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] barbican.number_of_retries = 60 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] barbican.retry_delay = 1 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] barbican.send_service_user_token = False {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] barbican.split_loggers = False {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] barbican.timeout = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] barbican.verify_ssl = True {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] barbican.verify_ssl_path = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] barbican_service_user.auth_section = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] barbican_service_user.auth_type = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] barbican_service_user.cafile = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] barbican_service_user.certfile = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] barbican_service_user.collect_timing = False {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] barbican_service_user.insecure = False {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] barbican_service_user.keyfile = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] barbican_service_user.split_loggers = False {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] barbican_service_user.timeout = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] vault.approle_role_id = **** {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] vault.approle_secret_id = **** {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] vault.auth_method = approle {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] vault.auth_path = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] vault.kv_mountpoint = secret {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] vault.kv_path = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] vault.kv_version = 2 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] vault.namespace = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] vault.root_token_id = **** {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] vault.ssl_ca_crt_file = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] vault.timeout = 60.0 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] vault.token_file = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] vault.token_role = None {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] vault.use_ssl = False {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 14:21:35 devstack cinder-volume[94082]: DEBUG oslo_service.backend._eventlet.service [None req-d15852c6-bd33-440a-b594-c8e85970a05b None None] ******************************************************************************** {{(pid=94082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Aug 26 14:21:35 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-115faf15-1997-40dc-a6fa-aaba6693aefb None None] CMD "mount.quobyte" returned: 1 in 0.082s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:21:35 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-115faf15-1997-40dc-a6fa-aaba6693aefb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:21:35 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-115faf15-1997-40dc-a6fa-aaba6693aefb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:21:35 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-115faf15-1997-40dc-a6fa-aaba6693aefb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:21:35 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-115faf15-1997-40dc-a6fa-aaba6693aefb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:21:35 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-115faf15-1997-40dc-a6fa-aaba6693aefb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:21:35 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-115faf15-1997-40dc-a6fa-aaba6693aefb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:21:35 devstack sudo[94399]: pam_unix(sudo:session): session closed for user root Aug 26 14:21:35 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-115faf15-1997-40dc-a6fa-aaba6693aefb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.272s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:21:35 devstack cinder-volume[94394]: INFO cinder.volume.driver [None req-115faf15-1997-40dc-a6fa-aaba6693aefb None None] Driver hasn't implemented _init_vendor_properties() Aug 26 14:21:35 devstack cinder-volume[94394]: DEBUG cinder.volume.driver [None req-115faf15-1997-40dc-a6fa-aaba6693aefb None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.8208618164062, 'free_capacity_gb': 1774.8208618164062, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=94394) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Aug 26 14:21:35 devstack cinder-volume[94394]: DEBUG oslo_db.sqlalchemy.engines [None req-115faf15-1997-40dc-a6fa-aaba6693aefb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94394) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 26 14:21:35 devstack cinder-volume[94394]: DEBUG dbcounter [-] [94394] Writer thread running {{(pid=94394) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 26 14:21:35 devstack cinder-volume[94394]: DEBUG cinder.db.api [None req-115faf15-1997-40dc-a6fa-aaba6693aefb None None] Building query based on filter {{(pid=94394) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Aug 26 14:21:35 devstack cinder-volume[94394]: DEBUG cinder.image.image_utils [None req-115faf15-1997-40dc-a6fa-aaba6693aefb None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=94394) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Aug 26 14:21:35 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-115faf15-1997-40dc-a6fa-aaba6693aefb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:21:35 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-115faf15-1997-40dc-a6fa-aaba6693aefb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:21:35 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-115faf15-1997-40dc-a6fa-aaba6693aefb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:21:35 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-115faf15-1997-40dc-a6fa-aaba6693aefb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:21:35 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-115faf15-1997-40dc-a6fa-aaba6693aefb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:21:35 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-115faf15-1997-40dc-a6fa-aaba6693aefb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:21:35 devstack cinder-volume[94394]: INFO cinder.keymgr.migration [None req-e4b3266b-3045-475b-88c1-ed65fa11c9f8 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Aug 26 14:21:35 devstack sudo[94407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:21:35 devstack sudo[94407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:21:36 devstack sudo[94407]: pam_unix(sudo:session): session closed for user root Aug 26 14:21:36 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-115faf15-1997-40dc-a6fa-aaba6693aefb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.282s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:21:36 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-115faf15-1997-40dc-a6fa-aaba6693aefb None None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:21:36 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-115faf15-1997-40dc-a6fa-aaba6693aefb None None] Driver initialization completed successfully. Aug 26 14:21:36 devstack cinder-volume[94394]: INFO cinder.manager [None req-115faf15-1997-40dc-a6fa-aaba6693aefb None None] Initiating service 3 cleanup Aug 26 14:21:36 devstack cinder-volume[94394]: INFO cinder.manager [None req-115faf15-1997-40dc-a6fa-aaba6693aefb None None] Service 3 cleanup completed. Aug 26 14:21:36 devstack cinder-volume[94394]: DEBUG cinder.service [None req-115faf15-1997-40dc-a6fa-aaba6693aefb None None] Creating RPC server for service cinder-volume {{(pid=94394) start /opt/stack/cinder/cinder/service.py:231}} Aug 26 14:21:36 devstack cinder-volume[94394]: DEBUG cinder.service [None req-115faf15-1997-40dc-a6fa-aaba6693aefb None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=94394) start /opt/stack/cinder/cinder/service.py:237}} Aug 26 14:21:36 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-115faf15-1997-40dc-a6fa-aaba6693aefb None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Aug 26 14:21:36 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-115faf15-1997-40dc-a6fa-aaba6693aefb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:21:36 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-115faf15-1997-40dc-a6fa-aaba6693aefb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:21:36 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-115faf15-1997-40dc-a6fa-aaba6693aefb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:21:36 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-115faf15-1997-40dc-a6fa-aaba6693aefb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:21:36 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-115faf15-1997-40dc-a6fa-aaba6693aefb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:21:36 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-115faf15-1997-40dc-a6fa-aaba6693aefb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:21:36 devstack sudo[94417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:21:36 devstack sudo[94417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:21:36 devstack sudo[94417]: pam_unix(sudo:session): session closed for user root Aug 26 14:21:36 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-115faf15-1997-40dc-a6fa-aaba6693aefb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.234s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:21:36 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-115faf15-1997-40dc-a6fa-aaba6693aefb None None] Driver post RPC initialization completed successfully. Aug 26 14:21:45 devstack cinder-volume[94082]: DEBUG dbcounter [-] [94082] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=94082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 14:21:46 devstack cinder-volume[94394]: DEBUG dbcounter [-] [94394] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=94394) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 14:21:46 devstack cinder-volume[94394]: DEBUG dbcounter [-] [94394] Writing DB stats cinder:SELECT=3 {{(pid=94394) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 14:22:33 devstack cinder-volume[94394]: DEBUG oslo_service.periodic_task [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Running periodic task VolumeManager._thread_info {{(pid=94394) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 14:22:33 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] thread count: 6 {{(pid=94394) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 14:22:33 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] thread info: [<_MainThread(MainThread, started 126600738033792)>, , , , , ] {{(pid=94394) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 14:22:35 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1427f1e-221b-4064-976a-932bef20c318 tempest-TaggedAttachmentsTest-331859631 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:22:35 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-c1427f1e-221b-4064-976a-932bef20c318 tempest-TaggedAttachmentsTest-331859631 None] Flow 'volume_create_manager' (b2b0a672-11f5-4c51-b4d4-6c3f5e5b635c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:22:35 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-c1427f1e-221b-4064-976a-932bef20c318 tempest-TaggedAttachmentsTest-331859631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (819382e3-c75e-4a35-b731-b680fc9f98d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:22:35 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-c1427f1e-221b-4064-976a-932bef20c318 tempest-TaggedAttachmentsTest-331859631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (819382e3-c75e-4a35-b731-b680fc9f98d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:22:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1497129083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26d71c7a-3059-4d6a-ac06-2cf82d2b06f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c35d96a81e24864a80ad0fed893e339',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:22:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:22:35Z,use_quota=True,user_id='51556800a6d342a597999536c8e8b1fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:22:35 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-c1427f1e-221b-4064-976a-932bef20c318 tempest-TaggedAttachmentsTest-331859631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (612a6e83-70ef-41df-9122-c9a5b78dda16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:22:35 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-c1427f1e-221b-4064-976a-932bef20c318 tempest-TaggedAttachmentsTest-331859631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (612a6e83-70ef-41df-9122-c9a5b78dda16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:22:35 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-c1427f1e-221b-4064-976a-932bef20c318 tempest-TaggedAttachmentsTest-331859631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb2d8e19-670b-4f5c-95a6-8466f72e17aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:22:35 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-c1427f1e-221b-4064-976a-932bef20c318 tempest-TaggedAttachmentsTest-331859631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb2d8e19-670b-4f5c-95a6-8466f72e17aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26d71c7a-3059-4d6a-ac06-2cf82d2b06f2', 'volume_name': 'volume-26d71c7a-3059-4d6a-ac06-2cf82d2b06f2', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:22:35 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-c1427f1e-221b-4064-976a-932bef20c318 tempest-TaggedAttachmentsTest-331859631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (347ef110-9e4f-471f-bca2-0fd53763aba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:22:35 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-c1427f1e-221b-4064-976a-932bef20c318 tempest-TaggedAttachmentsTest-331859631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (347ef110-9e4f-471f-bca2-0fd53763aba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:22:35 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-c1427f1e-221b-4064-976a-932bef20c318 tempest-TaggedAttachmentsTest-331859631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a56cfe58-27da-409b-b207-370e27d5085c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:22:35 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-c1427f1e-221b-4064-976a-932bef20c318 tempest-TaggedAttachmentsTest-331859631 None] Volume 26d71c7a-3059-4d6a-ac06-2cf82d2b06f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26d71c7a-3059-4d6a-ac06-2cf82d2b06f2', 'volume_size': 1} Aug 26 14:22:35 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-c1427f1e-221b-4064-976a-932bef20c318 tempest-TaggedAttachmentsTest-331859631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:22:35 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-c1427f1e-221b-4064-976a-932bef20c318 tempest-TaggedAttachmentsTest-331859631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:22:35 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-c1427f1e-221b-4064-976a-932bef20c318 tempest-TaggedAttachmentsTest-331859631 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:22:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1497129083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26d71c7a-3059-4d6a-ac06-2cf82d2b06f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c35d96a81e24864a80ad0fed893e339',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:22:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:22:35Z,use_quota=True,user_id='51556800a6d342a597999536c8e8b1fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:22:35 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-c1427f1e-221b-4064-976a-932bef20c318 tempest-TaggedAttachmentsTest-331859631 None] Creating volume 26d71c7a-3059-4d6a-ac06-2cf82d2b06f2 {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:22:35 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-c1427f1e-221b-4064-976a-932bef20c318 tempest-TaggedAttachmentsTest-331859631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:22:35 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-c1427f1e-221b-4064-976a-932bef20c318 tempest-TaggedAttachmentsTest-331859631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:22:35 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-c1427f1e-221b-4064-976a-932bef20c318 tempest-TaggedAttachmentsTest-331859631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:22:35 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-c1427f1e-221b-4064-976a-932bef20c318 tempest-TaggedAttachmentsTest-331859631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:22:35 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-c1427f1e-221b-4064-976a-932bef20c318 tempest-TaggedAttachmentsTest-331859631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:22:35 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-c1427f1e-221b-4064-976a-932bef20c318 tempest-TaggedAttachmentsTest-331859631 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:22:35 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-c1427f1e-221b-4064-976a-932bef20c318 tempest-TaggedAttachmentsTest-331859631 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:22:35 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-c1427f1e-221b-4064-976a-932bef20c318 tempest-TaggedAttachmentsTest-331859631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-26d71c7a-3059-4d6a-ac06-2cf82d2b06f2 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:22:35 devstack sudo[94876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-26d71c7a-3059-4d6a-ac06-2cf82d2b06f2 1073741824 Aug 26 14:22:35 devstack sudo[94876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:22:36 devstack sudo[94876]: pam_unix(sudo:session): session closed for user root Aug 26 14:22:36 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-c1427f1e-221b-4064-976a-932bef20c318 tempest-TaggedAttachmentsTest-331859631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-26d71c7a-3059-4d6a-ac06-2cf82d2b06f2 1073741824" returned: 0 in 1.236s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:22:36 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-c1427f1e-221b-4064-976a-932bef20c318 tempest-TaggedAttachmentsTest-331859631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-26d71c7a-3059-4d6a-ac06-2cf82d2b06f2 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:22:36 devstack sudo[95247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-26d71c7a-3059-4d6a-ac06-2cf82d2b06f2 Aug 26 14:22:36 devstack sudo[95247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:22:37 devstack sudo[95247]: pam_unix(sudo:session): session closed for user root Aug 26 14:22:37 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-c1427f1e-221b-4064-976a-932bef20c318 tempest-TaggedAttachmentsTest-331859631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-26d71c7a-3059-4d6a-ac06-2cf82d2b06f2" returned: 0 in 0.679s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:22:37 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-c1427f1e-221b-4064-976a-932bef20c318 tempest-TaggedAttachmentsTest-331859631 None] <== create_volume: return (2106ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:22:37 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-c1427f1e-221b-4064-976a-932bef20c318 tempest-TaggedAttachmentsTest-331859631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.115s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:22:37 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-c1427f1e-221b-4064-976a-932bef20c318 tempest-TaggedAttachmentsTest-331859631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a56cfe58-27da-409b-b207-370e27d5085c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26d71c7a-3059-4d6a-ac06-2cf82d2b06f2', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:22:37 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-c1427f1e-221b-4064-976a-932bef20c318 tempest-TaggedAttachmentsTest-331859631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54387cb4-dc12-43ee-91c6-7a2437b263f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:22:37 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-c1427f1e-221b-4064-976a-932bef20c318 tempest-TaggedAttachmentsTest-331859631 None] Volume volume-26d71c7a-3059-4d6a-ac06-2cf82d2b06f2 (26d71c7a-3059-4d6a-ac06-2cf82d2b06f2): created successfully Aug 26 14:22:37 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-c1427f1e-221b-4064-976a-932bef20c318 tempest-TaggedAttachmentsTest-331859631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54387cb4-dc12-43ee-91c6-7a2437b263f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:22:37 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-c1427f1e-221b-4064-976a-932bef20c318 tempest-TaggedAttachmentsTest-331859631 None] Flow 'volume_create_manager' (b2b0a672-11f5-4c51-b4d4-6c3f5e5b635c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:22:37 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-c1427f1e-221b-4064-976a-932bef20c318 tempest-TaggedAttachmentsTest-331859631 None] Created volume successfully. Aug 26 14:22:47 devstack cinder-volume[94394]: DEBUG dbcounter [-] [94394] Writing DB stats cinder:SELECT=1,cinder:UPDATE=3 {{(pid=94394) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 14:22:47 devstack cinder-volume[94394]: DEBUG dbcounter [-] [94394] Writing DB stats cinder:SELECT=3,cinder:UPDATE=3,cinder:INSERT=1,cinder:DELETE=1 {{(pid=94394) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 14:22:58 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-8faad88a-7a13-4e73-9207-7daa4cd7462e tempest-ServerRescueNegativeTestJSON-407889640 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:22:58 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-8faad88a-7a13-4e73-9207-7daa4cd7462e tempest-ServerRescueNegativeTestJSON-407889640 None] Flow 'volume_create_manager' (cd837182-580c-44c2-a84b-09acc5529ecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:22:58 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-8faad88a-7a13-4e73-9207-7daa4cd7462e tempest-ServerRescueNegativeTestJSON-407889640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68541c9d-bdc7-4b39-aa8f-9c37895cb45e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:22:58 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-8faad88a-7a13-4e73-9207-7daa4cd7462e tempest-ServerRescueNegativeTestJSON-407889640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68541c9d-bdc7-4b39-aa8f-9c37895cb45e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:22:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1992754968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6554f49-df91-4a46-8ad7-c6c974faa969,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bb45001ae0047718e8cf6a16ec1ff51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:22:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:22:59Z,use_quota=True,user_id='3e0d6d79b9d94e7b903704d5a7c87458',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:22:58 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-8faad88a-7a13-4e73-9207-7daa4cd7462e tempest-ServerRescueNegativeTestJSON-407889640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77e09168-5fe2-45b3-8a80-828b2c783f7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:22:58 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-8faad88a-7a13-4e73-9207-7daa4cd7462e tempest-ServerRescueNegativeTestJSON-407889640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77e09168-5fe2-45b3-8a80-828b2c783f7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:22:58 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-8faad88a-7a13-4e73-9207-7daa4cd7462e tempest-ServerRescueNegativeTestJSON-407889640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4369d8d-094b-4a4e-aa29-67c2db471916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:22:58 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-8faad88a-7a13-4e73-9207-7daa4cd7462e tempest-ServerRescueNegativeTestJSON-407889640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4369d8d-094b-4a4e-aa29-67c2db471916) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6554f49-df91-4a46-8ad7-c6c974faa969', 'volume_name': 'volume-a6554f49-df91-4a46-8ad7-c6c974faa969', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:22:58 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-8faad88a-7a13-4e73-9207-7daa4cd7462e tempest-ServerRescueNegativeTestJSON-407889640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c48e0f7-dffd-40cd-ae27-7afc51c7433d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:22:58 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-8faad88a-7a13-4e73-9207-7daa4cd7462e tempest-ServerRescueNegativeTestJSON-407889640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c48e0f7-dffd-40cd-ae27-7afc51c7433d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:22:58 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-8faad88a-7a13-4e73-9207-7daa4cd7462e tempest-ServerRescueNegativeTestJSON-407889640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (799ab1fb-2e6f-49fc-99b5-fee274477d73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:22:58 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-8faad88a-7a13-4e73-9207-7daa4cd7462e tempest-ServerRescueNegativeTestJSON-407889640 None] Volume a6554f49-df91-4a46-8ad7-c6c974faa969: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6554f49-df91-4a46-8ad7-c6c974faa969', 'volume_size': 1} Aug 26 14:22:58 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-8faad88a-7a13-4e73-9207-7daa4cd7462e tempest-ServerRescueNegativeTestJSON-407889640 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:22:58 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-8faad88a-7a13-4e73-9207-7daa4cd7462e tempest-ServerRescueNegativeTestJSON-407889640 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:22:58 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-8faad88a-7a13-4e73-9207-7daa4cd7462e tempest-ServerRescueNegativeTestJSON-407889640 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:22:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1992754968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6554f49-df91-4a46-8ad7-c6c974faa969,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bb45001ae0047718e8cf6a16ec1ff51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:22:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:22:59Z,use_quota=True,user_id='3e0d6d79b9d94e7b903704d5a7c87458',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:22:58 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-8faad88a-7a13-4e73-9207-7daa4cd7462e tempest-ServerRescueNegativeTestJSON-407889640 None] Creating volume a6554f49-df91-4a46-8ad7-c6c974faa969 {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:22:58 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-8faad88a-7a13-4e73-9207-7daa4cd7462e tempest-ServerRescueNegativeTestJSON-407889640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:22:58 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-8faad88a-7a13-4e73-9207-7daa4cd7462e tempest-ServerRescueNegativeTestJSON-407889640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:22:58 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-8faad88a-7a13-4e73-9207-7daa4cd7462e tempest-ServerRescueNegativeTestJSON-407889640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:22:58 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-8faad88a-7a13-4e73-9207-7daa4cd7462e tempest-ServerRescueNegativeTestJSON-407889640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:22:58 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-8faad88a-7a13-4e73-9207-7daa4cd7462e tempest-ServerRescueNegativeTestJSON-407889640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:22:58 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-8faad88a-7a13-4e73-9207-7daa4cd7462e tempest-ServerRescueNegativeTestJSON-407889640 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:22:58 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-8faad88a-7a13-4e73-9207-7daa4cd7462e tempest-ServerRescueNegativeTestJSON-407889640 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:22:58 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-8faad88a-7a13-4e73-9207-7daa4cd7462e tempest-ServerRescueNegativeTestJSON-407889640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-a6554f49-df91-4a46-8ad7-c6c974faa969 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:22:58 devstack sudo[95587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-a6554f49-df91-4a46-8ad7-c6c974faa969 1073741824 Aug 26 14:22:58 devstack sudo[95587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:22:59 devstack sudo[95587]: pam_unix(sudo:session): session closed for user root Aug 26 14:22:59 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-8faad88a-7a13-4e73-9207-7daa4cd7462e tempest-ServerRescueNegativeTestJSON-407889640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-a6554f49-df91-4a46-8ad7-c6c974faa969 1073741824" returned: 0 in 1.035s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:22:59 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-8faad88a-7a13-4e73-9207-7daa4cd7462e tempest-ServerRescueNegativeTestJSON-407889640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-a6554f49-df91-4a46-8ad7-c6c974faa969 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:22:59 devstack sudo[95596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-a6554f49-df91-4a46-8ad7-c6c974faa969 Aug 26 14:22:59 devstack sudo[95596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:23:00 devstack sudo[95596]: pam_unix(sudo:session): session closed for user root Aug 26 14:23:00 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-8faad88a-7a13-4e73-9207-7daa4cd7462e tempest-ServerRescueNegativeTestJSON-407889640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-a6554f49-df91-4a46-8ad7-c6c974faa969" returned: 0 in 0.380s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:23:00 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-8faad88a-7a13-4e73-9207-7daa4cd7462e tempest-ServerRescueNegativeTestJSON-407889640 None] <== create_volume: return (1483ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:23:00 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-8faad88a-7a13-4e73-9207-7daa4cd7462e tempest-ServerRescueNegativeTestJSON-407889640 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.486s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:23:00 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-8faad88a-7a13-4e73-9207-7daa4cd7462e tempest-ServerRescueNegativeTestJSON-407889640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (799ab1fb-2e6f-49fc-99b5-fee274477d73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6554f49-df91-4a46-8ad7-c6c974faa969', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:23:00 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-8faad88a-7a13-4e73-9207-7daa4cd7462e tempest-ServerRescueNegativeTestJSON-407889640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6745426-525b-47d8-877f-2c0b756edc6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:23:00 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-8faad88a-7a13-4e73-9207-7daa4cd7462e tempest-ServerRescueNegativeTestJSON-407889640 None] Volume volume-a6554f49-df91-4a46-8ad7-c6c974faa969 (a6554f49-df91-4a46-8ad7-c6c974faa969): created successfully Aug 26 14:23:00 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-8faad88a-7a13-4e73-9207-7daa4cd7462e tempest-ServerRescueNegativeTestJSON-407889640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6745426-525b-47d8-877f-2c0b756edc6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:23:00 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-8faad88a-7a13-4e73-9207-7daa4cd7462e tempest-ServerRescueNegativeTestJSON-407889640 None] Flow 'volume_create_manager' (cd837182-580c-44c2-a84b-09acc5529ecd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:23:00 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-8faad88a-7a13-4e73-9207-7daa4cd7462e tempest-ServerRescueNegativeTestJSON-407889640 None] Created volume successfully. Aug 26 14:23:10 devstack cinder-volume[94394]: DEBUG dbcounter [-] [94394] Writing DB stats cinder:UPDATE=3,cinder:SELECT=1,cinder:INSERT=1 {{(pid=94394) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 14:23:10 devstack cinder-volume[94394]: DEBUG dbcounter [-] [94394] Writing DB stats cinder:SELECT=3,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=94394) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 14:23:13 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-e4441f35-d1b5-4fdc-87b7-4910a46b39d3 tempest-ServerRescueNegativeTestJSON-407889640 None] Acquiring lock "cinder-a6554f49-df91-4a46-8ad7-c6c974faa969-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:23:13 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-e4441f35-d1b5-4fdc-87b7-4910a46b39d3 tempest-ServerRescueNegativeTestJSON-407889640 None] Lock "cinder-a6554f49-df91-4a46-8ad7-c6c974faa969-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:23:13 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-e4441f35-d1b5-4fdc-87b7-4910a46b39d3 tempest-ServerRescueNegativeTestJSON-407889640 None] Acquiring lock "cinder-quobyte-a6554f49-df91-4a46-8ad7-c6c974faa969" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:23:13 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-e4441f35-d1b5-4fdc-87b7-4910a46b39d3 tempest-ServerRescueNegativeTestJSON-407889640 None] Lock "cinder-quobyte-a6554f49-df91-4a46-8ad7-c6c974faa969" acquired by "delete_volume" :: waited 0.030s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:23:13 devstack cinder-volume[94394]: INFO oslo.privsep.daemon [None req-e4441f35-d1b5-4fdc-87b7-4910a46b39d3 tempest-ServerRescueNegativeTestJSON-407889640 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpy95pelev/privsep.sock'] Aug 26 14:23:13 devstack sudo[95729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpy95pelev/privsep.sock Aug 26 14:23:13 devstack sudo[95729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:23:15 devstack cinder-volume[94394]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Aug 26 14:23:15 devstack cinder-volume[94394]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 26 14:23:15 devstack cinder-volume[94394]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Aug 26 14:23:15 devstack cinder-volume[94394]: WARNING oslo.privsep.daemon [-] privsep log: Aug 26 14:23:15 devstack cinder-volume[94394]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Aug 26 14:23:15 devstack cinder-volume[94394]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Aug 26 14:23:15 devstack cinder-volume[94394]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 26 14:23:15 devstack cinder-volume[94394]: WARNING oslo.privsep.daemon [-] privsep log: Aug 26 14:23:15 devstack cinder-volume[94394]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Aug 26 14:23:15 devstack sudo[95729]: pam_unix(sudo:session): session closed for user root Aug 26 14:23:15 devstack cinder-volume[94394]: INFO oslo.privsep.daemon [None req-e4441f35-d1b5-4fdc-87b7-4910a46b39d3 tempest-ServerRescueNegativeTestJSON-407889640 None] Spawned new privsep daemon via rootwrap Aug 26 14:23:15 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [None req-e4441f35-d1b5-4fdc-87b7-4910a46b39d3 tempest-ServerRescueNegativeTestJSON-407889640 None] Accepted privsep connection to /tmp/tmpy95pelev/privsep.sock {{(pid=94394) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Aug 26 14:23:15 devstack cinder-volume[94394]: INFO oslo.privsep.daemon [-] privsep daemon starting Aug 26 14:23:15 devstack cinder-volume[94394]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Aug 26 14:23:15 devstack cinder-volume[94394]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Aug 26 14:23:15 devstack cinder-volume[94394]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 95755 Aug 26 14:23:15 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8a094a6-571a-4249-bca5-c66ac95ba9c1]: (2,) {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:23:15 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b89b397-6d7c-466a-b0a6-9274f88b4cba]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:23:15 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e4441f35-d1b5-4fdc-87b7-4910a46b39d3 tempest-ServerRescueNegativeTestJSON-407889640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-a6554f49-df91-4a46-8ad7-c6c974faa969 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:23:15 devstack sudo[95766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-a6554f49-df91-4a46-8ad7-c6c974faa969 Aug 26 14:23:15 devstack sudo[95766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:23:15 devstack sudo[95766]: pam_unix(sudo:session): session closed for user root Aug 26 14:23:15 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e4441f35-d1b5-4fdc-87b7-4910a46b39d3 tempest-ServerRescueNegativeTestJSON-407889640 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-a6554f49-df91-4a46-8ad7-c6c974faa969" returned: 0 in 0.432s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:23:15 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e4441f35-d1b5-4fdc-87b7-4910a46b39d3 tempest-ServerRescueNegativeTestJSON-407889640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-a6554f49-df91-4a46-8ad7-c6c974faa969 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:23:15 devstack sudo[95773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-a6554f49-df91-4a46-8ad7-c6c974faa969 Aug 26 14:23:15 devstack sudo[95773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:23:16 devstack sudo[95773]: pam_unix(sudo:session): session closed for user root Aug 26 14:23:16 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e4441f35-d1b5-4fdc-87b7-4910a46b39d3 tempest-ServerRescueNegativeTestJSON-407889640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-a6554f49-df91-4a46-8ad7-c6c974faa969" returned: 0 in 0.323s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:23:16 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-e4441f35-d1b5-4fdc-87b7-4910a46b39d3 tempest-ServerRescueNegativeTestJSON-407889640 None] Lock "cinder-quobyte-a6554f49-df91-4a46-8ad7-c6c974faa969" released by "delete_volume" :: held 2.352s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:23:16 devstack cinder-volume[94394]: WARNING cinder.quota [None req-e4441f35-d1b5-4fdc-87b7-4910a46b39d3 tempest-ServerRescueNegativeTestJSON-407889640 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Aug 26 14:23:16 devstack cinder-volume[94394]: WARNING cinder.quota [None req-e4441f35-d1b5-4fdc-87b7-4910a46b39d3 tempest-ServerRescueNegativeTestJSON-407889640 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Aug 26 14:23:16 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-e4441f35-d1b5-4fdc-87b7-4910a46b39d3 tempest-ServerRescueNegativeTestJSON-407889640 None] Created reservations ['8f809f53-27a0-4b89-8d36-261abfdf6cb7', 'a33ef408-fe0d-4929-84d3-41278c1fe6a6', 'd1ef9472-2d07-4146-b07e-0481bef7c6a9', 'e3a76932-99af-435a-9450-3b2fac71318a'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:23:16 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e4441f35-d1b5-4fdc-87b7-4910a46b39d3 tempest-ServerRescueNegativeTestJSON-407889640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:23:16 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e4441f35-d1b5-4fdc-87b7-4910a46b39d3 tempest-ServerRescueNegativeTestJSON-407889640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:23:16 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-e4441f35-d1b5-4fdc-87b7-4910a46b39d3 tempest-ServerRescueNegativeTestJSON-407889640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:23:16 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-e4441f35-d1b5-4fdc-87b7-4910a46b39d3 tempest-ServerRescueNegativeTestJSON-407889640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:23:16 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e4441f35-d1b5-4fdc-87b7-4910a46b39d3 tempest-ServerRescueNegativeTestJSON-407889640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:23:16 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e4441f35-d1b5-4fdc-87b7-4910a46b39d3 tempest-ServerRescueNegativeTestJSON-407889640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:23:16 devstack sudo[95777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:23:16 devstack sudo[95777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:23:16 devstack sudo[95777]: pam_unix(sudo:session): session closed for user root Aug 26 14:23:16 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e4441f35-d1b5-4fdc-87b7-4910a46b39d3 tempest-ServerRescueNegativeTestJSON-407889640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.269s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:23:16 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-e4441f35-d1b5-4fdc-87b7-4910a46b39d3 tempest-ServerRescueNegativeTestJSON-407889640 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:23:16 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-e4441f35-d1b5-4fdc-87b7-4910a46b39d3 tempest-ServerRescueNegativeTestJSON-407889640 None] Deleted volume successfully. Aug 26 14:23:16 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-e4441f35-d1b5-4fdc-87b7-4910a46b39d3 tempest-ServerRescueNegativeTestJSON-407889640 None] Lock "cinder-a6554f49-df91-4a46-8ad7-c6c974faa969-delete_volume" released by "delete_volume" :: held 2.951s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:23:24 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-509ddc34-4077-4bfb-8307-c8604bb5ecc2 tempest-ServerActionsTestOtherA-177810280 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:23:24 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-509ddc34-4077-4bfb-8307-c8604bb5ecc2 tempest-ServerActionsTestOtherA-177810280 None] Flow 'volume_create_manager' (2eb8a901-2b3b-4982-b408-32f92d546336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:23:24 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-509ddc34-4077-4bfb-8307-c8604bb5ecc2 tempest-ServerActionsTestOtherA-177810280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (531e8c62-73ce-449b-8370-184c4f9d1d28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:23:24 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-509ddc34-4077-4bfb-8307-c8604bb5ecc2 tempest-ServerActionsTestOtherA-177810280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (531e8c62-73ce-449b-8370-184c4f9d1d28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:23:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1683194204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=941128c9-af6f-409e-acc7-30ee4961080f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19ca4f3446574d1789d1fb3d467a7392',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:23:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:23:24Z,use_quota=True,user_id='808344d184d94b1c8fce92d044169973',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:23:24 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-509ddc34-4077-4bfb-8307-c8604bb5ecc2 tempest-ServerActionsTestOtherA-177810280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09978e2e-ca92-4af5-9751-af6025c149d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:23:24 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-509ddc34-4077-4bfb-8307-c8604bb5ecc2 tempest-ServerActionsTestOtherA-177810280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09978e2e-ca92-4af5-9751-af6025c149d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:23:24 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-509ddc34-4077-4bfb-8307-c8604bb5ecc2 tempest-ServerActionsTestOtherA-177810280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f59f50f5-1591-4a56-9bc5-675e31d67889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:23:24 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-509ddc34-4077-4bfb-8307-c8604bb5ecc2 tempest-ServerActionsTestOtherA-177810280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f59f50f5-1591-4a56-9bc5-675e31d67889) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '941128c9-af6f-409e-acc7-30ee4961080f', 'volume_name': 'volume-941128c9-af6f-409e-acc7-30ee4961080f', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:23:24 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-509ddc34-4077-4bfb-8307-c8604bb5ecc2 tempest-ServerActionsTestOtherA-177810280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20d50f4d-e9fd-4f1d-9751-6ac1bd168a54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:23:24 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-509ddc34-4077-4bfb-8307-c8604bb5ecc2 tempest-ServerActionsTestOtherA-177810280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20d50f4d-e9fd-4f1d-9751-6ac1bd168a54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:23:24 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-509ddc34-4077-4bfb-8307-c8604bb5ecc2 tempest-ServerActionsTestOtherA-177810280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0dde6c9-d5dd-47ca-823e-aa59a8eaeecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:23:24 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-509ddc34-4077-4bfb-8307-c8604bb5ecc2 tempest-ServerActionsTestOtherA-177810280 None] Volume 941128c9-af6f-409e-acc7-30ee4961080f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-941128c9-af6f-409e-acc7-30ee4961080f', 'volume_size': 1} Aug 26 14:23:24 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-509ddc34-4077-4bfb-8307-c8604bb5ecc2 tempest-ServerActionsTestOtherA-177810280 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:23:24 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-509ddc34-4077-4bfb-8307-c8604bb5ecc2 tempest-ServerActionsTestOtherA-177810280 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:23:24 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-509ddc34-4077-4bfb-8307-c8604bb5ecc2 tempest-ServerActionsTestOtherA-177810280 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:23:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1683194204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=941128c9-af6f-409e-acc7-30ee4961080f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19ca4f3446574d1789d1fb3d467a7392',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:23:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:23:24Z,use_quota=True,user_id='808344d184d94b1c8fce92d044169973',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:23:24 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-509ddc34-4077-4bfb-8307-c8604bb5ecc2 tempest-ServerActionsTestOtherA-177810280 None] Creating volume 941128c9-af6f-409e-acc7-30ee4961080f {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:23:24 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-509ddc34-4077-4bfb-8307-c8604bb5ecc2 tempest-ServerActionsTestOtherA-177810280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:23:24 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-509ddc34-4077-4bfb-8307-c8604bb5ecc2 tempest-ServerActionsTestOtherA-177810280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:23:24 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-509ddc34-4077-4bfb-8307-c8604bb5ecc2 tempest-ServerActionsTestOtherA-177810280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:23:24 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-509ddc34-4077-4bfb-8307-c8604bb5ecc2 tempest-ServerActionsTestOtherA-177810280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:23:24 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-509ddc34-4077-4bfb-8307-c8604bb5ecc2 tempest-ServerActionsTestOtherA-177810280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:23:24 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-509ddc34-4077-4bfb-8307-c8604bb5ecc2 tempest-ServerActionsTestOtherA-177810280 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:23:24 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-509ddc34-4077-4bfb-8307-c8604bb5ecc2 tempest-ServerActionsTestOtherA-177810280 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:23:24 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-509ddc34-4077-4bfb-8307-c8604bb5ecc2 tempest-ServerActionsTestOtherA-177810280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-941128c9-af6f-409e-acc7-30ee4961080f 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:23:24 devstack sudo[95889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-941128c9-af6f-409e-acc7-30ee4961080f 1073741824 Aug 26 14:23:24 devstack sudo[95889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:23:24 devstack sudo[95889]: pam_unix(sudo:session): session closed for user root Aug 26 14:23:24 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-509ddc34-4077-4bfb-8307-c8604bb5ecc2 tempest-ServerActionsTestOtherA-177810280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-941128c9-af6f-409e-acc7-30ee4961080f 1073741824" returned: 0 in 0.538s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:23:24 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-509ddc34-4077-4bfb-8307-c8604bb5ecc2 tempest-ServerActionsTestOtherA-177810280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-941128c9-af6f-409e-acc7-30ee4961080f {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:23:24 devstack sudo[95898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-941128c9-af6f-409e-acc7-30ee4961080f Aug 26 14:23:24 devstack sudo[95898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:23:25 devstack sudo[95898]: pam_unix(sudo:session): session closed for user root Aug 26 14:23:25 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-509ddc34-4077-4bfb-8307-c8604bb5ecc2 tempest-ServerActionsTestOtherA-177810280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-941128c9-af6f-409e-acc7-30ee4961080f" returned: 0 in 0.302s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:23:25 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-509ddc34-4077-4bfb-8307-c8604bb5ecc2 tempest-ServerActionsTestOtherA-177810280 None] <== create_volume: return (895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:23:25 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-509ddc34-4077-4bfb-8307-c8604bb5ecc2 tempest-ServerActionsTestOtherA-177810280 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.898s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:23:25 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-509ddc34-4077-4bfb-8307-c8604bb5ecc2 tempest-ServerActionsTestOtherA-177810280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0dde6c9-d5dd-47ca-823e-aa59a8eaeecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-941128c9-af6f-409e-acc7-30ee4961080f', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:23:25 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-509ddc34-4077-4bfb-8307-c8604bb5ecc2 tempest-ServerActionsTestOtherA-177810280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (252454b5-c6d7-4693-9a15-8a0959df6ecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:23:25 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-509ddc34-4077-4bfb-8307-c8604bb5ecc2 tempest-ServerActionsTestOtherA-177810280 None] Volume volume-941128c9-af6f-409e-acc7-30ee4961080f (941128c9-af6f-409e-acc7-30ee4961080f): created successfully Aug 26 14:23:25 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-509ddc34-4077-4bfb-8307-c8604bb5ecc2 tempest-ServerActionsTestOtherA-177810280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (252454b5-c6d7-4693-9a15-8a0959df6ecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:23:25 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-509ddc34-4077-4bfb-8307-c8604bb5ecc2 tempest-ServerActionsTestOtherA-177810280 None] Flow 'volume_create_manager' (2eb8a901-2b3b-4982-b408-32f92d546336) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:23:25 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-509ddc34-4077-4bfb-8307-c8604bb5ecc2 tempest-ServerActionsTestOtherA-177810280 None] Created volume successfully. Aug 26 14:23:33 devstack cinder-volume[94394]: DEBUG oslo_service.periodic_task [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94394) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 14:23:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:23:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:23:33 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:23:33 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:23:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:23:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:23:33 devstack sudo[95921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:23:33 devstack sudo[95921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:23:33 devstack sudo[95921]: pam_unix(sudo:session): session closed for user root Aug 26 14:23:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.388s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:23:33 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:23:33 devstack cinder-volume[94394]: DEBUG oslo_service.periodic_task [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Running periodic task VolumeManager._thread_info {{(pid=94394) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 14:23:33 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] thread count: 8 {{(pid=94394) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 14:23:33 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] thread info: [<_MainThread(MainThread, started 126600738033792)>, , , , , , , ] {{(pid=94394) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 14:23:35 devstack cinder-volume[94394]: DEBUG dbcounter [-] [94394] Writing DB stats cinder:SELECT=9,cinder:UPDATE=11,cinder:INSERT=1 {{(pid=94394) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 14:23:35 devstack cinder-volume[94394]: DEBUG dbcounter [-] [94394] Writing DB stats cinder:SELECT=5,cinder:INSERT=4,cinder:UPDATE=11,cinder:DELETE=2 {{(pid=94394) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 14:23:39 devstack cinder-volume[94394]: WARNING py.warnings [req-e9da17b0-d0ef-4fa2-851e-5e7c2730a0d0 req-abbc08cd-d07f-4856-bef6-5e8bca21fc9b tempest-TaggedAttachmentsTest-331859631 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Aug 26 14:23:39 devstack cinder-volume[94394]: .first() Aug 26 14:23:39 devstack cinder-volume[94394]: Aug 26 14:23:40 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [req-e9da17b0-d0ef-4fa2-851e-5e7c2730a0d0 req-abbc08cd-d07f-4856-bef6-5e8bca21fc9b tempest-TaggedAttachmentsTest-331859631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:23:40 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [req-e9da17b0-d0ef-4fa2-851e-5e7c2730a0d0 req-abbc08cd-d07f-4856-bef6-5e8bca21fc9b tempest-TaggedAttachmentsTest-331859631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:23:40 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [req-e9da17b0-d0ef-4fa2-851e-5e7c2730a0d0 req-abbc08cd-d07f-4856-bef6-5e8bca21fc9b tempest-TaggedAttachmentsTest-331859631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:23:40 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [req-e9da17b0-d0ef-4fa2-851e-5e7c2730a0d0 req-abbc08cd-d07f-4856-bef6-5e8bca21fc9b tempest-TaggedAttachmentsTest-331859631 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b', 'name': 'volume-26d71c7a-3059-4d6a-ac06-2cf82d2b06f2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9f74164e-792d-45f3-96cd-aae761eb22ef', 'enforce_multipath': True} {{(pid=94394) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 14:23:40 devstack cinder-volume[94394]: INFO cinder.volume.manager [req-e9da17b0-d0ef-4fa2-851e-5e7c2730a0d0 req-abbc08cd-d07f-4856-bef6-5e8bca21fc9b tempest-TaggedAttachmentsTest-331859631 None] attachment_update completed successfully. Aug 26 14:23:46 devstack cinder-volume[94394]: INFO cinder.volume.manager [req-19ed8f29-e076-46d9-8727-c1eafb6c6081 req-492956c6-4581-40cf-ab89-175f6d874ca0 tempest-TaggedAttachmentsTest-331859631 None] Terminate volume connection completed successfully. Aug 26 14:23:46 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [req-19ed8f29-e076-46d9-8727-c1eafb6c6081 req-492956c6-4581-40cf-ab89-175f6d874ca0 tempest-TaggedAttachmentsTest-331859631 None] Deleting attachment 9f74164e-792d-45f3-96cd-aae761eb22ef. {{(pid=94394) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 14:23:56 devstack cinder-volume[94394]: DEBUG dbcounter [-] [94394] Writing DB stats cinder:UPDATE=1,cinder:SELECT=7 {{(pid=94394) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 14:23:56 devstack cinder-volume[94394]: DEBUG dbcounter [-] [94394] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=94394) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 14:24:09 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-3ea14245-ed3e-4994-aa60-a808ce7e9ff8 tempest-TaggedAttachmentsTest-331859631 None] Acquiring lock "cinder-26d71c7a-3059-4d6a-ac06-2cf82d2b06f2-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:24:09 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-3ea14245-ed3e-4994-aa60-a808ce7e9ff8 tempest-TaggedAttachmentsTest-331859631 None] Lock "cinder-26d71c7a-3059-4d6a-ac06-2cf82d2b06f2-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:24:09 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-3ea14245-ed3e-4994-aa60-a808ce7e9ff8 tempest-TaggedAttachmentsTest-331859631 None] Acquiring lock "cinder-quobyte-26d71c7a-3059-4d6a-ac06-2cf82d2b06f2" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:24:09 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-3ea14245-ed3e-4994-aa60-a808ce7e9ff8 tempest-TaggedAttachmentsTest-331859631 None] Lock "cinder-quobyte-26d71c7a-3059-4d6a-ac06-2cf82d2b06f2" acquired by "delete_volume" :: waited 0.023s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:24:09 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b9814e1-b33d-454a-932e-ddf44fee6f9b]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:24:09 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-3ea14245-ed3e-4994-aa60-a808ce7e9ff8 tempest-TaggedAttachmentsTest-331859631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-26d71c7a-3059-4d6a-ac06-2cf82d2b06f2 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:24:10 devstack sudo[96826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-26d71c7a-3059-4d6a-ac06-2cf82d2b06f2 Aug 26 14:24:10 devstack sudo[96826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:24:10 devstack sudo[96826]: pam_unix(sudo:session): session closed for user root Aug 26 14:24:10 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-3ea14245-ed3e-4994-aa60-a808ce7e9ff8 tempest-TaggedAttachmentsTest-331859631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-26d71c7a-3059-4d6a-ac06-2cf82d2b06f2" returned: 0 in 0.428s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:24:10 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-3ea14245-ed3e-4994-aa60-a808ce7e9ff8 tempest-TaggedAttachmentsTest-331859631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-26d71c7a-3059-4d6a-ac06-2cf82d2b06f2 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:24:10 devstack sudo[96833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-26d71c7a-3059-4d6a-ac06-2cf82d2b06f2 Aug 26 14:24:10 devstack sudo[96833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:24:10 devstack sudo[96833]: pam_unix(sudo:session): session closed for user root Aug 26 14:24:10 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-3ea14245-ed3e-4994-aa60-a808ce7e9ff8 tempest-TaggedAttachmentsTest-331859631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-26d71c7a-3059-4d6a-ac06-2cf82d2b06f2" returned: 0 in 0.255s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:24:10 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-3ea14245-ed3e-4994-aa60-a808ce7e9ff8 tempest-TaggedAttachmentsTest-331859631 None] Lock "cinder-quobyte-26d71c7a-3059-4d6a-ac06-2cf82d2b06f2" released by "delete_volume" :: held 0.731s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:24:10 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-3ea14245-ed3e-4994-aa60-a808ce7e9ff8 tempest-TaggedAttachmentsTest-331859631 None] Created reservations ['15a389fd-a583-43e2-8ee0-ae90fa97bdc5', '02dcf759-e4fd-48e9-b865-f659acf0b25b', '73b74a72-f776-477d-818c-79d1eedb8e51', 'a74461e3-961a-4ae5-93a5-46043ea8e81e'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:24:10 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-3ea14245-ed3e-4994-aa60-a808ce7e9ff8 tempest-TaggedAttachmentsTest-331859631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:24:10 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-3ea14245-ed3e-4994-aa60-a808ce7e9ff8 tempest-TaggedAttachmentsTest-331859631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:24:10 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-3ea14245-ed3e-4994-aa60-a808ce7e9ff8 tempest-TaggedAttachmentsTest-331859631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:24:10 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-3ea14245-ed3e-4994-aa60-a808ce7e9ff8 tempest-TaggedAttachmentsTest-331859631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:24:10 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-3ea14245-ed3e-4994-aa60-a808ce7e9ff8 tempest-TaggedAttachmentsTest-331859631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:24:10 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-3ea14245-ed3e-4994-aa60-a808ce7e9ff8 tempest-TaggedAttachmentsTest-331859631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:24:10 devstack sudo[96840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:24:10 devstack sudo[96840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:24:11 devstack sudo[96840]: pam_unix(sudo:session): session closed for user root Aug 26 14:24:11 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-3ea14245-ed3e-4994-aa60-a808ce7e9ff8 tempest-TaggedAttachmentsTest-331859631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.757s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:24:11 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-3ea14245-ed3e-4994-aa60-a808ce7e9ff8 tempest-TaggedAttachmentsTest-331859631 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:24:11 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-3ea14245-ed3e-4994-aa60-a808ce7e9ff8 tempest-TaggedAttachmentsTest-331859631 None] Deleted volume successfully. Aug 26 14:24:11 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-3ea14245-ed3e-4994-aa60-a808ce7e9ff8 tempest-TaggedAttachmentsTest-331859631 None] Lock "cinder-26d71c7a-3059-4d6a-ac06-2cf82d2b06f2-delete_volume" released by "delete_volume" :: held 1.857s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:24:13 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-b61cf3c0-9daa-4a96-90ef-74bb411ca07c tempest-VolumesAdminNegativeTest-1475890296 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:24:13 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-b61cf3c0-9daa-4a96-90ef-74bb411ca07c tempest-VolumesAdminNegativeTest-1475890296 None] Flow 'volume_create_manager' (67f28f36-0471-47ba-b100-de2fef3a07e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:24:13 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-b61cf3c0-9daa-4a96-90ef-74bb411ca07c tempest-VolumesAdminNegativeTest-1475890296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c842a13-5074-46cf-b309-8abbf0ab7933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:24:13 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-b61cf3c0-9daa-4a96-90ef-74bb411ca07c tempest-VolumesAdminNegativeTest-1475890296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c842a13-5074-46cf-b309-8abbf0ab7933) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:24:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1507898406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cb97033-b195-4628-a9eb-2ac6cce88e52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2ea6682434041d1bb1abd7d995aca92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:24:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:24:14Z,use_quota=True,user_id='6aef553826a34078a989b389118f08e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:24:13 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-b61cf3c0-9daa-4a96-90ef-74bb411ca07c tempest-VolumesAdminNegativeTest-1475890296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12a1080d-3839-4cad-9d6b-26d35a8d3869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:24:13 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-b61cf3c0-9daa-4a96-90ef-74bb411ca07c tempest-VolumesAdminNegativeTest-1475890296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12a1080d-3839-4cad-9d6b-26d35a8d3869) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:24:13 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-b61cf3c0-9daa-4a96-90ef-74bb411ca07c tempest-VolumesAdminNegativeTest-1475890296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bc18282-c227-4d83-b248-afce9b7b56f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:24:13 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-b61cf3c0-9daa-4a96-90ef-74bb411ca07c tempest-VolumesAdminNegativeTest-1475890296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bc18282-c227-4d83-b248-afce9b7b56f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9cb97033-b195-4628-a9eb-2ac6cce88e52', 'volume_name': 'volume-9cb97033-b195-4628-a9eb-2ac6cce88e52', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:24:13 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-b61cf3c0-9daa-4a96-90ef-74bb411ca07c tempest-VolumesAdminNegativeTest-1475890296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (119707a8-df87-433f-af08-cad7097e3bbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:24:13 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-b61cf3c0-9daa-4a96-90ef-74bb411ca07c tempest-VolumesAdminNegativeTest-1475890296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (119707a8-df87-433f-af08-cad7097e3bbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:24:13 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-b61cf3c0-9daa-4a96-90ef-74bb411ca07c tempest-VolumesAdminNegativeTest-1475890296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c8b4fff-f236-479f-aa53-f5aeee3e4962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:24:13 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-b61cf3c0-9daa-4a96-90ef-74bb411ca07c tempest-VolumesAdminNegativeTest-1475890296 None] Volume 9cb97033-b195-4628-a9eb-2ac6cce88e52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9cb97033-b195-4628-a9eb-2ac6cce88e52', 'volume_size': 1} Aug 26 14:24:13 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-b61cf3c0-9daa-4a96-90ef-74bb411ca07c tempest-VolumesAdminNegativeTest-1475890296 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:24:13 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-b61cf3c0-9daa-4a96-90ef-74bb411ca07c tempest-VolumesAdminNegativeTest-1475890296 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:24:13 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-b61cf3c0-9daa-4a96-90ef-74bb411ca07c tempest-VolumesAdminNegativeTest-1475890296 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:24:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1507898406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cb97033-b195-4628-a9eb-2ac6cce88e52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2ea6682434041d1bb1abd7d995aca92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:24:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:24:14Z,use_quota=True,user_id='6aef553826a34078a989b389118f08e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:24:13 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-b61cf3c0-9daa-4a96-90ef-74bb411ca07c tempest-VolumesAdminNegativeTest-1475890296 None] Creating volume 9cb97033-b195-4628-a9eb-2ac6cce88e52 {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:24:13 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-b61cf3c0-9daa-4a96-90ef-74bb411ca07c tempest-VolumesAdminNegativeTest-1475890296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:24:13 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-b61cf3c0-9daa-4a96-90ef-74bb411ca07c tempest-VolumesAdminNegativeTest-1475890296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:24:13 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-b61cf3c0-9daa-4a96-90ef-74bb411ca07c tempest-VolumesAdminNegativeTest-1475890296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:24:13 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-b61cf3c0-9daa-4a96-90ef-74bb411ca07c tempest-VolumesAdminNegativeTest-1475890296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:24:13 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-b61cf3c0-9daa-4a96-90ef-74bb411ca07c tempest-VolumesAdminNegativeTest-1475890296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:24:13 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-b61cf3c0-9daa-4a96-90ef-74bb411ca07c tempest-VolumesAdminNegativeTest-1475890296 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:24:13 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-b61cf3c0-9daa-4a96-90ef-74bb411ca07c tempest-VolumesAdminNegativeTest-1475890296 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:24:13 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-b61cf3c0-9daa-4a96-90ef-74bb411ca07c tempest-VolumesAdminNegativeTest-1475890296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9cb97033-b195-4628-a9eb-2ac6cce88e52 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:24:13 devstack sudo[96859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9cb97033-b195-4628-a9eb-2ac6cce88e52 1073741824 Aug 26 14:24:13 devstack sudo[96859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:24:14 devstack sudo[96859]: pam_unix(sudo:session): session closed for user root Aug 26 14:24:14 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-b61cf3c0-9daa-4a96-90ef-74bb411ca07c tempest-VolumesAdminNegativeTest-1475890296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9cb97033-b195-4628-a9eb-2ac6cce88e52 1073741824" returned: 0 in 0.767s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:24:14 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-b61cf3c0-9daa-4a96-90ef-74bb411ca07c tempest-VolumesAdminNegativeTest-1475890296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9cb97033-b195-4628-a9eb-2ac6cce88e52 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:24:14 devstack sudo[96865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9cb97033-b195-4628-a9eb-2ac6cce88e52 Aug 26 14:24:14 devstack sudo[96865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:24:15 devstack sudo[96865]: pam_unix(sudo:session): session closed for user root Aug 26 14:24:15 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-b61cf3c0-9daa-4a96-90ef-74bb411ca07c tempest-VolumesAdminNegativeTest-1475890296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9cb97033-b195-4628-a9eb-2ac6cce88e52" returned: 0 in 0.450s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:24:15 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-b61cf3c0-9daa-4a96-90ef-74bb411ca07c tempest-VolumesAdminNegativeTest-1475890296 None] <== create_volume: return (1302ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:24:15 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-b61cf3c0-9daa-4a96-90ef-74bb411ca07c tempest-VolumesAdminNegativeTest-1475890296 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.306s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:24:15 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-b61cf3c0-9daa-4a96-90ef-74bb411ca07c tempest-VolumesAdminNegativeTest-1475890296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c8b4fff-f236-479f-aa53-f5aeee3e4962) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9cb97033-b195-4628-a9eb-2ac6cce88e52', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:24:15 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-b61cf3c0-9daa-4a96-90ef-74bb411ca07c tempest-VolumesAdminNegativeTest-1475890296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9678243-c2ba-4cff-a002-d0b437d4d87e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:24:15 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-b61cf3c0-9daa-4a96-90ef-74bb411ca07c tempest-VolumesAdminNegativeTest-1475890296 None] Volume volume-9cb97033-b195-4628-a9eb-2ac6cce88e52 (9cb97033-b195-4628-a9eb-2ac6cce88e52): created successfully Aug 26 14:24:15 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-b61cf3c0-9daa-4a96-90ef-74bb411ca07c tempest-VolumesAdminNegativeTest-1475890296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9678243-c2ba-4cff-a002-d0b437d4d87e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:24:15 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-b61cf3c0-9daa-4a96-90ef-74bb411ca07c tempest-VolumesAdminNegativeTest-1475890296 None] Flow 'volume_create_manager' (67f28f36-0471-47ba-b100-de2fef3a07e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:24:15 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-b61cf3c0-9daa-4a96-90ef-74bb411ca07c tempest-VolumesAdminNegativeTest-1475890296 None] Created volume successfully. Aug 26 14:24:16 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-6fe86fee-d58f-42b5-9598-4cbd82145b2f tempest-VolumesAdminNegativeTest-1475890296 None] Acquiring lock "cinder-9cb97033-b195-4628-a9eb-2ac6cce88e52-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:24:16 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-6fe86fee-d58f-42b5-9598-4cbd82145b2f tempest-VolumesAdminNegativeTest-1475890296 None] Lock "cinder-9cb97033-b195-4628-a9eb-2ac6cce88e52-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:24:16 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-6fe86fee-d58f-42b5-9598-4cbd82145b2f tempest-VolumesAdminNegativeTest-1475890296 None] Acquiring lock "cinder-quobyte-9cb97033-b195-4628-a9eb-2ac6cce88e52" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:24:16 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-6fe86fee-d58f-42b5-9598-4cbd82145b2f tempest-VolumesAdminNegativeTest-1475890296 None] Lock "cinder-quobyte-9cb97033-b195-4628-a9eb-2ac6cce88e52" acquired by "delete_volume" :: waited 0.030s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:24:16 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[63b703cb-ee9f-45d1-a3ba-fb3507b78fbd]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:24:16 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-6fe86fee-d58f-42b5-9598-4cbd82145b2f tempest-VolumesAdminNegativeTest-1475890296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9cb97033-b195-4628-a9eb-2ac6cce88e52 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:24:16 devstack sudo[96871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9cb97033-b195-4628-a9eb-2ac6cce88e52 Aug 26 14:24:16 devstack sudo[96871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:24:17 devstack sudo[96871]: pam_unix(sudo:session): session closed for user root Aug 26 14:24:17 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-6fe86fee-d58f-42b5-9598-4cbd82145b2f tempest-VolumesAdminNegativeTest-1475890296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9cb97033-b195-4628-a9eb-2ac6cce88e52" returned: 0 in 1.054s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:24:17 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-6fe86fee-d58f-42b5-9598-4cbd82145b2f tempest-VolumesAdminNegativeTest-1475890296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9cb97033-b195-4628-a9eb-2ac6cce88e52 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:24:17 devstack sudo[96877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9cb97033-b195-4628-a9eb-2ac6cce88e52 Aug 26 14:24:17 devstack sudo[96877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:24:17 devstack sudo[96877]: pam_unix(sudo:session): session closed for user root Aug 26 14:24:17 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-6fe86fee-d58f-42b5-9598-4cbd82145b2f tempest-VolumesAdminNegativeTest-1475890296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9cb97033-b195-4628-a9eb-2ac6cce88e52" returned: 0 in 0.392s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:24:17 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-6fe86fee-d58f-42b5-9598-4cbd82145b2f tempest-VolumesAdminNegativeTest-1475890296 None] Lock "cinder-quobyte-9cb97033-b195-4628-a9eb-2ac6cce88e52" released by "delete_volume" :: held 1.541s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:24:17 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-6fe86fee-d58f-42b5-9598-4cbd82145b2f tempest-VolumesAdminNegativeTest-1475890296 None] Created reservations ['36583862-d745-4e2b-a971-a6395fcf5847', '6e492384-1881-456a-9da5-ef289587dc42', 'e59c5540-b6f7-4649-ae24-9a0f825aeef7', 'eae30660-70c6-43e2-8635-381fdbb0ed84'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:24:17 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-6fe86fee-d58f-42b5-9598-4cbd82145b2f tempest-VolumesAdminNegativeTest-1475890296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:24:17 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-6fe86fee-d58f-42b5-9598-4cbd82145b2f tempest-VolumesAdminNegativeTest-1475890296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:24:17 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-6fe86fee-d58f-42b5-9598-4cbd82145b2f tempest-VolumesAdminNegativeTest-1475890296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:24:17 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-6fe86fee-d58f-42b5-9598-4cbd82145b2f tempest-VolumesAdminNegativeTest-1475890296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:24:17 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-6fe86fee-d58f-42b5-9598-4cbd82145b2f tempest-VolumesAdminNegativeTest-1475890296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:24:17 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-6fe86fee-d58f-42b5-9598-4cbd82145b2f tempest-VolumesAdminNegativeTest-1475890296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:24:18 devstack sudo[96880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:24:18 devstack sudo[96880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:24:18 devstack sudo[96880]: pam_unix(sudo:session): session closed for user root Aug 26 14:24:18 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-6fe86fee-d58f-42b5-9598-4cbd82145b2f tempest-VolumesAdminNegativeTest-1475890296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.365s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:24:18 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-6fe86fee-d58f-42b5-9598-4cbd82145b2f tempest-VolumesAdminNegativeTest-1475890296 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:24:18 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-6fe86fee-d58f-42b5-9598-4cbd82145b2f tempest-VolumesAdminNegativeTest-1475890296 None] Deleted volume successfully. Aug 26 14:24:18 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-6fe86fee-d58f-42b5-9598-4cbd82145b2f tempest-VolumesAdminNegativeTest-1475890296 None] Lock "cinder-9cb97033-b195-4628-a9eb-2ac6cce88e52-delete_volume" released by "delete_volume" :: held 2.359s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:24:23 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [req-d51fd68e-e4e4-40f5-a345-1abba9b7d7a5 req-4d762b80-7a22-44c0-b22c-17833404cd81 tempest-ServerActionsTestOtherA-177810280 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:24:23 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [req-d51fd68e-e4e4-40f5-a345-1abba9b7d7a5 req-4d762b80-7a22-44c0-b22c-17833404cd81 tempest-ServerActionsTestOtherA-177810280 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:24:23 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [req-d51fd68e-e4e4-40f5-a345-1abba9b7d7a5 req-4d762b80-7a22-44c0-b22c-17833404cd81 tempest-ServerActionsTestOtherA-177810280 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:24:23 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [req-d51fd68e-e4e4-40f5-a345-1abba9b7d7a5 req-4d762b80-7a22-44c0-b22c-17833404cd81 tempest-ServerActionsTestOtherA-177810280 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b', 'name': 'volume-941128c9-af6f-409e-acc7-30ee4961080f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '91a6b7f8-364b-47ab-bd01-5fcf4397edb7', 'enforce_multipath': True} {{(pid=94394) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 14:24:23 devstack cinder-volume[94394]: INFO cinder.volume.manager [req-d51fd68e-e4e4-40f5-a345-1abba9b7d7a5 req-4d762b80-7a22-44c0-b22c-17833404cd81 tempest-ServerActionsTestOtherA-177810280 None] attachment_update completed successfully. Aug 26 14:24:27 devstack cinder-volume[94394]: INFO cinder.volume.manager [req-2e924a1a-5611-4cc4-ae8d-471d4aa0c78e req-ebf0289f-8c24-4477-a470-f5ea4890f89f tempest-ServerActionsTestOtherA-177810280 None] Terminate volume connection completed successfully. Aug 26 14:24:27 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [req-2e924a1a-5611-4cc4-ae8d-471d4aa0c78e req-ebf0289f-8c24-4477-a470-f5ea4890f89f tempest-ServerActionsTestOtherA-177810280 None] Deleting attachment 91a6b7f8-364b-47ab-bd01-5fcf4397edb7. {{(pid=94394) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 14:24:28 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [req-2e924a1a-5611-4cc4-ae8d-471d4aa0c78e req-577fce48-1f1f-4286-8293-7592e441d57b tempest-ServerActionsTestOtherA-177810280 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:24:28 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [req-2e924a1a-5611-4cc4-ae8d-471d4aa0c78e req-577fce48-1f1f-4286-8293-7592e441d57b tempest-ServerActionsTestOtherA-177810280 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:24:28 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [req-2e924a1a-5611-4cc4-ae8d-471d4aa0c78e req-577fce48-1f1f-4286-8293-7592e441d57b tempest-ServerActionsTestOtherA-177810280 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:24:28 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [req-2e924a1a-5611-4cc4-ae8d-471d4aa0c78e req-577fce48-1f1f-4286-8293-7592e441d57b tempest-ServerActionsTestOtherA-177810280 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b', 'name': 'volume-941128c9-af6f-409e-acc7-30ee4961080f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6f5148df-4889-440f-bec9-afd392d5622c', 'enforce_multipath': True} {{(pid=94394) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 14:24:29 devstack cinder-volume[94394]: INFO cinder.volume.manager [req-2e924a1a-5611-4cc4-ae8d-471d4aa0c78e req-577fce48-1f1f-4286-8293-7592e441d57b tempest-ServerActionsTestOtherA-177810280 None] attachment_update completed successfully. Aug 26 14:24:33 devstack cinder-volume[94394]: DEBUG oslo_service.periodic_task [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94394) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 14:24:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:24:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:24:33 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:24:33 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:24:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:24:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:24:33 devstack sudo[97925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:24:33 devstack sudo[97925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:24:34 devstack sudo[97925]: pam_unix(sudo:session): session closed for user root Aug 26 14:24:34 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.782s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:24:34 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:24:38 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1fccd29-3af7-442e-966c-b03b312d8db6 tempest-AttachVolumeShelveTestJSON-216028008 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:24:38 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-e1fccd29-3af7-442e-966c-b03b312d8db6 tempest-AttachVolumeShelveTestJSON-216028008 None] Flow 'volume_create_manager' (bf404abe-e927-4f9a-af4d-9a0e4943d185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:24:38 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-e1fccd29-3af7-442e-966c-b03b312d8db6 tempest-AttachVolumeShelveTestJSON-216028008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (573a25cf-e0b1-453f-b451-349c7ff6fcd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:24:38 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-e1fccd29-3af7-442e-966c-b03b312d8db6 tempest-AttachVolumeShelveTestJSON-216028008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (573a25cf-e0b1-453f-b451-349c7ff6fcd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:24:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1032850715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55703f1c-abd4-4e8e-a872-5b1d3f6db8cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6208e573a9784ec9a5c5ae67a1c44f77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:24:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:24:39Z,use_quota=True,user_id='d9d21f4baa174ef094aa3b3c04262094',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:24:38 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-e1fccd29-3af7-442e-966c-b03b312d8db6 tempest-AttachVolumeShelveTestJSON-216028008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f1a63d5-80e4-4c5f-8ed1-4101f51fa2a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:24:38 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-e1fccd29-3af7-442e-966c-b03b312d8db6 tempest-AttachVolumeShelveTestJSON-216028008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f1a63d5-80e4-4c5f-8ed1-4101f51fa2a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:24:38 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-e1fccd29-3af7-442e-966c-b03b312d8db6 tempest-AttachVolumeShelveTestJSON-216028008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e46c59b3-800b-41b4-8d58-e5768b36b2dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:24:38 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-e1fccd29-3af7-442e-966c-b03b312d8db6 tempest-AttachVolumeShelveTestJSON-216028008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e46c59b3-800b-41b4-8d58-e5768b36b2dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55703f1c-abd4-4e8e-a872-5b1d3f6db8cb', 'volume_name': 'volume-55703f1c-abd4-4e8e-a872-5b1d3f6db8cb', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:24:38 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-e1fccd29-3af7-442e-966c-b03b312d8db6 tempest-AttachVolumeShelveTestJSON-216028008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abb296b4-8546-47f4-8715-fa69cfff7a08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:24:38 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-e1fccd29-3af7-442e-966c-b03b312d8db6 tempest-AttachVolumeShelveTestJSON-216028008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abb296b4-8546-47f4-8715-fa69cfff7a08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:24:38 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-e1fccd29-3af7-442e-966c-b03b312d8db6 tempest-AttachVolumeShelveTestJSON-216028008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99770c8e-0e84-4571-9b6c-80d8589c63c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:24:38 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-e1fccd29-3af7-442e-966c-b03b312d8db6 tempest-AttachVolumeShelveTestJSON-216028008 None] Volume 55703f1c-abd4-4e8e-a872-5b1d3f6db8cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55703f1c-abd4-4e8e-a872-5b1d3f6db8cb', 'volume_size': 1} Aug 26 14:24:38 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e1fccd29-3af7-442e-966c-b03b312d8db6 tempest-AttachVolumeShelveTestJSON-216028008 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:24:38 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e1fccd29-3af7-442e-966c-b03b312d8db6 tempest-AttachVolumeShelveTestJSON-216028008 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:24:38 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-e1fccd29-3af7-442e-966c-b03b312d8db6 tempest-AttachVolumeShelveTestJSON-216028008 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:24:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1032850715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55703f1c-abd4-4e8e-a872-5b1d3f6db8cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6208e573a9784ec9a5c5ae67a1c44f77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:24:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:24:39Z,use_quota=True,user_id='d9d21f4baa174ef094aa3b3c04262094',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:24:38 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-e1fccd29-3af7-442e-966c-b03b312d8db6 tempest-AttachVolumeShelveTestJSON-216028008 None] Creating volume 55703f1c-abd4-4e8e-a872-5b1d3f6db8cb {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:24:38 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e1fccd29-3af7-442e-966c-b03b312d8db6 tempest-AttachVolumeShelveTestJSON-216028008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:24:38 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e1fccd29-3af7-442e-966c-b03b312d8db6 tempest-AttachVolumeShelveTestJSON-216028008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:24:38 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-e1fccd29-3af7-442e-966c-b03b312d8db6 tempest-AttachVolumeShelveTestJSON-216028008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:24:38 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-e1fccd29-3af7-442e-966c-b03b312d8db6 tempest-AttachVolumeShelveTestJSON-216028008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:24:38 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e1fccd29-3af7-442e-966c-b03b312d8db6 tempest-AttachVolumeShelveTestJSON-216028008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:24:38 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-e1fccd29-3af7-442e-966c-b03b312d8db6 tempest-AttachVolumeShelveTestJSON-216028008 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:24:38 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-e1fccd29-3af7-442e-966c-b03b312d8db6 tempest-AttachVolumeShelveTestJSON-216028008 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:24:38 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e1fccd29-3af7-442e-966c-b03b312d8db6 tempest-AttachVolumeShelveTestJSON-216028008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-55703f1c-abd4-4e8e-a872-5b1d3f6db8cb 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:24:38 devstack sudo[97932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-55703f1c-abd4-4e8e-a872-5b1d3f6db8cb 1073741824 Aug 26 14:24:38 devstack sudo[97932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:24:39 devstack sudo[97932]: pam_unix(sudo:session): session closed for user root Aug 26 14:24:39 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e1fccd29-3af7-442e-966c-b03b312d8db6 tempest-AttachVolumeShelveTestJSON-216028008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-55703f1c-abd4-4e8e-a872-5b1d3f6db8cb 1073741824" returned: 0 in 0.684s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:24:39 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e1fccd29-3af7-442e-966c-b03b312d8db6 tempest-AttachVolumeShelveTestJSON-216028008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-55703f1c-abd4-4e8e-a872-5b1d3f6db8cb {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:24:39 devstack sudo[97940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-55703f1c-abd4-4e8e-a872-5b1d3f6db8cb Aug 26 14:24:39 devstack sudo[97940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:24:39 devstack sudo[97940]: pam_unix(sudo:session): session closed for user root Aug 26 14:24:39 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e1fccd29-3af7-442e-966c-b03b312d8db6 tempest-AttachVolumeShelveTestJSON-216028008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-55703f1c-abd4-4e8e-a872-5b1d3f6db8cb" returned: 0 in 0.356s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:24:39 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-e1fccd29-3af7-442e-966c-b03b312d8db6 tempest-AttachVolumeShelveTestJSON-216028008 None] <== create_volume: return (1101ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:24:39 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e1fccd29-3af7-442e-966c-b03b312d8db6 tempest-AttachVolumeShelveTestJSON-216028008 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.104s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:24:39 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-e1fccd29-3af7-442e-966c-b03b312d8db6 tempest-AttachVolumeShelveTestJSON-216028008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99770c8e-0e84-4571-9b6c-80d8589c63c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55703f1c-abd4-4e8e-a872-5b1d3f6db8cb', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:24:39 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-e1fccd29-3af7-442e-966c-b03b312d8db6 tempest-AttachVolumeShelveTestJSON-216028008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89572d55-e151-454f-9b25-596c318baece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:24:39 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-e1fccd29-3af7-442e-966c-b03b312d8db6 tempest-AttachVolumeShelveTestJSON-216028008 None] Volume volume-55703f1c-abd4-4e8e-a872-5b1d3f6db8cb (55703f1c-abd4-4e8e-a872-5b1d3f6db8cb): created successfully Aug 26 14:24:39 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-e1fccd29-3af7-442e-966c-b03b312d8db6 tempest-AttachVolumeShelveTestJSON-216028008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89572d55-e151-454f-9b25-596c318baece) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:24:39 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-e1fccd29-3af7-442e-966c-b03b312d8db6 tempest-AttachVolumeShelveTestJSON-216028008 None] Flow 'volume_create_manager' (bf404abe-e927-4f9a-af4d-9a0e4943d185) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:24:39 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-e1fccd29-3af7-442e-966c-b03b312d8db6 tempest-AttachVolumeShelveTestJSON-216028008 None] Created volume successfully. Aug 26 14:24:49 devstack cinder-volume[94394]: DEBUG dbcounter [-] [94394] Writing DB stats cinder:SELECT=29,cinder:UPDATE=19,cinder:DELETE=2,cinder:INSERT=4 {{(pid=94394) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 14:24:49 devstack cinder-volume[94394]: DEBUG dbcounter [-] [94394] Writing DB stats cinder:UPDATE=31,cinder:SELECT=27,cinder:INSERT=6,cinder:DELETE=2 {{(pid=94394) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 14:24:57 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [req-34b60bce-ec28-4b67-b211-438dcde227f7 req-b7c1e988-58d9-4fae-81c7-e1fb75d6ea4d tempest-AttachVolumeShelveTestJSON-216028008 None] No connector for attachment 794a4ae5-21de-4c90-be61-746039ce76d1; skipping storage backend terminate_connection call. {{(pid=94394) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Aug 26 14:24:57 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [req-34b60bce-ec28-4b67-b211-438dcde227f7 req-b7c1e988-58d9-4fae-81c7-e1fb75d6ea4d tempest-AttachVolumeShelveTestJSON-216028008 None] Deleting attachment 794a4ae5-21de-4c90-be61-746039ce76d1. {{(pid=94394) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 14:25:02 devstack cinder-volume[94394]: INFO cinder.volume.manager [req-44379e91-f65f-4bea-b3e6-12de124f95ec req-004e7443-14a6-4e5c-92f5-75557b01d911 tempest-ServerActionsTestOtherA-177810280 None] Terminate volume connection completed successfully. Aug 26 14:25:02 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [req-44379e91-f65f-4bea-b3e6-12de124f95ec req-004e7443-14a6-4e5c-92f5-75557b01d911 tempest-ServerActionsTestOtherA-177810280 None] Deleting attachment 6f5148df-4889-440f-bec9-afd392d5622c. {{(pid=94394) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 14:25:07 devstack cinder-volume[94394]: DEBUG dbcounter [-] [94394] Writing DB stats cinder:SELECT=1 {{(pid=94394) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 14:25:12 devstack cinder-volume[94394]: DEBUG dbcounter [-] [94394] Writing DB stats cinder:SELECT=3 {{(pid=94394) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 14:25:16 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-17bc6edc-6605-4adc-bd94-1feb2e2d1cb7 tempest-ServerActionsTestOtherA-177810280 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:25:16 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-17bc6edc-6605-4adc-bd94-1feb2e2d1cb7 tempest-ServerActionsTestOtherA-177810280 None] Flow 'volume_create_manager' (3ea8d42a-77ca-4996-94e9-8967d6c372c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:25:16 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-17bc6edc-6605-4adc-bd94-1feb2e2d1cb7 tempest-ServerActionsTestOtherA-177810280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a274dff-c7a7-4b4a-a228-0cf6d44ea002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:25:16 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-17bc6edc-6605-4adc-bd94-1feb2e2d1cb7 tempest-ServerActionsTestOtherA-177810280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a274dff-c7a7-4b4a-a228-0cf6d44ea002) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:25:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1642581033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37f600b8-4b85-4859-8eb4-cd7968e97218,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19ca4f3446574d1789d1fb3d467a7392',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:25:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:25:16Z,use_quota=True,user_id='808344d184d94b1c8fce92d044169973',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:25:16 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-17bc6edc-6605-4adc-bd94-1feb2e2d1cb7 tempest-ServerActionsTestOtherA-177810280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aced3791-0c74-4d96-9626-3887525d3819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:25:16 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-17bc6edc-6605-4adc-bd94-1feb2e2d1cb7 tempest-ServerActionsTestOtherA-177810280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aced3791-0c74-4d96-9626-3887525d3819) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:25:16 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-17bc6edc-6605-4adc-bd94-1feb2e2d1cb7 tempest-ServerActionsTestOtherA-177810280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b8426d1-9251-4c6e-8fad-fd79ff79420a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:25:16 devstack cinder-volume[94394]: DEBUG cinder.image.glance [None req-17bc6edc-6605-4adc-bd94-1feb2e2d1cb7 tempest-ServerActionsTestOtherA-177810280 None] Creating Keystone auth plugin from conf {{(pid=94394) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 26 14:25:18 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-17bc6edc-6605-4adc-bd94-1feb2e2d1cb7 tempest-ServerActionsTestOtherA-177810280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b8426d1-9251-4c6e-8fad-fd79ff79420a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '37f600b8-4b85-4859-8eb4-cd7968e97218', 'volume_name': 'volume-37f600b8-4b85-4859-8eb4-cd7968e97218', 'volume_size': 1, 'image_id': '2681f5d8-1c86-4dfd-86fb-c29aaed49dc6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2681f5d8-1c86-4dfd-86fb-c29aaed49dc6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cbf977c46caa48c18e414079bf75016d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2681f5d8-1c86-4dfd-86fb-c29aaed49dc6', 'created_at': datetime.datetime(2026, 8, 26, 12, 16, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 12, 16, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2681f5d8-1c86-4dfd-86fb-c29aaed49dc6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:25:18 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-17bc6edc-6605-4adc-bd94-1feb2e2d1cb7 tempest-ServerActionsTestOtherA-177810280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4ac3f36-6a4c-4171-b7ec-8dca80128c80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:25:18 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-17bc6edc-6605-4adc-bd94-1feb2e2d1cb7 tempest-ServerActionsTestOtherA-177810280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4ac3f36-6a4c-4171-b7ec-8dca80128c80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:25:18 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-17bc6edc-6605-4adc-bd94-1feb2e2d1cb7 tempest-ServerActionsTestOtherA-177810280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df770056-6079-4178-b880-f01af3a3c15a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:25:18 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-17bc6edc-6605-4adc-bd94-1feb2e2d1cb7 tempest-ServerActionsTestOtherA-177810280 None] Volume 37f600b8-4b85-4859-8eb4-cd7968e97218: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-37f600b8-4b85-4859-8eb4-cd7968e97218', 'volume_size': 1, 'image_id': '2681f5d8-1c86-4dfd-86fb-c29aaed49dc6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2681f5d8-1c86-4dfd-86fb-c29aaed49dc6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cbf977c46caa48c18e414079bf75016d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2681f5d8-1c86-4dfd-86fb-c29aaed49dc6', 'created_at': datetime.datetime(2026, 8, 26, 12, 16, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 12, 16, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2681f5d8-1c86-4dfd-86fb-c29aaed49dc6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 26 14:25:18 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-17bc6edc-6605-4adc-bd94-1feb2e2d1cb7 tempest-ServerActionsTestOtherA-177810280 None] Trying to clone 37f600b8-4b85-4859-8eb4-cd7968e97218 from image 2681f5d8-1c86-4dfd-86fb-c29aaed49dc6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/2681f5d8-1c86-4dfd-86fb-c29aaed49dc6', 'metadata': {}}]). {{(pid=94394) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 26 14:25:19 devstack cinder-volume[94394]: DEBUG cinder.image.image_utils [None req-17bc6edc-6605-4adc-bd94-1feb2e2d1cb7 tempest-ServerActionsTestOtherA-177810280 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2681f5d8-1c86-4dfd-86fb-c29aaed49dc6_2oi_5ekzdevstack@QuobyteHD, size 20.69 MB, duration 1.41 sec {{(pid=94394) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 26 14:25:19 devstack cinder-volume[94394]: INFO cinder.image.image_utils [None req-17bc6edc-6605-4adc-bd94-1feb2e2d1cb7 tempest-ServerActionsTestOtherA-177810280 None] Image download 20.69 MB at 14.63 MB/s Aug 26 14:25:19 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bcda652-d164-49ef-9cee-6895a4f85c06]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:25:19 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-17bc6edc-6605-4adc-bd94-1feb2e2d1cb7 tempest-ServerActionsTestOtherA-177810280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2681f5d8-1c86-4dfd-86fb-c29aaed49dc6_2oi_5ekzdevstack@QuobyteHD {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:25:19 devstack sudo[98936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2681f5d8-1c86-4dfd-86fb-c29aaed49dc6_2oi_5ekzdevstack@QuobyteHD Aug 26 14:25:19 devstack sudo[98936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:25:20 devstack sudo[98936]: pam_unix(sudo:session): session closed for user root Aug 26 14:25:20 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-17bc6edc-6605-4adc-bd94-1feb2e2d1cb7 tempest-ServerActionsTestOtherA-177810280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2681f5d8-1c86-4dfd-86fb-c29aaed49dc6_2oi_5ekzdevstack@QuobyteHD" returned: 0 in 0.730s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:25:20 devstack cinder-volume[94394]: DEBUG cinder.image.image_utils [None req-17bc6edc-6605-4adc-bd94-1feb2e2d1cb7 tempest-ServerActionsTestOtherA-177810280 None] Temporary image 2681f5d8-1c86-4dfd-86fb-c29aaed49dc6 is fetched for user 808344d184d94b1c8fce92d044169973. {{(pid=94394) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 26 14:25:20 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[8943fa98-e993-49ec-84ae-0347a3686868]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:25:20 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-17bc6edc-6605-4adc-bd94-1feb2e2d1cb7 tempest-ServerActionsTestOtherA-177810280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2681f5d8-1c86-4dfd-86fb-c29aaed49dc6_2oi_5ekzdevstack@QuobyteHD {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:25:20 devstack sudo[98966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2681f5d8-1c86-4dfd-86fb-c29aaed49dc6_2oi_5ekzdevstack@QuobyteHD Aug 26 14:25:20 devstack sudo[98966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:25:21 devstack sudo[98966]: pam_unix(sudo:session): session closed for user root Aug 26 14:25:21 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-17bc6edc-6605-4adc-bd94-1feb2e2d1cb7 tempest-ServerActionsTestOtherA-177810280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2681f5d8-1c86-4dfd-86fb-c29aaed49dc6_2oi_5ekzdevstack@QuobyteHD" returned: 0 in 0.543s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:25:21 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-17bc6edc-6605-4adc-bd94-1feb2e2d1cb7 tempest-ServerActionsTestOtherA-177810280 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:25:21 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-17bc6edc-6605-4adc-bd94-1feb2e2d1cb7 tempest-ServerActionsTestOtherA-177810280 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.016s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:25:21 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-17bc6edc-6605-4adc-bd94-1feb2e2d1cb7 tempest-ServerActionsTestOtherA-177810280 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:25:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1642581033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37f600b8-4b85-4859-8eb4-cd7968e97218,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19ca4f3446574d1789d1fb3d467a7392',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:25:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:25:16Z,use_quota=True,user_id='808344d184d94b1c8fce92d044169973',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:25:21 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-17bc6edc-6605-4adc-bd94-1feb2e2d1cb7 tempest-ServerActionsTestOtherA-177810280 None] Creating volume 37f600b8-4b85-4859-8eb4-cd7968e97218 {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:25:21 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-17bc6edc-6605-4adc-bd94-1feb2e2d1cb7 tempest-ServerActionsTestOtherA-177810280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:25:21 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-17bc6edc-6605-4adc-bd94-1feb2e2d1cb7 tempest-ServerActionsTestOtherA-177810280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:25:21 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-17bc6edc-6605-4adc-bd94-1feb2e2d1cb7 tempest-ServerActionsTestOtherA-177810280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:25:21 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-17bc6edc-6605-4adc-bd94-1feb2e2d1cb7 tempest-ServerActionsTestOtherA-177810280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:25:21 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-17bc6edc-6605-4adc-bd94-1feb2e2d1cb7 tempest-ServerActionsTestOtherA-177810280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.053s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:25:21 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-17bc6edc-6605-4adc-bd94-1feb2e2d1cb7 tempest-ServerActionsTestOtherA-177810280 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:25:21 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-17bc6edc-6605-4adc-bd94-1feb2e2d1cb7 tempest-ServerActionsTestOtherA-177810280 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:25:21 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-17bc6edc-6605-4adc-bd94-1feb2e2d1cb7 tempest-ServerActionsTestOtherA-177810280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-37f600b8-4b85-4859-8eb4-cd7968e97218 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:25:21 devstack sudo[99015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-37f600b8-4b85-4859-8eb4-cd7968e97218 1073741824 Aug 26 14:25:21 devstack sudo[99015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:25:22 devstack sudo[99015]: pam_unix(sudo:session): session closed for user root Aug 26 14:25:22 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-17bc6edc-6605-4adc-bd94-1feb2e2d1cb7 tempest-ServerActionsTestOtherA-177810280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-37f600b8-4b85-4859-8eb4-cd7968e97218 1073741824" returned: 0 in 0.860s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:25:22 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-17bc6edc-6605-4adc-bd94-1feb2e2d1cb7 tempest-ServerActionsTestOtherA-177810280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-37f600b8-4b85-4859-8eb4-cd7968e97218 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:25:22 devstack sudo[99040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-37f600b8-4b85-4859-8eb4-cd7968e97218 Aug 26 14:25:22 devstack sudo[99040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:25:22 devstack sudo[99040]: pam_unix(sudo:session): session closed for user root Aug 26 14:25:22 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-17bc6edc-6605-4adc-bd94-1feb2e2d1cb7 tempest-ServerActionsTestOtherA-177810280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-37f600b8-4b85-4859-8eb4-cd7968e97218" returned: 0 in 0.549s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:25:22 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-17bc6edc-6605-4adc-bd94-1feb2e2d1cb7 tempest-ServerActionsTestOtherA-177810280 None] <== create_volume: return (1677ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:25:22 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-17bc6edc-6605-4adc-bd94-1feb2e2d1cb7 tempest-ServerActionsTestOtherA-177810280 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.680s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:25:23 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e5de7b6-a376-4726-8907-1c0ae47645ce tempest-DeleteServersTestJSON-599435894 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:25:23 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-5e5de7b6-a376-4726-8907-1c0ae47645ce tempest-DeleteServersTestJSON-599435894 None] Flow 'volume_create_manager' (e4c6af21-8442-4592-8b06-559d4802116b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:25:23 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-5e5de7b6-a376-4726-8907-1c0ae47645ce tempest-DeleteServersTestJSON-599435894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ef19d01-6813-4018-a6fd-a2bcceac9e86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:25:23 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-5e5de7b6-a376-4726-8907-1c0ae47645ce tempest-DeleteServersTestJSON-599435894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ef19d01-6813-4018-a6fd-a2bcceac9e86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:25:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-675994195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5007c8c0-3e14-432a-baec-9a1d70f7b093,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0a53a71385941308307f47a5ffb382f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:25:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:25:23Z,use_quota=True,user_id='7b9d854414ce4e4bac18fd8f64fc3529',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:25:23 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-5e5de7b6-a376-4726-8907-1c0ae47645ce tempest-DeleteServersTestJSON-599435894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7db7f56-b281-422b-b90a-270e3fa5581e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:25:23 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-5e5de7b6-a376-4726-8907-1c0ae47645ce tempest-DeleteServersTestJSON-599435894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7db7f56-b281-422b-b90a-270e3fa5581e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:25:23 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-5e5de7b6-a376-4726-8907-1c0ae47645ce tempest-DeleteServersTestJSON-599435894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (812e6221-c83e-4133-8b96-705fd6c14e48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:25:23 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-5e5de7b6-a376-4726-8907-1c0ae47645ce tempest-DeleteServersTestJSON-599435894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (812e6221-c83e-4133-8b96-705fd6c14e48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5007c8c0-3e14-432a-baec-9a1d70f7b093', 'volume_name': 'volume-5007c8c0-3e14-432a-baec-9a1d70f7b093', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:25:23 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-5e5de7b6-a376-4726-8907-1c0ae47645ce tempest-DeleteServersTestJSON-599435894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fed0a68-302e-4933-a836-6c4304dbb8d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:25:23 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-5e5de7b6-a376-4726-8907-1c0ae47645ce tempest-DeleteServersTestJSON-599435894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fed0a68-302e-4933-a836-6c4304dbb8d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:25:23 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-5e5de7b6-a376-4726-8907-1c0ae47645ce tempest-DeleteServersTestJSON-599435894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d6ccf5f-f66c-4954-a97d-98774e8f2227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:25:23 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-5e5de7b6-a376-4726-8907-1c0ae47645ce tempest-DeleteServersTestJSON-599435894 None] Volume 5007c8c0-3e14-432a-baec-9a1d70f7b093: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5007c8c0-3e14-432a-baec-9a1d70f7b093', 'volume_size': 1} Aug 26 14:25:23 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-5e5de7b6-a376-4726-8907-1c0ae47645ce tempest-DeleteServersTestJSON-599435894 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:25:23 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-5e5de7b6-a376-4726-8907-1c0ae47645ce tempest-DeleteServersTestJSON-599435894 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:25:23 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-5e5de7b6-a376-4726-8907-1c0ae47645ce tempest-DeleteServersTestJSON-599435894 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:25:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-675994195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5007c8c0-3e14-432a-baec-9a1d70f7b093,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0a53a71385941308307f47a5ffb382f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:25:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:25:23Z,use_quota=True,user_id='7b9d854414ce4e4bac18fd8f64fc3529',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:25:23 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-5e5de7b6-a376-4726-8907-1c0ae47645ce tempest-DeleteServersTestJSON-599435894 None] Creating volume 5007c8c0-3e14-432a-baec-9a1d70f7b093 {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:25:23 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-5e5de7b6-a376-4726-8907-1c0ae47645ce tempest-DeleteServersTestJSON-599435894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:25:23 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-5e5de7b6-a376-4726-8907-1c0ae47645ce tempest-DeleteServersTestJSON-599435894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:25:23 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-5e5de7b6-a376-4726-8907-1c0ae47645ce tempest-DeleteServersTestJSON-599435894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:25:23 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-5e5de7b6-a376-4726-8907-1c0ae47645ce tempest-DeleteServersTestJSON-599435894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:25:23 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-5e5de7b6-a376-4726-8907-1c0ae47645ce tempest-DeleteServersTestJSON-599435894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:25:23 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-5e5de7b6-a376-4726-8907-1c0ae47645ce tempest-DeleteServersTestJSON-599435894 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:25:23 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-5e5de7b6-a376-4726-8907-1c0ae47645ce tempest-DeleteServersTestJSON-599435894 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:25:23 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-5e5de7b6-a376-4726-8907-1c0ae47645ce tempest-DeleteServersTestJSON-599435894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5007c8c0-3e14-432a-baec-9a1d70f7b093 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:25:23 devstack cinder-volume[94394]: DEBUG cinder.volume.volume_utils [None req-17bc6edc-6605-4adc-bd94-1feb2e2d1cb7 tempest-ServerActionsTestOtherA-177810280 None] Attempting download of 2681f5d8-1c86-4dfd-86fb-c29aaed49dc6 ((None, [{'url': 'file:///opt/stack/data/glance/images/2681f5d8-1c86-4dfd-86fb-c29aaed49dc6', 'metadata': {}}])) to volume 37f600b8-4b85-4859-8eb4-cd7968e97218. {{(pid=94394) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 26 14:25:23 devstack sudo[99044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5007c8c0-3e14-432a-baec-9a1d70f7b093 1073741824 Aug 26 14:25:23 devstack sudo[99044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:25:23 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eada398-2ec0-4769-818e-8e96e21bf7b4]: (4, 'raw') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:25:23 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-17bc6edc-6605-4adc-bd94-1feb2e2d1cb7 tempest-ServerActionsTestOtherA-177810280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2681f5d8-1c86-4dfd-86fb-c29aaed49dc6_l3bs47ls {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:25:23 devstack sudo[99048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2681f5d8-1c86-4dfd-86fb-c29aaed49dc6_l3bs47ls Aug 26 14:25:23 devstack sudo[99048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:25:23 devstack sudo[99048]: pam_unix(sudo:session): session closed for user root Aug 26 14:25:23 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-17bc6edc-6605-4adc-bd94-1feb2e2d1cb7 tempest-ServerActionsTestOtherA-177810280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2681f5d8-1c86-4dfd-86fb-c29aaed49dc6_l3bs47ls" returned: 0 in 0.634s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:25:23 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-17bc6edc-6605-4adc-bd94-1feb2e2d1cb7 tempest-ServerActionsTestOtherA-177810280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2681f5d8-1c86-4dfd-86fb-c29aaed49dc6_l3bs47ls {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:25:24 devstack sudo[99055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2681f5d8-1c86-4dfd-86fb-c29aaed49dc6_l3bs47ls Aug 26 14:25:24 devstack sudo[99044]: pam_unix(sudo:session): session closed for user root Aug 26 14:25:24 devstack sudo[99055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:25:24 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-5e5de7b6-a376-4726-8907-1c0ae47645ce tempest-DeleteServersTestJSON-599435894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5007c8c0-3e14-432a-baec-9a1d70f7b093 1073741824" returned: 0 in 0.922s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:25:24 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-5e5de7b6-a376-4726-8907-1c0ae47645ce tempest-DeleteServersTestJSON-599435894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5007c8c0-3e14-432a-baec-9a1d70f7b093 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:25:24 devstack sudo[99057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5007c8c0-3e14-432a-baec-9a1d70f7b093 Aug 26 14:25:24 devstack sudo[99057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:25:24 devstack sudo[99055]: pam_unix(sudo:session): session closed for user root Aug 26 14:25:24 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-17bc6edc-6605-4adc-bd94-1feb2e2d1cb7 tempest-ServerActionsTestOtherA-177810280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2681f5d8-1c86-4dfd-86fb-c29aaed49dc6_l3bs47ls" returned: 1 in 0.500s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:25:24 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-17bc6edc-6605-4adc-bd94-1feb2e2d1cb7 tempest-ServerActionsTestOtherA-177810280 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2681f5d8-1c86-4dfd-86fb-c29aaed49dc6_l3bs47ls' failed. Not Retrying. {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 14:25:24 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[667d208d-77a1-4928-a0ca-4987ae20e03b]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:25:24 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-17bc6edc-6605-4adc-bd94-1feb2e2d1cb7 tempest-ServerActionsTestOtherA-177810280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2681f5d8-1c86-4dfd-86fb-c29aaed49dc6_2oi_5ekzdevstack@QuobyteHD {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:25:24 devstack sudo[99057]: pam_unix(sudo:session): session closed for user root Aug 26 14:25:24 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-5e5de7b6-a376-4726-8907-1c0ae47645ce tempest-DeleteServersTestJSON-599435894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5007c8c0-3e14-432a-baec-9a1d70f7b093" returned: 0 in 0.504s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:25:24 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-5e5de7b6-a376-4726-8907-1c0ae47645ce tempest-DeleteServersTestJSON-599435894 None] <== create_volume: return (1545ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:25:24 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-5e5de7b6-a376-4726-8907-1c0ae47645ce tempest-DeleteServersTestJSON-599435894 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.550s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:25:24 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-5e5de7b6-a376-4726-8907-1c0ae47645ce tempest-DeleteServersTestJSON-599435894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d6ccf5f-f66c-4954-a97d-98774e8f2227) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5007c8c0-3e14-432a-baec-9a1d70f7b093', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:25:24 devstack sudo[99061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2681f5d8-1c86-4dfd-86fb-c29aaed49dc6_2oi_5ekzdevstack@QuobyteHD Aug 26 14:25:24 devstack sudo[99061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:25:24 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-5e5de7b6-a376-4726-8907-1c0ae47645ce tempest-DeleteServersTestJSON-599435894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6fdf6d0-f881-459a-a1b7-eb58f2e04132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:25:24 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-5e5de7b6-a376-4726-8907-1c0ae47645ce tempest-DeleteServersTestJSON-599435894 None] Volume volume-5007c8c0-3e14-432a-baec-9a1d70f7b093 (5007c8c0-3e14-432a-baec-9a1d70f7b093): created successfully Aug 26 14:25:24 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-5e5de7b6-a376-4726-8907-1c0ae47645ce tempest-DeleteServersTestJSON-599435894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6fdf6d0-f881-459a-a1b7-eb58f2e04132) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:25:24 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-5e5de7b6-a376-4726-8907-1c0ae47645ce tempest-DeleteServersTestJSON-599435894 None] Flow 'volume_create_manager' (e4c6af21-8442-4592-8b06-559d4802116b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:25:24 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-5e5de7b6-a376-4726-8907-1c0ae47645ce tempest-DeleteServersTestJSON-599435894 None] Created volume successfully. Aug 26 14:25:25 devstack sudo[99061]: pam_unix(sudo:session): session closed for user root Aug 26 14:25:25 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-17bc6edc-6605-4adc-bd94-1feb2e2d1cb7 tempest-ServerActionsTestOtherA-177810280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2681f5d8-1c86-4dfd-86fb-c29aaed49dc6_2oi_5ekzdevstack@QuobyteHD" returned: 0 in 0.659s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:25:25 devstack cinder-volume[94394]: DEBUG cinder.image.image_utils [None req-17bc6edc-6605-4adc-bd94-1feb2e2d1cb7 tempest-ServerActionsTestOtherA-177810280 None] 2681f5d8-1c86-4dfd-86fb-c29aaed49dc6 was qcow2, converting to qcow2 {{(pid=94394) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 26 14:25:25 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-17bc6edc-6605-4adc-bd94-1feb2e2d1cb7 tempest-ServerActionsTestOtherA-177810280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2681f5d8-1c86-4dfd-86fb-c29aaed49dc6_2oi_5ekzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-37f600b8-4b85-4859-8eb4-cd7968e97218 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:25:25 devstack sudo[99069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2681f5d8-1c86-4dfd-86fb-c29aaed49dc6_2oi_5ekzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-37f600b8-4b85-4859-8eb4-cd7968e97218 Aug 26 14:25:25 devstack sudo[99069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:25:26 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7e0b207-9f7e-4bbb-8293-321426b92264 tempest-ServersNegativeTestJSON-197643218 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:25:26 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-a7e0b207-9f7e-4bbb-8293-321426b92264 tempest-ServersNegativeTestJSON-197643218 None] Flow 'volume_create_manager' (d71540d0-87e0-406e-bb03-7210e2703565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:25:26 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-a7e0b207-9f7e-4bbb-8293-321426b92264 tempest-ServersNegativeTestJSON-197643218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e54c5f8-993f-43b3-9ed5-5da4dcd9c731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:25:26 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-a7e0b207-9f7e-4bbb-8293-321426b92264 tempest-ServersNegativeTestJSON-197643218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e54c5f8-993f-43b3-9ed5-5da4dcd9c731) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:25:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-605549424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7461ff5b-6475-4e29-aabe-faea295a75c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6106351b3ef4155a8659dec68323b40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:25:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:25:26Z,use_quota=True,user_id='7fb0935ba6aa4c0e8bb90827425fca0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:25:26 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-a7e0b207-9f7e-4bbb-8293-321426b92264 tempest-ServersNegativeTestJSON-197643218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e705e2c3-f4a0-47dc-b171-702648f57d8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:25:26 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-a7e0b207-9f7e-4bbb-8293-321426b92264 tempest-ServersNegativeTestJSON-197643218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e705e2c3-f4a0-47dc-b171-702648f57d8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:25:26 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-a7e0b207-9f7e-4bbb-8293-321426b92264 tempest-ServersNegativeTestJSON-197643218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (781fafd4-cfd8-4149-ad8e-eec678d2f0d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:25:26 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-a7e0b207-9f7e-4bbb-8293-321426b92264 tempest-ServersNegativeTestJSON-197643218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (781fafd4-cfd8-4149-ad8e-eec678d2f0d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7461ff5b-6475-4e29-aabe-faea295a75c4', 'volume_name': 'volume-7461ff5b-6475-4e29-aabe-faea295a75c4', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:25:26 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-a7e0b207-9f7e-4bbb-8293-321426b92264 tempest-ServersNegativeTestJSON-197643218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a83503f5-cf2b-453d-8a1a-9c7e540c554f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:25:26 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-a7e0b207-9f7e-4bbb-8293-321426b92264 tempest-ServersNegativeTestJSON-197643218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a83503f5-cf2b-453d-8a1a-9c7e540c554f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:25:26 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-a7e0b207-9f7e-4bbb-8293-321426b92264 tempest-ServersNegativeTestJSON-197643218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87476ce8-3f30-4293-abea-065db3e90082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:25:26 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-a7e0b207-9f7e-4bbb-8293-321426b92264 tempest-ServersNegativeTestJSON-197643218 None] Volume 7461ff5b-6475-4e29-aabe-faea295a75c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7461ff5b-6475-4e29-aabe-faea295a75c4', 'volume_size': 1} Aug 26 14:25:26 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-a7e0b207-9f7e-4bbb-8293-321426b92264 tempest-ServersNegativeTestJSON-197643218 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:25:26 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-a7e0b207-9f7e-4bbb-8293-321426b92264 tempest-ServersNegativeTestJSON-197643218 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:25:26 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-a7e0b207-9f7e-4bbb-8293-321426b92264 tempest-ServersNegativeTestJSON-197643218 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:25:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-605549424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7461ff5b-6475-4e29-aabe-faea295a75c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6106351b3ef4155a8659dec68323b40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:25:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:25:26Z,use_quota=True,user_id='7fb0935ba6aa4c0e8bb90827425fca0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:25:26 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-a7e0b207-9f7e-4bbb-8293-321426b92264 tempest-ServersNegativeTestJSON-197643218 None] Creating volume 7461ff5b-6475-4e29-aabe-faea295a75c4 {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:25:26 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-a7e0b207-9f7e-4bbb-8293-321426b92264 tempest-ServersNegativeTestJSON-197643218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:25:26 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-a7e0b207-9f7e-4bbb-8293-321426b92264 tempest-ServersNegativeTestJSON-197643218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:25:26 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-a7e0b207-9f7e-4bbb-8293-321426b92264 tempest-ServersNegativeTestJSON-197643218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:25:26 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-a7e0b207-9f7e-4bbb-8293-321426b92264 tempest-ServersNegativeTestJSON-197643218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:25:26 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-a7e0b207-9f7e-4bbb-8293-321426b92264 tempest-ServersNegativeTestJSON-197643218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:25:26 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-a7e0b207-9f7e-4bbb-8293-321426b92264 tempest-ServersNegativeTestJSON-197643218 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:25:26 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-a7e0b207-9f7e-4bbb-8293-321426b92264 tempest-ServersNegativeTestJSON-197643218 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:25:26 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-a7e0b207-9f7e-4bbb-8293-321426b92264 tempest-ServersNegativeTestJSON-197643218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-7461ff5b-6475-4e29-aabe-faea295a75c4 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:25:26 devstack sudo[99079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-7461ff5b-6475-4e29-aabe-faea295a75c4 1073741824 Aug 26 14:25:26 devstack sudo[99079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:25:27 devstack sudo[99079]: pam_unix(sudo:session): session closed for user root Aug 26 14:25:27 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-a7e0b207-9f7e-4bbb-8293-321426b92264 tempest-ServersNegativeTestJSON-197643218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-7461ff5b-6475-4e29-aabe-faea295a75c4 1073741824" returned: 0 in 0.906s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:25:27 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-a7e0b207-9f7e-4bbb-8293-321426b92264 tempest-ServersNegativeTestJSON-197643218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-7461ff5b-6475-4e29-aabe-faea295a75c4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:25:27 devstack sudo[99096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-7461ff5b-6475-4e29-aabe-faea295a75c4 Aug 26 14:25:27 devstack sudo[99096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:25:27 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [req-86b7d2b9-20d6-4cc5-8de9-c3b600dccf1f req-fd00c0d6-5df2-4ce3-8e44-3c1cca347146 tempest-DeleteServersTestJSON-599435894 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:25:27 devstack sudo[99096]: pam_unix(sudo:session): session closed for user root Aug 26 14:25:27 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-a7e0b207-9f7e-4bbb-8293-321426b92264 tempest-ServersNegativeTestJSON-197643218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-7461ff5b-6475-4e29-aabe-faea295a75c4" returned: 0 in 0.366s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:25:27 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-a7e0b207-9f7e-4bbb-8293-321426b92264 tempest-ServersNegativeTestJSON-197643218 None] <== create_volume: return (1365ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:25:27 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-a7e0b207-9f7e-4bbb-8293-321426b92264 tempest-ServersNegativeTestJSON-197643218 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.367s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:25:27 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [req-86b7d2b9-20d6-4cc5-8de9-c3b600dccf1f req-fd00c0d6-5df2-4ce3-8e44-3c1cca347146 tempest-DeleteServersTestJSON-599435894 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.286s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:25:27 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [req-86b7d2b9-20d6-4cc5-8de9-c3b600dccf1f req-fd00c0d6-5df2-4ce3-8e44-3c1cca347146 tempest-DeleteServersTestJSON-599435894 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:25:27 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-a7e0b207-9f7e-4bbb-8293-321426b92264 tempest-ServersNegativeTestJSON-197643218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87476ce8-3f30-4293-abea-065db3e90082) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7461ff5b-6475-4e29-aabe-faea295a75c4', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:25:27 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-a7e0b207-9f7e-4bbb-8293-321426b92264 tempest-ServersNegativeTestJSON-197643218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ce30cf1-c94f-4417-a56a-9611176c16fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:25:27 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-a7e0b207-9f7e-4bbb-8293-321426b92264 tempest-ServersNegativeTestJSON-197643218 None] Volume volume-7461ff5b-6475-4e29-aabe-faea295a75c4 (7461ff5b-6475-4e29-aabe-faea295a75c4): created successfully Aug 26 14:25:27 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-a7e0b207-9f7e-4bbb-8293-321426b92264 tempest-ServersNegativeTestJSON-197643218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ce30cf1-c94f-4417-a56a-9611176c16fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:25:27 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-a7e0b207-9f7e-4bbb-8293-321426b92264 tempest-ServersNegativeTestJSON-197643218 None] Flow 'volume_create_manager' (d71540d0-87e0-406e-bb03-7210e2703565) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:25:27 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [req-86b7d2b9-20d6-4cc5-8de9-c3b600dccf1f req-fd00c0d6-5df2-4ce3-8e44-3c1cca347146 tempest-DeleteServersTestJSON-599435894 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b', 'name': 'volume-5007c8c0-3e14-432a-baec-9a1d70f7b093', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f5caf145-7943-41a0-9a60-ed2f99b6f811', 'enforce_multipath': True} {{(pid=94394) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 14:25:27 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-a7e0b207-9f7e-4bbb-8293-321426b92264 tempest-ServersNegativeTestJSON-197643218 None] Created volume successfully. Aug 26 14:25:27 devstack cinder-volume[94394]: INFO cinder.volume.manager [req-86b7d2b9-20d6-4cc5-8de9-c3b600dccf1f req-fd00c0d6-5df2-4ce3-8e44-3c1cca347146 tempest-DeleteServersTestJSON-599435894 None] attachment_update completed successfully. Aug 26 14:25:27 devstack sudo[99069]: pam_unix(sudo:session): session closed for user root Aug 26 14:25:28 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-17bc6edc-6605-4adc-bd94-1feb2e2d1cb7 tempest-ServerActionsTestOtherA-177810280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2681f5d8-1c86-4dfd-86fb-c29aaed49dc6_2oi_5ekzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-37f600b8-4b85-4859-8eb4-cd7968e97218" returned: 0 in 2.857s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:25:28 devstack cinder-volume[94394]: DEBUG cinder.image.image_utils [None req-17bc6edc-6605-4adc-bd94-1feb2e2d1cb7 tempest-ServerActionsTestOtherA-177810280 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2681f5d8-1c86-4dfd-86fb-c29aaed49dc6_2oi_5ekzdevstack@QuobyteHD, size 112.00 MB, duration 2.86 sec, destination /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-37f600b8-4b85-4859-8eb4-cd7968e97218 {{(pid=94394) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 14:25:28 devstack cinder-volume[94394]: INFO cinder.image.image_utils [None req-17bc6edc-6605-4adc-bd94-1feb2e2d1cb7 tempest-ServerActionsTestOtherA-177810280 None] Converted 112.00 MB image at 39.19 MB/s Aug 26 14:25:28 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-17bc6edc-6605-4adc-bd94-1feb2e2d1cb7 tempest-ServerActionsTestOtherA-177810280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-37f600b8-4b85-4859-8eb4-cd7968e97218 1G {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:25:28 devstack sudo[99163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-37f600b8-4b85-4859-8eb4-cd7968e97218 1G Aug 26 14:25:28 devstack sudo[99163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:25:28 devstack sudo[99163]: pam_unix(sudo:session): session closed for user root Aug 26 14:25:28 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-17bc6edc-6605-4adc-bd94-1feb2e2d1cb7 tempest-ServerActionsTestOtherA-177810280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-37f600b8-4b85-4859-8eb4-cd7968e97218 1G" returned: 0 in 0.556s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:25:28 devstack cinder-volume[94394]: DEBUG cinder.volume.volume_utils [None req-17bc6edc-6605-4adc-bd94-1feb2e2d1cb7 tempest-ServerActionsTestOtherA-177810280 None] Downloaded image 2681f5d8-1c86-4dfd-86fb-c29aaed49dc6 ((None, [{'url': 'file:///opt/stack/data/glance/images/2681f5d8-1c86-4dfd-86fb-c29aaed49dc6', 'metadata': {}}])) to volume 37f600b8-4b85-4859-8eb4-cd7968e97218 successfully. {{(pid=94394) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 26 14:25:28 devstack cinder-volume[94394]: DEBUG cinder.image.image_utils [None req-17bc6edc-6605-4adc-bd94-1feb2e2d1cb7 tempest-ServerActionsTestOtherA-177810280 None] Temporary image 2681f5d8-1c86-4dfd-86fb-c29aaed49dc6 for user 808344d184d94b1c8fce92d044169973 is deleted. {{(pid=94394) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 26 14:25:28 devstack cinder-volume[94394]: DEBUG cinder.volume.volume_utils [None req-17bc6edc-6605-4adc-bd94-1feb2e2d1cb7 tempest-ServerActionsTestOtherA-177810280 None] Marking volume 37f600b8-4b85-4859-8eb4-cd7968e97218 as bootable. {{(pid=94394) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 26 14:25:28 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-17bc6edc-6605-4adc-bd94-1feb2e2d1cb7 tempest-ServerActionsTestOtherA-177810280 None] Copying metadata from image 2681f5d8-1c86-4dfd-86fb-c29aaed49dc6 to 37f600b8-4b85-4859-8eb4-cd7968e97218. {{(pid=94394) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 26 14:25:28 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-17bc6edc-6605-4adc-bd94-1feb2e2d1cb7 tempest-ServerActionsTestOtherA-177810280 None] Creating volume glance metadata for volume 37f600b8-4b85-4859-8eb4-cd7968e97218 backed by image 2681f5d8-1c86-4dfd-86fb-c29aaed49dc6 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '2681f5d8-1c86-4dfd-86fb-c29aaed49dc6', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=94394) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 26 14:25:28 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-17bc6edc-6605-4adc-bd94-1feb2e2d1cb7 tempest-ServerActionsTestOtherA-177810280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df770056-6079-4178-b880-f01af3a3c15a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37f600b8-4b85-4859-8eb4-cd7968e97218', 'volume_size': 1, 'image_id': '2681f5d8-1c86-4dfd-86fb-c29aaed49dc6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2681f5d8-1c86-4dfd-86fb-c29aaed49dc6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cbf977c46caa48c18e414079bf75016d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2681f5d8-1c86-4dfd-86fb-c29aaed49dc6', 'created_at': datetime.datetime(2026, 8, 26, 12, 16, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 12, 16, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2681f5d8-1c86-4dfd-86fb-c29aaed49dc6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:25:28 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-17bc6edc-6605-4adc-bd94-1feb2e2d1cb7 tempest-ServerActionsTestOtherA-177810280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a782f376-43c3-4ec6-ad5d-af47e20d0fba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:25:28 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-17bc6edc-6605-4adc-bd94-1feb2e2d1cb7 tempest-ServerActionsTestOtherA-177810280 None] Volume volume-37f600b8-4b85-4859-8eb4-cd7968e97218 (37f600b8-4b85-4859-8eb4-cd7968e97218): created successfully Aug 26 14:25:28 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-17bc6edc-6605-4adc-bd94-1feb2e2d1cb7 tempest-ServerActionsTestOtherA-177810280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a782f376-43c3-4ec6-ad5d-af47e20d0fba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:25:28 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-17bc6edc-6605-4adc-bd94-1feb2e2d1cb7 tempest-ServerActionsTestOtherA-177810280 None] Flow 'volume_create_manager' (3ea8d42a-77ca-4996-94e9-8967d6c372c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:25:28 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-17bc6edc-6605-4adc-bd94-1feb2e2d1cb7 tempest-ServerActionsTestOtherA-177810280 None] Created volume successfully. Aug 26 14:25:30 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-62545936-b233-40cb-a31e-76709270365d tempest-ServersNegativeTestJSON-197643218 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:25:30 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-62545936-b233-40cb-a31e-76709270365d tempest-ServersNegativeTestJSON-197643218 None] Flow 'volume_create_manager' (f9db9151-2ab2-4792-9abd-2286fe70cb54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:25:30 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-62545936-b233-40cb-a31e-76709270365d tempest-ServersNegativeTestJSON-197643218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5908c7cb-13c0-4a8a-8c5c-217c8ea08bea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:25:30 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-62545936-b233-40cb-a31e-76709270365d tempest-ServersNegativeTestJSON-197643218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5908c7cb-13c0-4a8a-8c5c-217c8ea08bea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:25:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1259005108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=822279f1-d270-4d1e-9491-1f8614244f11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6106351b3ef4155a8659dec68323b40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:25:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:25:30Z,use_quota=True,user_id='7fb0935ba6aa4c0e8bb90827425fca0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:25:30 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-62545936-b233-40cb-a31e-76709270365d tempest-ServersNegativeTestJSON-197643218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (185c8f79-0d3d-4215-9340-73083a903d3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:25:30 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-62545936-b233-40cb-a31e-76709270365d tempest-ServersNegativeTestJSON-197643218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (185c8f79-0d3d-4215-9340-73083a903d3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:25:30 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-62545936-b233-40cb-a31e-76709270365d tempest-ServersNegativeTestJSON-197643218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (025feb60-403b-44ca-a68a-5387864636a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:25:30 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-62545936-b233-40cb-a31e-76709270365d tempest-ServersNegativeTestJSON-197643218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (025feb60-403b-44ca-a68a-5387864636a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '822279f1-d270-4d1e-9491-1f8614244f11', 'volume_name': 'volume-822279f1-d270-4d1e-9491-1f8614244f11', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:25:30 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-62545936-b233-40cb-a31e-76709270365d tempest-ServersNegativeTestJSON-197643218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce05ab41-1095-4593-8d86-5aa5a81b80b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:25:30 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-62545936-b233-40cb-a31e-76709270365d tempest-ServersNegativeTestJSON-197643218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce05ab41-1095-4593-8d86-5aa5a81b80b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:25:30 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-62545936-b233-40cb-a31e-76709270365d tempest-ServersNegativeTestJSON-197643218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f640cc9-cd2f-425c-a387-59c0d4ba2f21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:25:30 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-62545936-b233-40cb-a31e-76709270365d tempest-ServersNegativeTestJSON-197643218 None] Volume 822279f1-d270-4d1e-9491-1f8614244f11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-822279f1-d270-4d1e-9491-1f8614244f11', 'volume_size': 1} Aug 26 14:25:30 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-62545936-b233-40cb-a31e-76709270365d tempest-ServersNegativeTestJSON-197643218 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:25:30 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-62545936-b233-40cb-a31e-76709270365d tempest-ServersNegativeTestJSON-197643218 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:25:30 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-62545936-b233-40cb-a31e-76709270365d tempest-ServersNegativeTestJSON-197643218 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:25:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1259005108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=822279f1-d270-4d1e-9491-1f8614244f11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6106351b3ef4155a8659dec68323b40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:25:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:25:30Z,use_quota=True,user_id='7fb0935ba6aa4c0e8bb90827425fca0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:25:30 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-62545936-b233-40cb-a31e-76709270365d tempest-ServersNegativeTestJSON-197643218 None] Creating volume 822279f1-d270-4d1e-9491-1f8614244f11 {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:25:30 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-62545936-b233-40cb-a31e-76709270365d tempest-ServersNegativeTestJSON-197643218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:25:30 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-62545936-b233-40cb-a31e-76709270365d tempest-ServersNegativeTestJSON-197643218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:25:30 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-62545936-b233-40cb-a31e-76709270365d tempest-ServersNegativeTestJSON-197643218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:25:30 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-62545936-b233-40cb-a31e-76709270365d tempest-ServersNegativeTestJSON-197643218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:25:30 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-62545936-b233-40cb-a31e-76709270365d tempest-ServersNegativeTestJSON-197643218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:25:30 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-62545936-b233-40cb-a31e-76709270365d tempest-ServersNegativeTestJSON-197643218 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:25:30 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-62545936-b233-40cb-a31e-76709270365d tempest-ServersNegativeTestJSON-197643218 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:25:30 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-62545936-b233-40cb-a31e-76709270365d tempest-ServersNegativeTestJSON-197643218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-822279f1-d270-4d1e-9491-1f8614244f11 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:25:30 devstack sudo[99492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-822279f1-d270-4d1e-9491-1f8614244f11 1073741824 Aug 26 14:25:30 devstack sudo[99492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:25:31 devstack sudo[99492]: pam_unix(sudo:session): session closed for user root Aug 26 14:25:31 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-62545936-b233-40cb-a31e-76709270365d tempest-ServersNegativeTestJSON-197643218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-822279f1-d270-4d1e-9491-1f8614244f11 1073741824" returned: 0 in 0.844s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:25:31 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-62545936-b233-40cb-a31e-76709270365d tempest-ServersNegativeTestJSON-197643218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-822279f1-d270-4d1e-9491-1f8614244f11 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:25:31 devstack sudo[99509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-822279f1-d270-4d1e-9491-1f8614244f11 Aug 26 14:25:31 devstack sudo[99509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:25:31 devstack sudo[99509]: pam_unix(sudo:session): session closed for user root Aug 26 14:25:31 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-62545936-b233-40cb-a31e-76709270365d tempest-ServersNegativeTestJSON-197643218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-822279f1-d270-4d1e-9491-1f8614244f11" returned: 0 in 0.537s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:25:31 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-62545936-b233-40cb-a31e-76709270365d tempest-ServersNegativeTestJSON-197643218 None] <== create_volume: return (1463ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:25:31 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-62545936-b233-40cb-a31e-76709270365d tempest-ServersNegativeTestJSON-197643218 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.468s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:25:32 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-62545936-b233-40cb-a31e-76709270365d tempest-ServersNegativeTestJSON-197643218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f640cc9-cd2f-425c-a387-59c0d4ba2f21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-822279f1-d270-4d1e-9491-1f8614244f11', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:25:32 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-62545936-b233-40cb-a31e-76709270365d tempest-ServersNegativeTestJSON-197643218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d27ba9d4-93fb-4d72-ab95-0228bd26469b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:25:32 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-62545936-b233-40cb-a31e-76709270365d tempest-ServersNegativeTestJSON-197643218 None] Volume volume-822279f1-d270-4d1e-9491-1f8614244f11 (822279f1-d270-4d1e-9491-1f8614244f11): created successfully Aug 26 14:25:32 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-62545936-b233-40cb-a31e-76709270365d tempest-ServersNegativeTestJSON-197643218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d27ba9d4-93fb-4d72-ab95-0228bd26469b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:25:32 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-62545936-b233-40cb-a31e-76709270365d tempest-ServersNegativeTestJSON-197643218 None] Flow 'volume_create_manager' (f9db9151-2ab2-4792-9abd-2286fe70cb54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:25:32 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-62545936-b233-40cb-a31e-76709270365d tempest-ServersNegativeTestJSON-197643218 None] Created volume successfully. Aug 26 14:25:33 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-67b261f8-e279-4c16-8b37-77c5f9fd3e53 tempest-ServersNegativeTestJSON-197643218 None] Acquiring lock "cinder-822279f1-d270-4d1e-9491-1f8614244f11-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:25:33 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-67b261f8-e279-4c16-8b37-77c5f9fd3e53 tempest-ServersNegativeTestJSON-197643218 None] Lock "cinder-822279f1-d270-4d1e-9491-1f8614244f11-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:25:33 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-67b261f8-e279-4c16-8b37-77c5f9fd3e53 tempest-ServersNegativeTestJSON-197643218 None] Acquiring lock "cinder-quobyte-822279f1-d270-4d1e-9491-1f8614244f11" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:25:33 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-67b261f8-e279-4c16-8b37-77c5f9fd3e53 tempest-ServersNegativeTestJSON-197643218 None] Lock "cinder-quobyte-822279f1-d270-4d1e-9491-1f8614244f11" acquired by "delete_volume" :: waited 0.032s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:25:33 devstack cinder-volume[94394]: DEBUG oslo_service.periodic_task [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94394) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 14:25:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:25:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:25:33 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:25:33 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:25:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:25:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:25:33 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[58c0ec15-095e-4940-8407-510da8d7ff60]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:25:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-67b261f8-e279-4c16-8b37-77c5f9fd3e53 tempest-ServersNegativeTestJSON-197643218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-822279f1-d270-4d1e-9491-1f8614244f11 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:25:33 devstack sudo[99570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:25:33 devstack sudo[99570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:25:33 devstack sudo[99571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-822279f1-d270-4d1e-9491-1f8614244f11 Aug 26 14:25:33 devstack sudo[99571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:25:34 devstack cinder-volume[94394]: INFO cinder.volume.manager [req-3d5766f6-4bae-4d79-a536-951c2989e8be req-9717d2c0-2a02-4673-9531-4aab875fc926 tempest-DeleteServersTestJSON-599435894 None] Terminate volume connection completed successfully. Aug 26 14:25:34 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [req-3d5766f6-4bae-4d79-a536-951c2989e8be req-9717d2c0-2a02-4673-9531-4aab875fc926 tempest-DeleteServersTestJSON-599435894 None] Deleting attachment f5caf145-7943-41a0-9a60-ed2f99b6f811. {{(pid=94394) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 14:25:34 devstack sudo[99570]: pam_unix(sudo:session): session closed for user root Aug 26 14:25:34 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.950s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:25:34 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:25:34 devstack cinder-volume[94394]: DEBUG oslo_service.periodic_task [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Running periodic task VolumeManager._thread_info {{(pid=94394) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 14:25:34 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] thread count: 28 {{(pid=94394) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 14:25:34 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] thread info: [<_MainThread(MainThread, started 126600738033792)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94394) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 14:25:34 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [req-44e2b976-b2ca-42bc-93e4-c1e428977932 req-0fb823c7-7978-4cb9-8a20-4f9898549e7f tempest-ServerActionsTestOtherA-177810280 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:25:34 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [req-44e2b976-b2ca-42bc-93e4-c1e428977932 req-0fb823c7-7978-4cb9-8a20-4f9898549e7f tempest-ServerActionsTestOtherA-177810280 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:25:34 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [req-44e2b976-b2ca-42bc-93e4-c1e428977932 req-0fb823c7-7978-4cb9-8a20-4f9898549e7f tempest-ServerActionsTestOtherA-177810280 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.034s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:25:34 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [req-44e2b976-b2ca-42bc-93e4-c1e428977932 req-0fb823c7-7978-4cb9-8a20-4f9898549e7f tempest-ServerActionsTestOtherA-177810280 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b', 'name': 'volume-37f600b8-4b85-4859-8eb4-cd7968e97218', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c80b444c-2d86-4779-afdf-0920e819c8d9', 'enforce_multipath': True} {{(pid=94394) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 14:25:34 devstack sudo[99571]: pam_unix(sudo:session): session closed for user root Aug 26 14:25:34 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-67b261f8-e279-4c16-8b37-77c5f9fd3e53 tempest-ServersNegativeTestJSON-197643218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-822279f1-d270-4d1e-9491-1f8614244f11" returned: 0 in 1.240s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:25:34 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-67b261f8-e279-4c16-8b37-77c5f9fd3e53 tempest-ServersNegativeTestJSON-197643218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-822279f1-d270-4d1e-9491-1f8614244f11 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:25:34 devstack sudo[99598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-822279f1-d270-4d1e-9491-1f8614244f11 Aug 26 14:25:34 devstack sudo[99598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:25:34 devstack cinder-volume[94394]: INFO cinder.volume.manager [req-44e2b976-b2ca-42bc-93e4-c1e428977932 req-0fb823c7-7978-4cb9-8a20-4f9898549e7f tempest-ServerActionsTestOtherA-177810280 None] attachment_update completed successfully. Aug 26 14:25:35 devstack sudo[99598]: pam_unix(sudo:session): session closed for user root Aug 26 14:25:35 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-67b261f8-e279-4c16-8b37-77c5f9fd3e53 tempest-ServersNegativeTestJSON-197643218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-822279f1-d270-4d1e-9491-1f8614244f11" returned: 0 in 0.357s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:25:35 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-67b261f8-e279-4c16-8b37-77c5f9fd3e53 tempest-ServersNegativeTestJSON-197643218 None] Lock "cinder-quobyte-822279f1-d270-4d1e-9491-1f8614244f11" released by "delete_volume" :: held 1.681s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:25:35 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-67b261f8-e279-4c16-8b37-77c5f9fd3e53 tempest-ServersNegativeTestJSON-197643218 None] Created reservations ['1412e4bf-f6f3-448f-b18e-9d6313fb4e9a', '2979fc96-f311-40bf-9375-0ac91c9b3bf0', '0d8cd51a-35d3-4299-9aeb-e2563caadfde', 'b4cc4b31-4cff-43de-a5e5-46e79a491234'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:25:35 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-67b261f8-e279-4c16-8b37-77c5f9fd3e53 tempest-ServersNegativeTestJSON-197643218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:25:35 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-67b261f8-e279-4c16-8b37-77c5f9fd3e53 tempest-ServersNegativeTestJSON-197643218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:25:35 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-67b261f8-e279-4c16-8b37-77c5f9fd3e53 tempest-ServersNegativeTestJSON-197643218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:25:35 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-67b261f8-e279-4c16-8b37-77c5f9fd3e53 tempest-ServersNegativeTestJSON-197643218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:25:35 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-67b261f8-e279-4c16-8b37-77c5f9fd3e53 tempest-ServersNegativeTestJSON-197643218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:25:35 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-67b261f8-e279-4c16-8b37-77c5f9fd3e53 tempest-ServersNegativeTestJSON-197643218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:25:35 devstack sudo[99601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:25:35 devstack sudo[99601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:25:36 devstack sudo[99601]: pam_unix(sudo:session): session closed for user root Aug 26 14:25:36 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-67b261f8-e279-4c16-8b37-77c5f9fd3e53 tempest-ServersNegativeTestJSON-197643218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.603s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:25:36 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-67b261f8-e279-4c16-8b37-77c5f9fd3e53 tempest-ServersNegativeTestJSON-197643218 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:25:36 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-67b261f8-e279-4c16-8b37-77c5f9fd3e53 tempest-ServersNegativeTestJSON-197643218 None] Deleted volume successfully. Aug 26 14:25:36 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-30677950-5d04-4d5b-8dc3-2c6b4096e55a tempest-ServersNegativeTestJSON-197643218 None] Acquiring lock "cinder-7461ff5b-6475-4e29-aabe-faea295a75c4-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:25:36 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-67b261f8-e279-4c16-8b37-77c5f9fd3e53 tempest-ServersNegativeTestJSON-197643218 None] Lock "cinder-822279f1-d270-4d1e-9491-1f8614244f11-delete_volume" released by "delete_volume" :: held 2.744s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:25:36 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-30677950-5d04-4d5b-8dc3-2c6b4096e55a tempest-ServersNegativeTestJSON-197643218 None] Lock "cinder-7461ff5b-6475-4e29-aabe-faea295a75c4-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:25:36 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-30677950-5d04-4d5b-8dc3-2c6b4096e55a tempest-ServersNegativeTestJSON-197643218 None] Acquiring lock "cinder-quobyte-7461ff5b-6475-4e29-aabe-faea295a75c4" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:25:36 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-30677950-5d04-4d5b-8dc3-2c6b4096e55a tempest-ServersNegativeTestJSON-197643218 None] Lock "cinder-quobyte-7461ff5b-6475-4e29-aabe-faea295a75c4" acquired by "delete_volume" :: waited 0.028s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:25:36 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7db2338-2409-45a9-a1ab-7a84ef0cdbde]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:25:36 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-30677950-5d04-4d5b-8dc3-2c6b4096e55a tempest-ServersNegativeTestJSON-197643218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-7461ff5b-6475-4e29-aabe-faea295a75c4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:25:36 devstack sudo[99604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-7461ff5b-6475-4e29-aabe-faea295a75c4 Aug 26 14:25:36 devstack sudo[99604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:25:36 devstack sudo[99604]: pam_unix(sudo:session): session closed for user root Aug 26 14:25:36 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-30677950-5d04-4d5b-8dc3-2c6b4096e55a tempest-ServersNegativeTestJSON-197643218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-7461ff5b-6475-4e29-aabe-faea295a75c4" returned: 0 in 0.563s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:25:36 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-30677950-5d04-4d5b-8dc3-2c6b4096e55a tempest-ServersNegativeTestJSON-197643218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-7461ff5b-6475-4e29-aabe-faea295a75c4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:25:36 devstack sudo[99609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-7461ff5b-6475-4e29-aabe-faea295a75c4 Aug 26 14:25:36 devstack sudo[99609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:25:37 devstack sudo[99609]: pam_unix(sudo:session): session closed for user root Aug 26 14:25:37 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-30677950-5d04-4d5b-8dc3-2c6b4096e55a tempest-ServersNegativeTestJSON-197643218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-7461ff5b-6475-4e29-aabe-faea295a75c4" returned: 0 in 0.387s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:25:37 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-30677950-5d04-4d5b-8dc3-2c6b4096e55a tempest-ServersNegativeTestJSON-197643218 None] Lock "cinder-quobyte-7461ff5b-6475-4e29-aabe-faea295a75c4" released by "delete_volume" :: held 1.016s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:25:37 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-30677950-5d04-4d5b-8dc3-2c6b4096e55a tempest-ServersNegativeTestJSON-197643218 None] Created reservations ['77ea6085-5352-41ab-b1de-cbf2b759a8a3', '06132b29-04f7-4263-aa21-14be08d120f3', '534a1758-0260-4bc7-8c96-1173d058b7e8', '09e3d96d-d740-43a6-a22b-c1d17dd20701'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:25:37 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-cb35bb99-4b82-4724-8bfb-9007a9113d15 tempest-DeleteServersTestJSON-599435894 None] Acquiring lock "cinder-5007c8c0-3e14-432a-baec-9a1d70f7b093-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:25:37 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-cb35bb99-4b82-4724-8bfb-9007a9113d15 tempest-DeleteServersTestJSON-599435894 None] Lock "cinder-5007c8c0-3e14-432a-baec-9a1d70f7b093-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:25:37 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-30677950-5d04-4d5b-8dc3-2c6b4096e55a tempest-ServersNegativeTestJSON-197643218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:25:37 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-30677950-5d04-4d5b-8dc3-2c6b4096e55a tempest-ServersNegativeTestJSON-197643218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:25:37 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-30677950-5d04-4d5b-8dc3-2c6b4096e55a tempest-ServersNegativeTestJSON-197643218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:25:37 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-30677950-5d04-4d5b-8dc3-2c6b4096e55a tempest-ServersNegativeTestJSON-197643218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:25:37 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-30677950-5d04-4d5b-8dc3-2c6b4096e55a tempest-ServersNegativeTestJSON-197643218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:25:37 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-30677950-5d04-4d5b-8dc3-2c6b4096e55a tempest-ServersNegativeTestJSON-197643218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:25:37 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-cb35bb99-4b82-4724-8bfb-9007a9113d15 tempest-DeleteServersTestJSON-599435894 None] Acquiring lock "cinder-quobyte-5007c8c0-3e14-432a-baec-9a1d70f7b093" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:25:37 devstack sudo[99612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:25:37 devstack sudo[99612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:25:37 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-cb35bb99-4b82-4724-8bfb-9007a9113d15 tempest-DeleteServersTestJSON-599435894 None] Lock "cinder-quobyte-5007c8c0-3e14-432a-baec-9a1d70f7b093" acquired by "delete_volume" :: waited 0.030s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:25:37 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[0581f00c-c3a4-41c8-8f38-e38c1110b6df]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:25:37 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-cb35bb99-4b82-4724-8bfb-9007a9113d15 tempest-DeleteServersTestJSON-599435894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5007c8c0-3e14-432a-baec-9a1d70f7b093 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:25:37 devstack sudo[99615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5007c8c0-3e14-432a-baec-9a1d70f7b093 Aug 26 14:25:37 devstack sudo[99615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:25:37 devstack sudo[99612]: pam_unix(sudo:session): session closed for user root Aug 26 14:25:37 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-30677950-5d04-4d5b-8dc3-2c6b4096e55a tempest-ServersNegativeTestJSON-197643218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.431s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:25:37 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-30677950-5d04-4d5b-8dc3-2c6b4096e55a tempest-ServersNegativeTestJSON-197643218 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:25:37 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-30677950-5d04-4d5b-8dc3-2c6b4096e55a tempest-ServersNegativeTestJSON-197643218 None] Deleted volume successfully. Aug 26 14:25:38 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-30677950-5d04-4d5b-8dc3-2c6b4096e55a tempest-ServersNegativeTestJSON-197643218 None] Lock "cinder-7461ff5b-6475-4e29-aabe-faea295a75c4-delete_volume" released by "delete_volume" :: held 1.873s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:25:38 devstack sudo[99615]: pam_unix(sudo:session): session closed for user root Aug 26 14:25:38 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-cb35bb99-4b82-4724-8bfb-9007a9113d15 tempest-DeleteServersTestJSON-599435894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5007c8c0-3e14-432a-baec-9a1d70f7b093" returned: 0 in 0.508s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:25:38 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-cb35bb99-4b82-4724-8bfb-9007a9113d15 tempest-DeleteServersTestJSON-599435894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5007c8c0-3e14-432a-baec-9a1d70f7b093 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:25:38 devstack sudo[99622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5007c8c0-3e14-432a-baec-9a1d70f7b093 Aug 26 14:25:38 devstack sudo[99622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:25:38 devstack sudo[99622]: pam_unix(sudo:session): session closed for user root Aug 26 14:25:38 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-cb35bb99-4b82-4724-8bfb-9007a9113d15 tempest-DeleteServersTestJSON-599435894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5007c8c0-3e14-432a-baec-9a1d70f7b093" returned: 0 in 0.435s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:25:38 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-cb35bb99-4b82-4724-8bfb-9007a9113d15 tempest-DeleteServersTestJSON-599435894 None] Lock "cinder-quobyte-5007c8c0-3e14-432a-baec-9a1d70f7b093" released by "delete_volume" :: held 1.020s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:25:38 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-cb35bb99-4b82-4724-8bfb-9007a9113d15 tempest-DeleteServersTestJSON-599435894 None] Created reservations ['3ab01143-e5fd-4f49-bc23-6e20028ca8d9', 'f9416acc-cc5c-4927-ac1d-3229c1a83795', '56d97385-b819-4f40-add1-7dd371720849', '9911c7b5-f5ec-4da4-99a9-94014bd44381'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:25:38 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-cb35bb99-4b82-4724-8bfb-9007a9113d15 tempest-DeleteServersTestJSON-599435894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:25:38 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-cb35bb99-4b82-4724-8bfb-9007a9113d15 tempest-DeleteServersTestJSON-599435894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:25:38 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-cb35bb99-4b82-4724-8bfb-9007a9113d15 tempest-DeleteServersTestJSON-599435894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:25:38 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-cb35bb99-4b82-4724-8bfb-9007a9113d15 tempest-DeleteServersTestJSON-599435894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:25:38 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-cb35bb99-4b82-4724-8bfb-9007a9113d15 tempest-DeleteServersTestJSON-599435894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:25:38 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-cb35bb99-4b82-4724-8bfb-9007a9113d15 tempest-DeleteServersTestJSON-599435894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:25:38 devstack sudo[99696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:25:38 devstack sudo[99696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:25:39 devstack sudo[99696]: pam_unix(sudo:session): session closed for user root Aug 26 14:25:39 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-cb35bb99-4b82-4724-8bfb-9007a9113d15 tempest-DeleteServersTestJSON-599435894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.496s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:25:39 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-cb35bb99-4b82-4724-8bfb-9007a9113d15 tempest-DeleteServersTestJSON-599435894 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:25:39 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-cb35bb99-4b82-4724-8bfb-9007a9113d15 tempest-DeleteServersTestJSON-599435894 None] Deleted volume successfully. Aug 26 14:25:39 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-cb35bb99-4b82-4724-8bfb-9007a9113d15 tempest-DeleteServersTestJSON-599435894 None] Lock "cinder-5007c8c0-3e14-432a-baec-9a1d70f7b093-delete_volume" released by "delete_volume" :: held 1.927s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:25:48 devstack cinder-volume[94394]: DEBUG dbcounter [-] [94394] Writing DB stats cinder:SELECT=48,cinder:UPDATE=42,cinder:DELETE=3,cinder:INSERT=10 {{(pid=94394) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 14:25:49 devstack cinder-volume[94394]: DEBUG dbcounter [-] [94394] Writing DB stats cinder:UPDATE=40,cinder:INSERT=19,cinder:SELECT=42,cinder:DELETE=4 {{(pid=94394) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 14:26:06 devstack cinder-volume[94394]: INFO cinder.volume.manager [req-13d8dbfc-d382-41b2-b156-2c802b3bc321 req-3ef1b403-4ee3-45ed-a783-eb5537bbd7a5 tempest-ServerActionsTestOtherA-177810280 None] Terminate volume connection completed successfully. Aug 26 14:26:06 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [req-13d8dbfc-d382-41b2-b156-2c802b3bc321 req-3ef1b403-4ee3-45ed-a783-eb5537bbd7a5 tempest-ServerActionsTestOtherA-177810280 None] Deleting attachment c80b444c-2d86-4779-afdf-0920e819c8d9. {{(pid=94394) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 14:26:10 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-d09687f5-be16-4339-9499-212d429f9ddd tempest-AttachVolumeShelveTestJSON-216028008 None] Acquiring lock "cinder-55703f1c-abd4-4e8e-a872-5b1d3f6db8cb-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:26:10 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-d09687f5-be16-4339-9499-212d429f9ddd tempest-AttachVolumeShelveTestJSON-216028008 None] Lock "cinder-55703f1c-abd4-4e8e-a872-5b1d3f6db8cb-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:26:10 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-d09687f5-be16-4339-9499-212d429f9ddd tempest-AttachVolumeShelveTestJSON-216028008 None] Acquiring lock "cinder-quobyte-55703f1c-abd4-4e8e-a872-5b1d3f6db8cb" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:26:10 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-d09687f5-be16-4339-9499-212d429f9ddd tempest-AttachVolumeShelveTestJSON-216028008 None] Lock "cinder-quobyte-55703f1c-abd4-4e8e-a872-5b1d3f6db8cb" acquired by "delete_volume" :: waited 0.025s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:26:10 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ffc79a2-efca-46dc-8017-09a8b04f111d]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:26:10 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-d09687f5-be16-4339-9499-212d429f9ddd tempest-AttachVolumeShelveTestJSON-216028008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-55703f1c-abd4-4e8e-a872-5b1d3f6db8cb {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:26:10 devstack sudo[100217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-55703f1c-abd4-4e8e-a872-5b1d3f6db8cb Aug 26 14:26:10 devstack sudo[100217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:26:10 devstack sudo[100217]: pam_unix(sudo:session): session closed for user root Aug 26 14:26:10 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-d09687f5-be16-4339-9499-212d429f9ddd tempest-AttachVolumeShelveTestJSON-216028008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-55703f1c-abd4-4e8e-a872-5b1d3f6db8cb" returned: 0 in 0.480s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:26:10 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-d09687f5-be16-4339-9499-212d429f9ddd tempest-AttachVolumeShelveTestJSON-216028008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-55703f1c-abd4-4e8e-a872-5b1d3f6db8cb {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:26:10 devstack sudo[100230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-55703f1c-abd4-4e8e-a872-5b1d3f6db8cb Aug 26 14:26:10 devstack sudo[100230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:26:10 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [req-13d8dbfc-d382-41b2-b156-2c802b3bc321 req-8aa4b01c-39d4-4cf9-8043-92ef4c8b3eba tempest-ServerActionsTestOtherA-177810280 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:26:10 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [req-13d8dbfc-d382-41b2-b156-2c802b3bc321 req-8aa4b01c-39d4-4cf9-8043-92ef4c8b3eba tempest-ServerActionsTestOtherA-177810280 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:26:10 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [req-13d8dbfc-d382-41b2-b156-2c802b3bc321 req-8aa4b01c-39d4-4cf9-8043-92ef4c8b3eba tempest-ServerActionsTestOtherA-177810280 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:26:10 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [req-13d8dbfc-d382-41b2-b156-2c802b3bc321 req-8aa4b01c-39d4-4cf9-8043-92ef4c8b3eba tempest-ServerActionsTestOtherA-177810280 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b', 'name': 'volume-37f600b8-4b85-4859-8eb4-cd7968e97218', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9bee6ce1-bec4-45f3-a6fb-d7c395b6416e', 'enforce_multipath': True} {{(pid=94394) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 14:26:10 devstack cinder-volume[94394]: INFO cinder.volume.manager [req-13d8dbfc-d382-41b2-b156-2c802b3bc321 req-8aa4b01c-39d4-4cf9-8043-92ef4c8b3eba tempest-ServerActionsTestOtherA-177810280 None] attachment_update completed successfully. Aug 26 14:26:10 devstack sudo[100230]: pam_unix(sudo:session): session closed for user root Aug 26 14:26:10 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-d09687f5-be16-4339-9499-212d429f9ddd tempest-AttachVolumeShelveTestJSON-216028008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-55703f1c-abd4-4e8e-a872-5b1d3f6db8cb" returned: 0 in 0.344s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:26:11 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-d09687f5-be16-4339-9499-212d429f9ddd tempest-AttachVolumeShelveTestJSON-216028008 None] Lock "cinder-quobyte-55703f1c-abd4-4e8e-a872-5b1d3f6db8cb" released by "delete_volume" :: held 0.890s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:26:11 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-d09687f5-be16-4339-9499-212d429f9ddd tempest-AttachVolumeShelveTestJSON-216028008 None] Created reservations ['c50da024-7005-4467-98a8-a83ede34d3c8', 'd9c1b013-cb98-4492-bc56-bcb096296114', 'be9ff65f-a4c8-41f2-bd01-ffaebf9c9544', 'ebcaa6b2-444a-4184-934b-8c3bda9bab45'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:26:11 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-d09687f5-be16-4339-9499-212d429f9ddd tempest-AttachVolumeShelveTestJSON-216028008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:26:11 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-d09687f5-be16-4339-9499-212d429f9ddd tempest-AttachVolumeShelveTestJSON-216028008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:26:11 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-d09687f5-be16-4339-9499-212d429f9ddd tempest-AttachVolumeShelveTestJSON-216028008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:26:11 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-d09687f5-be16-4339-9499-212d429f9ddd tempest-AttachVolumeShelveTestJSON-216028008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:26:11 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-d09687f5-be16-4339-9499-212d429f9ddd tempest-AttachVolumeShelveTestJSON-216028008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:26:11 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-d09687f5-be16-4339-9499-212d429f9ddd tempest-AttachVolumeShelveTestJSON-216028008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:26:11 devstack sudo[100238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:26:11 devstack sudo[100238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:26:11 devstack sudo[100238]: pam_unix(sudo:session): session closed for user root Aug 26 14:26:11 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-d09687f5-be16-4339-9499-212d429f9ddd tempest-AttachVolumeShelveTestJSON-216028008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.432s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:26:11 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-d09687f5-be16-4339-9499-212d429f9ddd tempest-AttachVolumeShelveTestJSON-216028008 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:26:11 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-d09687f5-be16-4339-9499-212d429f9ddd tempest-AttachVolumeShelveTestJSON-216028008 None] Deleted volume successfully. Aug 26 14:26:11 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-d09687f5-be16-4339-9499-212d429f9ddd tempest-AttachVolumeShelveTestJSON-216028008 None] Lock "cinder-55703f1c-abd4-4e8e-a872-5b1d3f6db8cb-delete_volume" released by "delete_volume" :: held 1.729s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:26:21 devstack cinder-volume[94394]: DEBUG dbcounter [-] [94394] Writing DB stats cinder:SELECT=13,cinder:UPDATE=11,cinder:INSERT=2 {{(pid=94394) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 14:26:21 devstack cinder-volume[94394]: DEBUG dbcounter [-] [94394] Writing DB stats cinder:SELECT=12,cinder:UPDATE=8,cinder:INSERT=2,cinder:DELETE=1 {{(pid=94394) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 14:26:29 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-9716d604-35eb-4a9b-b37e-2891983b403a tempest-GroupSnapshotsTest-1811106974 None] Group tempest-GroupSnapshotsTest-Group-1812604092: creating Aug 26 14:26:29 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-9716d604-35eb-4a9b-b37e-2891983b403a tempest-GroupSnapshotsTest-1811106974 None] Group tempest-GroupSnapshotsTest-Group-1812604092: created successfully Aug 26 14:26:29 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-9716d604-35eb-4a9b-b37e-2891983b403a tempest-GroupSnapshotsTest-1811106974 None] Create group completed successfully. Aug 26 14:26:32 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-54608c9a-e225-47f3-82fb-324ef1431a36 tempest-GroupSnapshotsTest-1811106974 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:26:32 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-54608c9a-e225-47f3-82fb-324ef1431a36 tempest-GroupSnapshotsTest-1811106974 None] Flow 'volume_create_manager' (9eadcce8-cf40-4791-b3bd-df2adff17444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:26:32 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-54608c9a-e225-47f3-82fb-324ef1431a36 tempest-GroupSnapshotsTest-1811106974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c856d0a-7473-4d9b-9e2d-6d21b528b55c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:26:32 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-54608c9a-e225-47f3-82fb-324ef1431a36 tempest-GroupSnapshotsTest-1811106974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c856d0a-7473-4d9b-9e2d-6d21b528b55c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:26:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-410956944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=116861da-0c00-4cc7-8c0a-b85e82bf9e35,host='devstack@QuobyteHD#QuobyteHD',id=4c5e19f2-9c03-4040-ad11-ae12ba409368,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be0ddeaba262430da8382e7591982d1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:26:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:26:32Z,use_quota=True,user_id='a27ee7ba07b24d918426092684738d79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3677e503-06a5-414c-9146-c03dce3adb06),volume_type_id=3677e503-06a5-414c-9146-c03dce3adb06)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:26:32 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-54608c9a-e225-47f3-82fb-324ef1431a36 tempest-GroupSnapshotsTest-1811106974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58e42de2-cd13-4dd8-a92e-424fafed4089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:26:32 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-54608c9a-e225-47f3-82fb-324ef1431a36 tempest-GroupSnapshotsTest-1811106974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58e42de2-cd13-4dd8-a92e-424fafed4089) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:26:32 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-54608c9a-e225-47f3-82fb-324ef1431a36 tempest-GroupSnapshotsTest-1811106974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85e73f73-12a3-4504-a87b-99296bdea45e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:26:32 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-54608c9a-e225-47f3-82fb-324ef1431a36 tempest-GroupSnapshotsTest-1811106974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85e73f73-12a3-4504-a87b-99296bdea45e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c5e19f2-9c03-4040-ad11-ae12ba409368', 'volume_name': 'volume-4c5e19f2-9c03-4040-ad11-ae12ba409368', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:26:32 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-54608c9a-e225-47f3-82fb-324ef1431a36 tempest-GroupSnapshotsTest-1811106974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12d47f8d-f191-49c3-9fe9-a64672f01ac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:26:32 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-54608c9a-e225-47f3-82fb-324ef1431a36 tempest-GroupSnapshotsTest-1811106974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12d47f8d-f191-49c3-9fe9-a64672f01ac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:26:32 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-54608c9a-e225-47f3-82fb-324ef1431a36 tempest-GroupSnapshotsTest-1811106974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbb91c8d-c444-49a5-aa30-6b52884e5327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:26:32 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-54608c9a-e225-47f3-82fb-324ef1431a36 tempest-GroupSnapshotsTest-1811106974 None] Volume 4c5e19f2-9c03-4040-ad11-ae12ba409368: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c5e19f2-9c03-4040-ad11-ae12ba409368', 'volume_size': 1} Aug 26 14:26:32 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-54608c9a-e225-47f3-82fb-324ef1431a36 tempest-GroupSnapshotsTest-1811106974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:26:32 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-54608c9a-e225-47f3-82fb-324ef1431a36 tempest-GroupSnapshotsTest-1811106974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:26:32 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-54608c9a-e225-47f3-82fb-324ef1431a36 tempest-GroupSnapshotsTest-1811106974 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=116861da-0c00-4cc7-8c0a-b85e82bf9e35,created_at=2026-08-26T12:26:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-410956944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=116861da-0c00-4cc7-8c0a-b85e82bf9e35,host='devstack@QuobyteHD#QuobyteHD',id=4c5e19f2-9c03-4040-ad11-ae12ba409368,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be0ddeaba262430da8382e7591982d1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:26:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:26:32Z,use_quota=True,user_id='a27ee7ba07b24d918426092684738d79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3677e503-06a5-414c-9146-c03dce3adb06),volume_type_id=3677e503-06a5-414c-9146-c03dce3adb06)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:26:32 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-54608c9a-e225-47f3-82fb-324ef1431a36 tempest-GroupSnapshotsTest-1811106974 None] Creating volume 4c5e19f2-9c03-4040-ad11-ae12ba409368 {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:26:32 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-54608c9a-e225-47f3-82fb-324ef1431a36 tempest-GroupSnapshotsTest-1811106974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:26:32 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-54608c9a-e225-47f3-82fb-324ef1431a36 tempest-GroupSnapshotsTest-1811106974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:26:32 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-54608c9a-e225-47f3-82fb-324ef1431a36 tempest-GroupSnapshotsTest-1811106974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:26:32 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-54608c9a-e225-47f3-82fb-324ef1431a36 tempest-GroupSnapshotsTest-1811106974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:26:32 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-54608c9a-e225-47f3-82fb-324ef1431a36 tempest-GroupSnapshotsTest-1811106974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:26:32 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-54608c9a-e225-47f3-82fb-324ef1431a36 tempest-GroupSnapshotsTest-1811106974 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:26:32 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-54608c9a-e225-47f3-82fb-324ef1431a36 tempest-GroupSnapshotsTest-1811106974 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:26:32 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-54608c9a-e225-47f3-82fb-324ef1431a36 tempest-GroupSnapshotsTest-1811106974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4c5e19f2-9c03-4040-ad11-ae12ba409368 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:26:32 devstack sudo[100949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4c5e19f2-9c03-4040-ad11-ae12ba409368 1073741824 Aug 26 14:26:32 devstack sudo[100949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:26:32 devstack sudo[100949]: pam_unix(sudo:session): session closed for user root Aug 26 14:26:32 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-54608c9a-e225-47f3-82fb-324ef1431a36 tempest-GroupSnapshotsTest-1811106974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4c5e19f2-9c03-4040-ad11-ae12ba409368 1073741824" returned: 0 in 0.646s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:26:32 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-54608c9a-e225-47f3-82fb-324ef1431a36 tempest-GroupSnapshotsTest-1811106974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4c5e19f2-9c03-4040-ad11-ae12ba409368 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:26:32 devstack sudo[100954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4c5e19f2-9c03-4040-ad11-ae12ba409368 Aug 26 14:26:32 devstack sudo[100954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:26:33 devstack sudo[100954]: pam_unix(sudo:session): session closed for user root Aug 26 14:26:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-54608c9a-e225-47f3-82fb-324ef1431a36 tempest-GroupSnapshotsTest-1811106974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4c5e19f2-9c03-4040-ad11-ae12ba409368" returned: 0 in 0.319s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:26:33 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-54608c9a-e225-47f3-82fb-324ef1431a36 tempest-GroupSnapshotsTest-1811106974 None] <== create_volume: return (1044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:26:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-54608c9a-e225-47f3-82fb-324ef1431a36 tempest-GroupSnapshotsTest-1811106974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.052s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:26:33 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-54608c9a-e225-47f3-82fb-324ef1431a36 tempest-GroupSnapshotsTest-1811106974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbb91c8d-c444-49a5-aa30-6b52884e5327) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c5e19f2-9c03-4040-ad11-ae12ba409368', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:26:33 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-54608c9a-e225-47f3-82fb-324ef1431a36 tempest-GroupSnapshotsTest-1811106974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e791e32d-974c-4303-9135-b37ac1cff768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:26:33 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-54608c9a-e225-47f3-82fb-324ef1431a36 tempest-GroupSnapshotsTest-1811106974 None] Volume volume-4c5e19f2-9c03-4040-ad11-ae12ba409368 (4c5e19f2-9c03-4040-ad11-ae12ba409368): created successfully Aug 26 14:26:33 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-54608c9a-e225-47f3-82fb-324ef1431a36 tempest-GroupSnapshotsTest-1811106974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e791e32d-974c-4303-9135-b37ac1cff768) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:26:33 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-54608c9a-e225-47f3-82fb-324ef1431a36 tempest-GroupSnapshotsTest-1811106974 None] Flow 'volume_create_manager' (9eadcce8-cf40-4791-b3bd-df2adff17444) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:26:33 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-54608c9a-e225-47f3-82fb-324ef1431a36 tempest-GroupSnapshotsTest-1811106974 None] Created volume successfully. Aug 26 14:26:33 devstack cinder-volume[94394]: DEBUG oslo_service.periodic_task [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94394) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 14:26:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:26:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:26:33 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:26:33 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:26:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:26:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:26:33 devstack sudo[100970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:26:33 devstack sudo[100970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:26:34 devstack sudo[100970]: pam_unix(sudo:session): session closed for user root Aug 26 14:26:34 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.457s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:26:34 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:26:35 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-4e241c2c-1234-450a-86b1-b5ef666f8e49 tempest-GroupSnapshotsTest-1811106974 None] GroupSnapshot d6b1e5e1-ad33-4b70-bddc-39e61152e137: creating. Aug 26 14:26:35 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-4e241c2c-1234-450a-86b1-b5ef666f8e49 tempest-GroupSnapshotsTest-1811106974 None] Group snapshot d6b1e5e1-ad33-4b70-bddc-39e61152e137: creating. {{(pid=94394) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 26 14:26:35 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-4e241c2c-1234-450a-86b1-b5ef666f8e49 tempest-GroupSnapshotsTest-1811106974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:26:35 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-4e241c2c-1234-450a-86b1-b5ef666f8e49 tempest-GroupSnapshotsTest-1811106974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:26:35 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-4e241c2c-1234-450a-86b1-b5ef666f8e49 tempest-GroupSnapshotsTest-1811106974 None] Creating offline snapshot 2cb8e1f5-baa5-4007-9b15-555b1fed06a4 of volume 4c5e19f2-9c03-4040-ad11-ae12ba409368 {{(pid=94394) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 14:26:35 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b174822-8733-45b0-9384-7e56c4147e37]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:26:35 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4e241c2c-1234-450a-86b1-b5ef666f8e49 tempest-GroupSnapshotsTest-1811106974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4c5e19f2-9c03-4040-ad11-ae12ba409368 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:26:35 devstack sudo[100994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4c5e19f2-9c03-4040-ad11-ae12ba409368 Aug 26 14:26:35 devstack sudo[100994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:26:35 devstack sudo[100994]: pam_unix(sudo:session): session closed for user root Aug 26 14:26:35 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4e241c2c-1234-450a-86b1-b5ef666f8e49 tempest-GroupSnapshotsTest-1811106974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4c5e19f2-9c03-4040-ad11-ae12ba409368" returned: 0 in 0.387s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:26:35 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4e241c2c-1234-450a-86b1-b5ef666f8e49 tempest-GroupSnapshotsTest-1811106974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4c5e19f2-9c03-4040-ad11-ae12ba409368,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4c5e19f2-9c03-4040-ad11-ae12ba409368.2cb8e1f5-baa5-4007-9b15-555b1fed06a4 1G {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:26:35 devstack sudo[100999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4c5e19f2-9c03-4040-ad11-ae12ba409368,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4c5e19f2-9c03-4040-ad11-ae12ba409368.2cb8e1f5-baa5-4007-9b15-555b1fed06a4 1G Aug 26 14:26:35 devstack sudo[100999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:26:35 devstack sudo[100999]: pam_unix(sudo:session): session closed for user root Aug 26 14:26:35 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4e241c2c-1234-450a-86b1-b5ef666f8e49 tempest-GroupSnapshotsTest-1811106974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4c5e19f2-9c03-4040-ad11-ae12ba409368,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4c5e19f2-9c03-4040-ad11-ae12ba409368.2cb8e1f5-baa5-4007-9b15-555b1fed06a4 1G" returned: 0 in 0.381s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:26:35 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4e241c2c-1234-450a-86b1-b5ef666f8e49 tempest-GroupSnapshotsTest-1811106974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c5e19f2-9c03-4040-ad11-ae12ba409368 -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4c5e19f2-9c03-4040-ad11-ae12ba409368.2cb8e1f5-baa5-4007-9b15-555b1fed06a4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:26:35 devstack sudo[101004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c5e19f2-9c03-4040-ad11-ae12ba409368 -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4c5e19f2-9c03-4040-ad11-ae12ba409368.2cb8e1f5-baa5-4007-9b15-555b1fed06a4 Aug 26 14:26:35 devstack sudo[101004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:26:36 devstack sudo[101004]: pam_unix(sudo:session): session closed for user root Aug 26 14:26:36 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4e241c2c-1234-450a-86b1-b5ef666f8e49 tempest-GroupSnapshotsTest-1811106974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c5e19f2-9c03-4040-ad11-ae12ba409368 -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4c5e19f2-9c03-4040-ad11-ae12ba409368.2cb8e1f5-baa5-4007-9b15-555b1fed06a4" returned: 0 in 0.295s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:26:36 devstack cinder-volume[94394]: WARNING cinder.volume.drivers.remotefs [None req-4e241c2c-1234-450a-86b1-b5ef666f8e49 tempest-GroupSnapshotsTest-1811106974 None] /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4c5e19f2-9c03-4040-ad11-ae12ba409368.2cb8e1f5-baa5-4007-9b15-555b1fed06a4 is being set with open permissions: ugo+rw: NotImplementedError Aug 26 14:26:36 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4e241c2c-1234-450a-86b1-b5ef666f8e49 tempest-GroupSnapshotsTest-1811106974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4c5e19f2-9c03-4040-ad11-ae12ba409368.2cb8e1f5-baa5-4007-9b15-555b1fed06a4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:26:36 devstack sudo[101010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4c5e19f2-9c03-4040-ad11-ae12ba409368.2cb8e1f5-baa5-4007-9b15-555b1fed06a4 Aug 26 14:26:36 devstack sudo[101010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:26:36 devstack sudo[101010]: pam_unix(sudo:session): session closed for user root Aug 26 14:26:36 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4e241c2c-1234-450a-86b1-b5ef666f8e49 tempest-GroupSnapshotsTest-1811106974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4c5e19f2-9c03-4040-ad11-ae12ba409368.2cb8e1f5-baa5-4007-9b15-555b1fed06a4" returned: 0 in 0.255s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:26:36 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4e241c2c-1234-450a-86b1-b5ef666f8e49 tempest-GroupSnapshotsTest-1811106974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4c5e19f2-9c03-4040-ad11-ae12ba409368.info {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:26:36 devstack sudo[101013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4c5e19f2-9c03-4040-ad11-ae12ba409368.info Aug 26 14:26:36 devstack sudo[101013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:26:36 devstack sudo[101013]: pam_unix(sudo:session): session closed for user root Aug 26 14:26:36 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4e241c2c-1234-450a-86b1-b5ef666f8e49 tempest-GroupSnapshotsTest-1811106974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4c5e19f2-9c03-4040-ad11-ae12ba409368.info" returned: 0 in 0.266s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:26:36 devstack cinder-volume[94394]: WARNING cinder.volume.drivers.remotefs [None req-4e241c2c-1234-450a-86b1-b5ef666f8e49 tempest-GroupSnapshotsTest-1811106974 None] /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4c5e19f2-9c03-4040-ad11-ae12ba409368.info is being set with open permissions: ugo+rw: NotImplementedError Aug 26 14:26:36 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4e241c2c-1234-450a-86b1-b5ef666f8e49 tempest-GroupSnapshotsTest-1811106974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4c5e19f2-9c03-4040-ad11-ae12ba409368.info {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:26:36 devstack sudo[101016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4c5e19f2-9c03-4040-ad11-ae12ba409368.info Aug 26 14:26:36 devstack sudo[101016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:26:37 devstack sudo[101016]: pam_unix(sudo:session): session closed for user root Aug 26 14:26:37 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4e241c2c-1234-450a-86b1-b5ef666f8e49 tempest-GroupSnapshotsTest-1811106974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4c5e19f2-9c03-4040-ad11-ae12ba409368.info" returned: 0 in 0.254s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:26:37 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-4e241c2c-1234-450a-86b1-b5ef666f8e49 tempest-GroupSnapshotsTest-1811106974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.921s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:26:37 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-4e241c2c-1234-450a-86b1-b5ef666f8e49 tempest-GroupSnapshotsTest-1811106974 None] group_snapshot d6b1e5e1-ad33-4b70-bddc-39e61152e137: created successfully Aug 26 14:26:38 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-2824b551-6a4b-4f97-a172-b52702c12771 tempest-GroupSnapshotsTest-1811106974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:26:38 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-2824b551-6a4b-4f97-a172-b52702c12771 tempest-GroupSnapshotsTest-1811106974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:26:38 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-2824b551-6a4b-4f97-a172-b52702c12771 tempest-GroupSnapshotsTest-1811106974 None] Acquiring lock "cinder-quobyte-2cb8e1f5-baa5-4007-9b15-555b1fed06a4-b1adfc5a-1e4e-4076-a422-7681f4dc9a47" by "_create_volume_from_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:26:38 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-2824b551-6a4b-4f97-a172-b52702c12771 tempest-GroupSnapshotsTest-1811106974 None] Lock "cinder-quobyte-2cb8e1f5-baa5-4007-9b15-555b1fed06a4-b1adfc5a-1e4e-4076-a422-7681f4dc9a47" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:26:38 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-2824b551-6a4b-4f97-a172-b52702c12771 tempest-GroupSnapshotsTest-1811106974 None] Creating volume b1adfc5a-1e4e-4076-a422-7681f4dc9a47 from snapshot 2cb8e1f5-baa5-4007-9b15-555b1fed06a4 {{(pid=94394) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Aug 26 14:26:38 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-2824b551-6a4b-4f97-a172-b52702c12771 tempest-GroupSnapshotsTest-1811106974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:26:38 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-2824b551-6a4b-4f97-a172-b52702c12771 tempest-GroupSnapshotsTest-1811106974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:26:38 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-2824b551-6a4b-4f97-a172-b52702c12771 tempest-GroupSnapshotsTest-1811106974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:26:38 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-2824b551-6a4b-4f97-a172-b52702c12771 tempest-GroupSnapshotsTest-1811106974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:26:38 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-2824b551-6a4b-4f97-a172-b52702c12771 tempest-GroupSnapshotsTest-1811106974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:26:38 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-2824b551-6a4b-4f97-a172-b52702c12771 tempest-GroupSnapshotsTest-1811106974 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:26:38 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-2824b551-6a4b-4f97-a172-b52702c12771 tempest-GroupSnapshotsTest-1811106974 None] Acquiring lock "cinder-quobyte-b1adfc5a-1e4e-4076-a422-7681f4dc9a47" by "_copy_volume_from_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:26:38 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-2824b551-6a4b-4f97-a172-b52702c12771 tempest-GroupSnapshotsTest-1811106974 None] Lock "cinder-quobyte-b1adfc5a-1e4e-4076-a422-7681f4dc9a47" acquired by "_copy_volume_from_snapshot" :: waited 0.039s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:26:38 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-2824b551-6a4b-4f97-a172-b52702c12771 tempest-GroupSnapshotsTest-1811106974 None] snapshot: 2cb8e1f5-baa5-4007-9b15-555b1fed06a4, volume: b1adfc5a-1e4e-4076-a422-7681f4dc9a47, {{(pid=94394) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 26 14:26:38 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-2824b551-6a4b-4f97-a172-b52702c12771 tempest-GroupSnapshotsTest-1811106974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:26:38 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-2824b551-6a4b-4f97-a172-b52702c12771 tempest-GroupSnapshotsTest-1811106974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:26:38 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-2824b551-6a4b-4f97-a172-b52702c12771 tempest-GroupSnapshotsTest-1811106974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:26:38 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-2824b551-6a4b-4f97-a172-b52702c12771 tempest-GroupSnapshotsTest-1811106974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:26:38 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-2824b551-6a4b-4f97-a172-b52702c12771 tempest-GroupSnapshotsTest-1811106974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:26:38 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eb05ddc-88b8-4856-bed0-3a5bd2f5aea4]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:26:38 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-2824b551-6a4b-4f97-a172-b52702c12771 tempest-GroupSnapshotsTest-1811106974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4c5e19f2-9c03-4040-ad11-ae12ba409368.2cb8e1f5-baa5-4007-9b15-555b1fed06a4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:26:38 devstack sudo[101019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4c5e19f2-9c03-4040-ad11-ae12ba409368.2cb8e1f5-baa5-4007-9b15-555b1fed06a4 Aug 26 14:26:38 devstack sudo[101019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:26:38 devstack sudo[101019]: pam_unix(sudo:session): session closed for user root Aug 26 14:26:38 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-2824b551-6a4b-4f97-a172-b52702c12771 tempest-GroupSnapshotsTest-1811106974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4c5e19f2-9c03-4040-ad11-ae12ba409368.2cb8e1f5-baa5-4007-9b15-555b1fed06a4" returned: 0 in 0.430s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:26:38 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-2824b551-6a4b-4f97-a172-b52702c12771 tempest-GroupSnapshotsTest-1811106974 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4c5e19f2-9c03-4040-ad11-ae12ba409368(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94394) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 14:26:38 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[67b06328-35e7-491b-80a6-226400d843d2]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:26:38 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-2824b551-6a4b-4f97-a172-b52702c12771 tempest-GroupSnapshotsTest-1811106974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4c5e19f2-9c03-4040-ad11-ae12ba409368 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:26:38 devstack sudo[101024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4c5e19f2-9c03-4040-ad11-ae12ba409368 Aug 26 14:26:38 devstack sudo[101024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:26:39 devstack sudo[101024]: pam_unix(sudo:session): session closed for user root Aug 26 14:26:39 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-2824b551-6a4b-4f97-a172-b52702c12771 tempest-GroupSnapshotsTest-1811106974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4c5e19f2-9c03-4040-ad11-ae12ba409368" returned: 0 in 0.381s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:26:39 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-2824b551-6a4b-4f97-a172-b52702c12771 tempest-GroupSnapshotsTest-1811106974 None] will copy from snapshot at /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4c5e19f2-9c03-4040-ad11-ae12ba409368 {{(pid=94394) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 26 14:26:39 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-2824b551-6a4b-4f97-a172-b52702c12771 tempest-GroupSnapshotsTest-1811106974 None] Creating direct copy from snapshot {{(pid=94394) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 26 14:26:39 devstack cinder-volume[94394]: DEBUG cinder.utils [None req-2824b551-6a4b-4f97-a172-b52702c12771 tempest-GroupSnapshotsTest-1811106974 None] Path /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b1adfc5a-1e4e-4076-a422-7681f4dc9a47 not found in is_blk_device check {{(pid=94394) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 26 14:26:39 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-2824b551-6a4b-4f97-a172-b52702c12771 tempest-GroupSnapshotsTest-1811106974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4c5e19f2-9c03-4040-ad11-ae12ba409368 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b1adfc5a-1e4e-4076-a422-7681f4dc9a47 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:26:39 devstack sudo[101029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4c5e19f2-9c03-4040-ad11-ae12ba409368 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b1adfc5a-1e4e-4076-a422-7681f4dc9a47 Aug 26 14:26:39 devstack sudo[101029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:26:45 devstack sudo[101029]: pam_unix(sudo:session): session closed for user root Aug 26 14:26:45 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-2824b551-6a4b-4f97-a172-b52702c12771 tempest-GroupSnapshotsTest-1811106974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4c5e19f2-9c03-4040-ad11-ae12ba409368 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b1adfc5a-1e4e-4076-a422-7681f4dc9a47" returned: 0 in 6.503s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:26:45 devstack cinder-volume[94394]: DEBUG cinder.image.image_utils [None req-2824b551-6a4b-4f97-a172-b52702c12771 tempest-GroupSnapshotsTest-1811106974 None] Image conversion details: src /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4c5e19f2-9c03-4040-ad11-ae12ba409368, size 1024.00 MB, duration 6.50 sec, destination /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b1adfc5a-1e4e-4076-a422-7681f4dc9a47 {{(pid=94394) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 14:26:45 devstack cinder-volume[94394]: INFO cinder.image.image_utils [None req-2824b551-6a4b-4f97-a172-b52702c12771 tempest-GroupSnapshotsTest-1811106974 None] Converted 1024.00 MB image at 157.43 MB/s Aug 26 14:26:45 devstack cinder-volume[94394]: WARNING cinder.volume.drivers.remotefs [None req-2824b551-6a4b-4f97-a172-b52702c12771 tempest-GroupSnapshotsTest-1811106974 None] /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b1adfc5a-1e4e-4076-a422-7681f4dc9a47 is being set with open permissions: ugo+rw: NotImplementedError Aug 26 14:26:45 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-2824b551-6a4b-4f97-a172-b52702c12771 tempest-GroupSnapshotsTest-1811106974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b1adfc5a-1e4e-4076-a422-7681f4dc9a47 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:26:45 devstack sudo[101148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b1adfc5a-1e4e-4076-a422-7681f4dc9a47 Aug 26 14:26:45 devstack sudo[101148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:26:45 devstack sudo[101148]: pam_unix(sudo:session): session closed for user root Aug 26 14:26:45 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-2824b551-6a4b-4f97-a172-b52702c12771 tempest-GroupSnapshotsTest-1811106974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b1adfc5a-1e4e-4076-a422-7681f4dc9a47" returned: 0 in 0.274s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:26:45 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-2824b551-6a4b-4f97-a172-b52702c12771 tempest-GroupSnapshotsTest-1811106974 None] Lock "cinder-quobyte-b1adfc5a-1e4e-4076-a422-7681f4dc9a47" released by "_copy_volume_from_snapshot" :: held 7.684s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:26:45 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-2824b551-6a4b-4f97-a172-b52702c12771 tempest-GroupSnapshotsTest-1811106974 None] Lock "cinder-quobyte-2cb8e1f5-baa5-4007-9b15-555b1fed06a4-b1adfc5a-1e4e-4076-a422-7681f4dc9a47" released by "_create_volume_from_snapshot" :: held 7.793s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:26:45 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-2824b551-6a4b-4f97-a172-b52702c12771 tempest-GroupSnapshotsTest-1811106974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.821s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:26:45 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-2824b551-6a4b-4f97-a172-b52702c12771 tempest-GroupSnapshotsTest-1811106974 None] Create group from source-snapshot-d6b1e5e1-ad33-4b70-bddc-39e61152e137 completed successfully. Aug 26 14:26:47 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-2ec15597-f7b0-42fb-bf89-ab1c54a1ee62 tempest-GroupSnapshotsTest-1811106974 None] Acquiring lock "cinder-quobyte-b1adfc5a-1e4e-4076-a422-7681f4dc9a47" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:26:47 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-2ec15597-f7b0-42fb-bf89-ab1c54a1ee62 tempest-GroupSnapshotsTest-1811106974 None] Lock "cinder-quobyte-b1adfc5a-1e4e-4076-a422-7681f4dc9a47" acquired by "delete_volume" :: waited 0.016s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:26:47 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce16f9ed-5a0b-4a67-9266-8b115137fccb]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:26:47 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-2ec15597-f7b0-42fb-bf89-ab1c54a1ee62 tempest-GroupSnapshotsTest-1811106974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b1adfc5a-1e4e-4076-a422-7681f4dc9a47 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:26:47 devstack sudo[101182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b1adfc5a-1e4e-4076-a422-7681f4dc9a47 Aug 26 14:26:47 devstack sudo[101182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:26:47 devstack cinder-volume[94394]: INFO cinder.volume.manager [req-5c742f46-19cc-4e63-a709-bfc28ca9646a req-564e0b70-c181-4485-9b01-d162f761b951 tempest-ServerActionsTestOtherA-177810280 None] Terminate volume connection completed successfully. Aug 26 14:26:47 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [req-5c742f46-19cc-4e63-a709-bfc28ca9646a req-564e0b70-c181-4485-9b01-d162f761b951 tempest-ServerActionsTestOtherA-177810280 None] Deleting attachment 9bee6ce1-bec4-45f3-a6fb-d7c395b6416e. {{(pid=94394) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 14:26:47 devstack sudo[101182]: pam_unix(sudo:session): session closed for user root Aug 26 14:26:47 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-2ec15597-f7b0-42fb-bf89-ab1c54a1ee62 tempest-GroupSnapshotsTest-1811106974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b1adfc5a-1e4e-4076-a422-7681f4dc9a47" returned: 0 in 0.426s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:26:47 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-2ec15597-f7b0-42fb-bf89-ab1c54a1ee62 tempest-GroupSnapshotsTest-1811106974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b1adfc5a-1e4e-4076-a422-7681f4dc9a47 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:26:47 devstack sudo[101188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b1adfc5a-1e4e-4076-a422-7681f4dc9a47 Aug 26 14:26:47 devstack sudo[101188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:26:47 devstack cinder-volume[94394]: DEBUG cinder.coordination [req-5c742f46-19cc-4e63-a709-bfc28ca9646a req-f053e475-5137-452e-8a9c-41bb61796e55 tempest-ServerActionsTestOtherA-177810280 None] Acquiring lock "cinder-37f600b8-4b85-4859-8eb4-cd7968e97218-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:26:47 devstack cinder-volume[94394]: DEBUG cinder.coordination [req-5c742f46-19cc-4e63-a709-bfc28ca9646a req-f053e475-5137-452e-8a9c-41bb61796e55 tempest-ServerActionsTestOtherA-177810280 None] Lock "cinder-37f600b8-4b85-4859-8eb4-cd7968e97218-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:26:48 devstack cinder-volume[94394]: DEBUG cinder.coordination [req-5c742f46-19cc-4e63-a709-bfc28ca9646a req-f053e475-5137-452e-8a9c-41bb61796e55 tempest-ServerActionsTestOtherA-177810280 None] Acquiring lock "cinder-quobyte-37f600b8-4b85-4859-8eb4-cd7968e97218" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:26:48 devstack cinder-volume[94394]: DEBUG cinder.coordination [req-5c742f46-19cc-4e63-a709-bfc28ca9646a req-f053e475-5137-452e-8a9c-41bb61796e55 tempest-ServerActionsTestOtherA-177810280 None] Lock "cinder-quobyte-37f600b8-4b85-4859-8eb4-cd7968e97218" acquired by "delete_volume" :: waited 0.025s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:26:48 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[324972c8-23a8-4d9f-ad51-1bb9550351e7]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:26:48 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [req-5c742f46-19cc-4e63-a709-bfc28ca9646a req-f053e475-5137-452e-8a9c-41bb61796e55 tempest-ServerActionsTestOtherA-177810280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-37f600b8-4b85-4859-8eb4-cd7968e97218 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:26:48 devstack sudo[101188]: pam_unix(sudo:session): session closed for user root Aug 26 14:26:48 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-2ec15597-f7b0-42fb-bf89-ab1c54a1ee62 tempest-GroupSnapshotsTest-1811106974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b1adfc5a-1e4e-4076-a422-7681f4dc9a47" returned: 0 in 0.301s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:26:48 devstack sudo[101190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-37f600b8-4b85-4859-8eb4-cd7968e97218 Aug 26 14:26:48 devstack sudo[101190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:26:48 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-2ec15597-f7b0-42fb-bf89-ab1c54a1ee62 tempest-GroupSnapshotsTest-1811106974 None] Lock "cinder-quobyte-b1adfc5a-1e4e-4076-a422-7681f4dc9a47" released by "delete_volume" :: held 0.779s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:26:48 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-2ec15597-f7b0-42fb-bf89-ab1c54a1ee62 tempest-GroupSnapshotsTest-1811106974 None] Created reservations ['c179fccc-a057-4362-9c87-6271647c24c1'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:26:48 devstack cinder-volume[94394]: WARNING cinder.quota [None req-2ec15597-f7b0-42fb-bf89-ab1c54a1ee62 tempest-GroupSnapshotsTest-1811106974 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-164961382 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-164961382, it is now deprecated. Please use the default quota class for default quota. Aug 26 14:26:48 devstack cinder-volume[94394]: WARNING cinder.quota [None req-2ec15597-f7b0-42fb-bf89-ab1c54a1ee62 tempest-GroupSnapshotsTest-1811106974 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-164961382 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-164961382, it is now deprecated. Please use the default quota class for default quota. Aug 26 14:26:48 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-2ec15597-f7b0-42fb-bf89-ab1c54a1ee62 tempest-GroupSnapshotsTest-1811106974 None] Created reservations ['ed2cdf52-207b-453a-8cad-f1bcef3f17d3', 'a5c3b169-141a-40fb-8e0f-c8d50bc80203', '57541ada-1376-40e6-897b-151c96d6a87f', '28631adf-3b10-4f58-a2a1-c04cc27325d1'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:26:48 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-2ec15597-f7b0-42fb-bf89-ab1c54a1ee62 tempest-GroupSnapshotsTest-1811106974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:26:48 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-2ec15597-f7b0-42fb-bf89-ab1c54a1ee62 tempest-GroupSnapshotsTest-1811106974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:26:48 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-2ec15597-f7b0-42fb-bf89-ab1c54a1ee62 tempest-GroupSnapshotsTest-1811106974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:26:48 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-2ec15597-f7b0-42fb-bf89-ab1c54a1ee62 tempest-GroupSnapshotsTest-1811106974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:26:48 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-2ec15597-f7b0-42fb-bf89-ab1c54a1ee62 tempest-GroupSnapshotsTest-1811106974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:26:48 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-2ec15597-f7b0-42fb-bf89-ab1c54a1ee62 tempest-GroupSnapshotsTest-1811106974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:26:48 devstack sudo[101195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:26:48 devstack sudo[101195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:26:48 devstack sudo[101190]: pam_unix(sudo:session): session closed for user root Aug 26 14:26:48 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [req-5c742f46-19cc-4e63-a709-bfc28ca9646a req-f053e475-5137-452e-8a9c-41bb61796e55 tempest-ServerActionsTestOtherA-177810280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-37f600b8-4b85-4859-8eb4-cd7968e97218" returned: 0 in 0.651s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:26:48 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [req-5c742f46-19cc-4e63-a709-bfc28ca9646a req-f053e475-5137-452e-8a9c-41bb61796e55 tempest-ServerActionsTestOtherA-177810280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-37f600b8-4b85-4859-8eb4-cd7968e97218 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:26:48 devstack sudo[101198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-37f600b8-4b85-4859-8eb4-cd7968e97218 Aug 26 14:26:48 devstack sudo[101198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:26:48 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-8da58459-dec3-41dc-9765-2db2637f3e84 tempest-GroupSnapshotsTest-1811106974 None] group_snapshot d6b1e5e1-ad33-4b70-bddc-39e61152e137: deleting Aug 26 14:26:48 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-8da58459-dec3-41dc-9765-2db2637f3e84 tempest-GroupSnapshotsTest-1811106974 None] group_snapshot d6b1e5e1-ad33-4b70-bddc-39e61152e137: deleting {{(pid=94394) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 26 14:26:49 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-8da58459-dec3-41dc-9765-2db2637f3e84 tempest-GroupSnapshotsTest-1811106974 None] Acquiring lock "cinder-quobyte-4c5e19f2-9c03-4040-ad11-ae12ba409368" by "delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:26:49 devstack sudo[101198]: pam_unix(sudo:session): session closed for user root Aug 26 14:26:49 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [req-5c742f46-19cc-4e63-a709-bfc28ca9646a req-f053e475-5137-452e-8a9c-41bb61796e55 tempest-ServerActionsTestOtherA-177810280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-37f600b8-4b85-4859-8eb4-cd7968e97218" returned: 0 in 0.314s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:26:49 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-8da58459-dec3-41dc-9765-2db2637f3e84 tempest-GroupSnapshotsTest-1811106974 None] Lock "cinder-quobyte-4c5e19f2-9c03-4040-ad11-ae12ba409368" acquired by "delete_snapshot" :: waited 0.051s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:26:49 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-8da58459-dec3-41dc-9765-2db2637f3e84 tempest-GroupSnapshotsTest-1811106974 None] Acquiring lock "cinder-quobyte-2cb8e1f5-baa5-4007-9b15-555b1fed06a4" by "_delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:26:49 devstack sudo[101195]: pam_unix(sudo:session): session closed for user root Aug 26 14:26:49 devstack cinder-volume[94394]: DEBUG cinder.coordination [req-5c742f46-19cc-4e63-a709-bfc28ca9646a req-f053e475-5137-452e-8a9c-41bb61796e55 tempest-ServerActionsTestOtherA-177810280 None] Lock "cinder-quobyte-37f600b8-4b85-4859-8eb4-cd7968e97218" released by "delete_volume" :: held 1.058s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:26:49 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-2ec15597-f7b0-42fb-bf89-ab1c54a1ee62 tempest-GroupSnapshotsTest-1811106974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.477s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:26:49 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-2ec15597-f7b0-42fb-bf89-ab1c54a1ee62 tempest-GroupSnapshotsTest-1811106974 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:26:49 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-2ec15597-f7b0-42fb-bf89-ab1c54a1ee62 tempest-GroupSnapshotsTest-1811106974 None] Delete group completed successfully. Aug 26 14:26:49 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-8da58459-dec3-41dc-9765-2db2637f3e84 tempest-GroupSnapshotsTest-1811106974 None] Lock "cinder-quobyte-2cb8e1f5-baa5-4007-9b15-555b1fed06a4" acquired by "_delete_snapshot" :: waited 0.042s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:26:49 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-8da58459-dec3-41dc-9765-2db2637f3e84 tempest-GroupSnapshotsTest-1811106974 None] Deleting offline snapshot 2cb8e1f5-baa5-4007-9b15-555b1fed06a4 of volume 4c5e19f2-9c03-4040-ad11-ae12ba409368 {{(pid=94394) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 14:26:49 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-8da58459-dec3-41dc-9765-2db2637f3e84 tempest-GroupSnapshotsTest-1811106974 None] snapshot_file for this snap is: volume-4c5e19f2-9c03-4040-ad11-ae12ba409368.2cb8e1f5-baa5-4007-9b15-555b1fed06a4 {{(pid=94394) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 14:26:49 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fd082bb-a3fa-4499-9adb-122e968270b3]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:26:49 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-8da58459-dec3-41dc-9765-2db2637f3e84 tempest-GroupSnapshotsTest-1811106974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4c5e19f2-9c03-4040-ad11-ae12ba409368.2cb8e1f5-baa5-4007-9b15-555b1fed06a4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:26:49 devstack cinder-volume[94394]: DEBUG cinder.quota [req-5c742f46-19cc-4e63-a709-bfc28ca9646a req-f053e475-5137-452e-8a9c-41bb61796e55 tempest-ServerActionsTestOtherA-177810280 None] Created reservations ['0f7b1164-d18b-4bc5-92c6-438554f3ca6a', '503e7fda-ebf6-4a7e-80b1-83dbcf12bd02', '635c2206-f44d-4851-baa5-abde25baed6c', '7ebfe6e6-fe2b-4e41-b358-9e3b2531bde2'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:26:49 devstack sudo[101202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4c5e19f2-9c03-4040-ad11-ae12ba409368.2cb8e1f5-baa5-4007-9b15-555b1fed06a4 Aug 26 14:26:49 devstack sudo[101202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:26:49 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [req-5c742f46-19cc-4e63-a709-bfc28ca9646a req-f053e475-5137-452e-8a9c-41bb61796e55 tempest-ServerActionsTestOtherA-177810280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:26:49 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [req-5c742f46-19cc-4e63-a709-bfc28ca9646a req-f053e475-5137-452e-8a9c-41bb61796e55 tempest-ServerActionsTestOtherA-177810280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:26:49 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [req-5c742f46-19cc-4e63-a709-bfc28ca9646a req-f053e475-5137-452e-8a9c-41bb61796e55 tempest-ServerActionsTestOtherA-177810280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:26:49 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [req-5c742f46-19cc-4e63-a709-bfc28ca9646a req-f053e475-5137-452e-8a9c-41bb61796e55 tempest-ServerActionsTestOtherA-177810280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:26:49 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [req-5c742f46-19cc-4e63-a709-bfc28ca9646a req-f053e475-5137-452e-8a9c-41bb61796e55 tempest-ServerActionsTestOtherA-177810280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:26:49 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [req-5c742f46-19cc-4e63-a709-bfc28ca9646a req-f053e475-5137-452e-8a9c-41bb61796e55 tempest-ServerActionsTestOtherA-177810280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:26:49 devstack sudo[101204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:26:49 devstack sudo[101204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:26:49 devstack sudo[101202]: pam_unix(sudo:session): session closed for user root Aug 26 14:26:49 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-8da58459-dec3-41dc-9765-2db2637f3e84 tempest-GroupSnapshotsTest-1811106974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4c5e19f2-9c03-4040-ad11-ae12ba409368.2cb8e1f5-baa5-4007-9b15-555b1fed06a4" returned: 0 in 0.571s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:26:49 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-8da58459-dec3-41dc-9765-2db2637f3e84 tempest-GroupSnapshotsTest-1811106974 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4c5e19f2-9c03-4040-ad11-ae12ba409368(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94394) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 14:26:49 devstack sudo[101204]: pam_unix(sudo:session): session closed for user root Aug 26 14:26:49 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [req-5c742f46-19cc-4e63-a709-bfc28ca9646a req-f053e475-5137-452e-8a9c-41bb61796e55 tempest-ServerActionsTestOtherA-177810280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.420s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:26:49 devstack cinder-volume[94394]: DEBUG cinder.manager [req-5c742f46-19cc-4e63-a709-bfc28ca9646a req-f053e475-5137-452e-8a9c-41bb61796e55 tempest-ServerActionsTestOtherA-177810280 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:26:49 devstack cinder-volume[94394]: INFO cinder.volume.manager [req-5c742f46-19cc-4e63-a709-bfc28ca9646a req-f053e475-5137-452e-8a9c-41bb61796e55 tempest-ServerActionsTestOtherA-177810280 None] Deleted volume successfully. Aug 26 14:26:49 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[04c65c1c-8a91-4ab2-b0ef-3260fdb4fc7b]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:26:49 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-8da58459-dec3-41dc-9765-2db2637f3e84 tempest-GroupSnapshotsTest-1811106974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4c5e19f2-9c03-4040-ad11-ae12ba409368 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:26:49 devstack cinder-volume[94394]: DEBUG cinder.coordination [req-5c742f46-19cc-4e63-a709-bfc28ca9646a req-f053e475-5137-452e-8a9c-41bb61796e55 tempest-ServerActionsTestOtherA-177810280 None] Lock "cinder-37f600b8-4b85-4859-8eb4-cd7968e97218-delete_volume" released by "delete_volume" :: held 1.884s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:26:49 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-831bb9f1-3407-4fb6-9c18-64de52293b2f tempest-ServerActionsTestOtherA-177810280 None] Acquiring lock "cinder-941128c9-af6f-409e-acc7-30ee4961080f-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:26:49 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-831bb9f1-3407-4fb6-9c18-64de52293b2f tempest-ServerActionsTestOtherA-177810280 None] Lock "cinder-941128c9-af6f-409e-acc7-30ee4961080f-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:26:50 devstack sudo[101211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4c5e19f2-9c03-4040-ad11-ae12ba409368 Aug 26 14:26:50 devstack sudo[101211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:26:50 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-831bb9f1-3407-4fb6-9c18-64de52293b2f tempest-ServerActionsTestOtherA-177810280 None] Acquiring lock "cinder-quobyte-941128c9-af6f-409e-acc7-30ee4961080f" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:26:50 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-831bb9f1-3407-4fb6-9c18-64de52293b2f tempest-ServerActionsTestOtherA-177810280 None] Lock "cinder-quobyte-941128c9-af6f-409e-acc7-30ee4961080f" acquired by "delete_volume" :: waited 0.027s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:26:50 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[8db20d0b-9c08-4695-b967-6558d4f5e5d2]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:26:50 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-831bb9f1-3407-4fb6-9c18-64de52293b2f tempest-ServerActionsTestOtherA-177810280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-941128c9-af6f-409e-acc7-30ee4961080f {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:26:50 devstack sudo[101213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-941128c9-af6f-409e-acc7-30ee4961080f Aug 26 14:26:50 devstack sudo[101213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:26:50 devstack sudo[101211]: pam_unix(sudo:session): session closed for user root Aug 26 14:26:50 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-8da58459-dec3-41dc-9765-2db2637f3e84 tempest-GroupSnapshotsTest-1811106974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4c5e19f2-9c03-4040-ad11-ae12ba409368" returned: 0 in 0.666s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:26:50 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-8da58459-dec3-41dc-9765-2db2637f3e84 tempest-GroupSnapshotsTest-1811106974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4c5e19f2-9c03-4040-ad11-ae12ba409368.2cb8e1f5-baa5-4007-9b15-555b1fed06a4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:26:50 devstack sudo[101213]: pam_unix(sudo:session): session closed for user root Aug 26 14:26:50 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-831bb9f1-3407-4fb6-9c18-64de52293b2f tempest-ServerActionsTestOtherA-177810280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-941128c9-af6f-409e-acc7-30ee4961080f" returned: 0 in 0.399s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:26:50 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-831bb9f1-3407-4fb6-9c18-64de52293b2f tempest-ServerActionsTestOtherA-177810280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-941128c9-af6f-409e-acc7-30ee4961080f {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:26:50 devstack sudo[101221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4c5e19f2-9c03-4040-ad11-ae12ba409368.2cb8e1f5-baa5-4007-9b15-555b1fed06a4 Aug 26 14:26:50 devstack sudo[101221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:26:50 devstack sudo[101223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-941128c9-af6f-409e-acc7-30ee4961080f Aug 26 14:26:50 devstack sudo[101223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:26:50 devstack sudo[101223]: pam_unix(sudo:session): session closed for user root Aug 26 14:26:50 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-831bb9f1-3407-4fb6-9c18-64de52293b2f tempest-ServerActionsTestOtherA-177810280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-941128c9-af6f-409e-acc7-30ee4961080f" returned: 0 in 0.269s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:26:50 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-831bb9f1-3407-4fb6-9c18-64de52293b2f tempest-ServerActionsTestOtherA-177810280 None] Lock "cinder-quobyte-941128c9-af6f-409e-acc7-30ee4961080f" released by "delete_volume" :: held 0.728s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:26:50 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-831bb9f1-3407-4fb6-9c18-64de52293b2f tempest-ServerActionsTestOtherA-177810280 None] Created reservations ['af47e01f-2faa-484c-816e-7e3adcc8e990', 'a465add8-e068-44f7-b88f-19bf2a61a208', '739bc470-053f-4e6f-9e6d-1a6485b861ae', 'e3803fcf-05ab-409b-b155-4b081ad61749'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:26:50 devstack sudo[101221]: pam_unix(sudo:session): session closed for user root Aug 26 14:26:50 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-8da58459-dec3-41dc-9765-2db2637f3e84 tempest-GroupSnapshotsTest-1811106974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4c5e19f2-9c03-4040-ad11-ae12ba409368.2cb8e1f5-baa5-4007-9b15-555b1fed06a4" returned: 0 in 0.375s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:26:50 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-8da58459-dec3-41dc-9765-2db2637f3e84 tempest-GroupSnapshotsTest-1811106974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4c5e19f2-9c03-4040-ad11-ae12ba409368.2cb8e1f5-baa5-4007-9b15-555b1fed06a4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:26:50 devstack sudo[101229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4c5e19f2-9c03-4040-ad11-ae12ba409368.2cb8e1f5-baa5-4007-9b15-555b1fed06a4 Aug 26 14:26:50 devstack sudo[101229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:26:50 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-831bb9f1-3407-4fb6-9c18-64de52293b2f tempest-ServerActionsTestOtherA-177810280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:26:50 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-831bb9f1-3407-4fb6-9c18-64de52293b2f tempest-ServerActionsTestOtherA-177810280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:26:50 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-831bb9f1-3407-4fb6-9c18-64de52293b2f tempest-ServerActionsTestOtherA-177810280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:26:50 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-831bb9f1-3407-4fb6-9c18-64de52293b2f tempest-ServerActionsTestOtherA-177810280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:26:50 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-831bb9f1-3407-4fb6-9c18-64de52293b2f tempest-ServerActionsTestOtherA-177810280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:26:50 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-831bb9f1-3407-4fb6-9c18-64de52293b2f tempest-ServerActionsTestOtherA-177810280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:26:50 devstack sudo[101231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:26:50 devstack sudo[101231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:26:51 devstack sudo[101229]: pam_unix(sudo:session): session closed for user root Aug 26 14:26:51 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-8da58459-dec3-41dc-9765-2db2637f3e84 tempest-GroupSnapshotsTest-1811106974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4c5e19f2-9c03-4040-ad11-ae12ba409368.2cb8e1f5-baa5-4007-9b15-555b1fed06a4" returned: 0 in 0.294s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:26:51 devstack sudo[101231]: pam_unix(sudo:session): session closed for user root Aug 26 14:26:51 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-8da58459-dec3-41dc-9765-2db2637f3e84 tempest-GroupSnapshotsTest-1811106974 None] Lock "cinder-quobyte-2cb8e1f5-baa5-4007-9b15-555b1fed06a4" released by "_delete_snapshot" :: held 2.088s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:26:51 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-831bb9f1-3407-4fb6-9c18-64de52293b2f tempest-ServerActionsTestOtherA-177810280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.296s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:26:51 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-831bb9f1-3407-4fb6-9c18-64de52293b2f tempest-ServerActionsTestOtherA-177810280 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:26:51 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-8da58459-dec3-41dc-9765-2db2637f3e84 tempest-GroupSnapshotsTest-1811106974 None] Lock "cinder-quobyte-4c5e19f2-9c03-4040-ad11-ae12ba409368" released by "delete_snapshot" :: held 2.151s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:26:51 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-831bb9f1-3407-4fb6-9c18-64de52293b2f tempest-ServerActionsTestOtherA-177810280 None] Deleted volume successfully. Aug 26 14:26:51 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-831bb9f1-3407-4fb6-9c18-64de52293b2f tempest-ServerActionsTestOtherA-177810280 None] Lock "cinder-941128c9-af6f-409e-acc7-30ee4961080f-delete_volume" released by "delete_volume" :: held 1.328s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:26:51 devstack cinder-volume[94394]: WARNING cinder.quota [None req-8da58459-dec3-41dc-9765-2db2637f3e84 tempest-GroupSnapshotsTest-1811106974 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-164961382 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-164961382, it is now deprecated. Please use the default quota class for default quota. Aug 26 14:26:51 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-8da58459-dec3-41dc-9765-2db2637f3e84 tempest-GroupSnapshotsTest-1811106974 None] Created reservations ['4a8404ad-eb28-4a1c-8dca-052df517dc21', '6cf389ed-8842-40b4-af16-bc6054576064', 'b9dfe459-3ad9-4522-a510-f311a27cdcb3', '8c58705f-d454-4043-840a-0cda6f65a04f'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:26:51 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-8da58459-dec3-41dc-9765-2db2637f3e84 tempest-GroupSnapshotsTest-1811106974 None] group_snapshot d6b1e5e1-ad33-4b70-bddc-39e61152e137: deleted successfully Aug 26 14:26:52 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ab68011-0758-4a97-974f-6bd1d586e015 tempest-AttachVolumeNegativeTest-342477261 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:26:52 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-4ab68011-0758-4a97-974f-6bd1d586e015 tempest-AttachVolumeNegativeTest-342477261 None] Flow 'volume_create_manager' (8a750500-eb7e-4d0a-bf7a-c6bc675104c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:26:52 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-4ab68011-0758-4a97-974f-6bd1d586e015 tempest-AttachVolumeNegativeTest-342477261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f589358b-0fb7-4f60-94fb-7f8d039ae465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:26:52 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-4ab68011-0758-4a97-974f-6bd1d586e015 tempest-AttachVolumeNegativeTest-342477261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f589358b-0fb7-4f60-94fb-7f8d039ae465) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:26:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-73484543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74f30e56-9a4b-44b3-8a83-c0c3889e4a19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2ee4807719a490e87da9514d245fd2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:26:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:26:52Z,use_quota=True,user_id='3453249502664779b9b949032cd68e96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:26:52 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-4ab68011-0758-4a97-974f-6bd1d586e015 tempest-AttachVolumeNegativeTest-342477261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1fa6aed-7e6f-4c2a-a036-063585de699d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:26:52 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-4ab68011-0758-4a97-974f-6bd1d586e015 tempest-AttachVolumeNegativeTest-342477261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1fa6aed-7e6f-4c2a-a036-063585de699d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:26:52 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-4ab68011-0758-4a97-974f-6bd1d586e015 tempest-AttachVolumeNegativeTest-342477261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f94af4d-31da-4364-a184-be62f5c205a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:26:52 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-4ab68011-0758-4a97-974f-6bd1d586e015 tempest-AttachVolumeNegativeTest-342477261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f94af4d-31da-4364-a184-be62f5c205a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74f30e56-9a4b-44b3-8a83-c0c3889e4a19', 'volume_name': 'volume-74f30e56-9a4b-44b3-8a83-c0c3889e4a19', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:26:52 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-4ab68011-0758-4a97-974f-6bd1d586e015 tempest-AttachVolumeNegativeTest-342477261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bbd9cf4-e983-4cea-8cd6-de32b82fc650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:26:52 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-4ab68011-0758-4a97-974f-6bd1d586e015 tempest-AttachVolumeNegativeTest-342477261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bbd9cf4-e983-4cea-8cd6-de32b82fc650) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:26:52 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-4ab68011-0758-4a97-974f-6bd1d586e015 tempest-AttachVolumeNegativeTest-342477261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c016df46-26f8-47cf-a4ae-f9981e65718c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:26:52 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-4ab68011-0758-4a97-974f-6bd1d586e015 tempest-AttachVolumeNegativeTest-342477261 None] Volume 74f30e56-9a4b-44b3-8a83-c0c3889e4a19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74f30e56-9a4b-44b3-8a83-c0c3889e4a19', 'volume_size': 1} Aug 26 14:26:52 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-4ab68011-0758-4a97-974f-6bd1d586e015 tempest-AttachVolumeNegativeTest-342477261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:26:52 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-4ab68011-0758-4a97-974f-6bd1d586e015 tempest-AttachVolumeNegativeTest-342477261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:26:52 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-4ab68011-0758-4a97-974f-6bd1d586e015 tempest-AttachVolumeNegativeTest-342477261 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:26:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-73484543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74f30e56-9a4b-44b3-8a83-c0c3889e4a19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2ee4807719a490e87da9514d245fd2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:26:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:26:52Z,use_quota=True,user_id='3453249502664779b9b949032cd68e96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:26:52 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-4ab68011-0758-4a97-974f-6bd1d586e015 tempest-AttachVolumeNegativeTest-342477261 None] Creating volume 74f30e56-9a4b-44b3-8a83-c0c3889e4a19 {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:26:52 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-4ab68011-0758-4a97-974f-6bd1d586e015 tempest-AttachVolumeNegativeTest-342477261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:26:52 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-4ab68011-0758-4a97-974f-6bd1d586e015 tempest-AttachVolumeNegativeTest-342477261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:26:52 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-4ab68011-0758-4a97-974f-6bd1d586e015 tempest-AttachVolumeNegativeTest-342477261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:26:52 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-4ab68011-0758-4a97-974f-6bd1d586e015 tempest-AttachVolumeNegativeTest-342477261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:26:52 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-4ab68011-0758-4a97-974f-6bd1d586e015 tempest-AttachVolumeNegativeTest-342477261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:26:52 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-4ab68011-0758-4a97-974f-6bd1d586e015 tempest-AttachVolumeNegativeTest-342477261 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:26:52 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-4ab68011-0758-4a97-974f-6bd1d586e015 tempest-AttachVolumeNegativeTest-342477261 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:26:52 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4ab68011-0758-4a97-974f-6bd1d586e015 tempest-AttachVolumeNegativeTest-342477261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-74f30e56-9a4b-44b3-8a83-c0c3889e4a19 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:26:52 devstack sudo[101263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-74f30e56-9a4b-44b3-8a83-c0c3889e4a19 1073741824 Aug 26 14:26:52 devstack sudo[101263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:26:52 devstack sudo[101263]: pam_unix(sudo:session): session closed for user root Aug 26 14:26:53 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4ab68011-0758-4a97-974f-6bd1d586e015 tempest-AttachVolumeNegativeTest-342477261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-74f30e56-9a4b-44b3-8a83-c0c3889e4a19 1073741824" returned: 0 in 0.693s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:26:53 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-29498720-0309-4a24-be78-9a7381726e25 tempest-GroupSnapshotsTest-1811106974 None] Acquiring lock "cinder-quobyte-4c5e19f2-9c03-4040-ad11-ae12ba409368" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:26:53 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4ab68011-0758-4a97-974f-6bd1d586e015 tempest-AttachVolumeNegativeTest-342477261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-74f30e56-9a4b-44b3-8a83-c0c3889e4a19 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:26:53 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-29498720-0309-4a24-be78-9a7381726e25 tempest-GroupSnapshotsTest-1811106974 None] Lock "cinder-quobyte-4c5e19f2-9c03-4040-ad11-ae12ba409368" acquired by "delete_volume" :: waited 0.034s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:26:53 devstack sudo[101277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-74f30e56-9a4b-44b3-8a83-c0c3889e4a19 Aug 26 14:26:53 devstack sudo[101277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:26:53 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[969ebfcf-69fd-4d7a-9a48-ccd7c08173f7]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:26:53 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-29498720-0309-4a24-be78-9a7381726e25 tempest-GroupSnapshotsTest-1811106974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4c5e19f2-9c03-4040-ad11-ae12ba409368 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:26:53 devstack sudo[101279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4c5e19f2-9c03-4040-ad11-ae12ba409368 Aug 26 14:26:53 devstack sudo[101279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:26:53 devstack sudo[101277]: pam_unix(sudo:session): session closed for user root Aug 26 14:26:53 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4ab68011-0758-4a97-974f-6bd1d586e015 tempest-AttachVolumeNegativeTest-342477261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-74f30e56-9a4b-44b3-8a83-c0c3889e4a19" returned: 0 in 0.418s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:26:53 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-4ab68011-0758-4a97-974f-6bd1d586e015 tempest-AttachVolumeNegativeTest-342477261 None] <== create_volume: return (1233ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:26:53 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-4ab68011-0758-4a97-974f-6bd1d586e015 tempest-AttachVolumeNegativeTest-342477261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.236s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:26:53 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-4ab68011-0758-4a97-974f-6bd1d586e015 tempest-AttachVolumeNegativeTest-342477261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c016df46-26f8-47cf-a4ae-f9981e65718c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74f30e56-9a4b-44b3-8a83-c0c3889e4a19', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:26:53 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-4ab68011-0758-4a97-974f-6bd1d586e015 tempest-AttachVolumeNegativeTest-342477261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33a24a90-5d9a-4413-920a-b62dd659999d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:26:53 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-4ab68011-0758-4a97-974f-6bd1d586e015 tempest-AttachVolumeNegativeTest-342477261 None] Volume volume-74f30e56-9a4b-44b3-8a83-c0c3889e4a19 (74f30e56-9a4b-44b3-8a83-c0c3889e4a19): created successfully Aug 26 14:26:53 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-4ab68011-0758-4a97-974f-6bd1d586e015 tempest-AttachVolumeNegativeTest-342477261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33a24a90-5d9a-4413-920a-b62dd659999d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:26:53 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-4ab68011-0758-4a97-974f-6bd1d586e015 tempest-AttachVolumeNegativeTest-342477261 None] Flow 'volume_create_manager' (8a750500-eb7e-4d0a-bf7a-c6bc675104c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:26:53 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-4ab68011-0758-4a97-974f-6bd1d586e015 tempest-AttachVolumeNegativeTest-342477261 None] Created volume successfully. Aug 26 14:26:53 devstack sudo[101279]: pam_unix(sudo:session): session closed for user root Aug 26 14:26:53 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-29498720-0309-4a24-be78-9a7381726e25 tempest-GroupSnapshotsTest-1811106974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4c5e19f2-9c03-4040-ad11-ae12ba409368" returned: 0 in 0.550s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:26:53 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-29498720-0309-4a24-be78-9a7381726e25 tempest-GroupSnapshotsTest-1811106974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4c5e19f2-9c03-4040-ad11-ae12ba409368 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:26:53 devstack sudo[101286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4c5e19f2-9c03-4040-ad11-ae12ba409368 Aug 26 14:26:53 devstack sudo[101286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:26:53 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-e332edb0-3787-47f5-ae41-13a8a096e8c4 tempest-AttachVolumeTestJSON-1421707928 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:26:53 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-e332edb0-3787-47f5-ae41-13a8a096e8c4 tempest-AttachVolumeTestJSON-1421707928 None] Flow 'volume_create_manager' (510cc658-be09-4fd4-b3f3-0ed208a52105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:26:53 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-e332edb0-3787-47f5-ae41-13a8a096e8c4 tempest-AttachVolumeTestJSON-1421707928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9b940ac-f9ac-418c-a0a2-6cfbeeeb7ea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:26:53 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-e332edb0-3787-47f5-ae41-13a8a096e8c4 tempest-AttachVolumeTestJSON-1421707928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9b940ac-f9ac-418c-a0a2-6cfbeeeb7ea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:26:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1648311662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1a50d5b-8b47-41c5-b6ac-decaa9684a65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='948795cbf7d94ac690dd0722903834d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:26:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:26:54Z,use_quota=True,user_id='b42030cd1bff449596db251600581e7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:26:53 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-e332edb0-3787-47f5-ae41-13a8a096e8c4 tempest-AttachVolumeTestJSON-1421707928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc6a38d2-acc7-47e9-9669-5db3004b4cc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:26:53 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-e332edb0-3787-47f5-ae41-13a8a096e8c4 tempest-AttachVolumeTestJSON-1421707928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc6a38d2-acc7-47e9-9669-5db3004b4cc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:26:53 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-e332edb0-3787-47f5-ae41-13a8a096e8c4 tempest-AttachVolumeTestJSON-1421707928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00e59bf9-c5a4-4e16-855a-287847dec9d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:26:53 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-e332edb0-3787-47f5-ae41-13a8a096e8c4 tempest-AttachVolumeTestJSON-1421707928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00e59bf9-c5a4-4e16-855a-287847dec9d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1a50d5b-8b47-41c5-b6ac-decaa9684a65', 'volume_name': 'volume-c1a50d5b-8b47-41c5-b6ac-decaa9684a65', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:26:53 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-e332edb0-3787-47f5-ae41-13a8a096e8c4 tempest-AttachVolumeTestJSON-1421707928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28297d8e-6715-4caf-b3f1-11af33044a07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:26:53 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-e332edb0-3787-47f5-ae41-13a8a096e8c4 tempest-AttachVolumeTestJSON-1421707928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28297d8e-6715-4caf-b3f1-11af33044a07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:26:53 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-e332edb0-3787-47f5-ae41-13a8a096e8c4 tempest-AttachVolumeTestJSON-1421707928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abfe16f8-3622-428b-9518-d177ebb9da11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:26:53 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-e332edb0-3787-47f5-ae41-13a8a096e8c4 tempest-AttachVolumeTestJSON-1421707928 None] Volume c1a50d5b-8b47-41c5-b6ac-decaa9684a65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1a50d5b-8b47-41c5-b6ac-decaa9684a65', 'volume_size': 1} Aug 26 14:26:53 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e332edb0-3787-47f5-ae41-13a8a096e8c4 tempest-AttachVolumeTestJSON-1421707928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:26:53 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e332edb0-3787-47f5-ae41-13a8a096e8c4 tempest-AttachVolumeTestJSON-1421707928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:26:53 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-e332edb0-3787-47f5-ae41-13a8a096e8c4 tempest-AttachVolumeTestJSON-1421707928 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:26:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1648311662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1a50d5b-8b47-41c5-b6ac-decaa9684a65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='948795cbf7d94ac690dd0722903834d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:26:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:26:54Z,use_quota=True,user_id='b42030cd1bff449596db251600581e7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:26:53 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-e332edb0-3787-47f5-ae41-13a8a096e8c4 tempest-AttachVolumeTestJSON-1421707928 None] Creating volume c1a50d5b-8b47-41c5-b6ac-decaa9684a65 {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:26:53 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e332edb0-3787-47f5-ae41-13a8a096e8c4 tempest-AttachVolumeTestJSON-1421707928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:26:53 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e332edb0-3787-47f5-ae41-13a8a096e8c4 tempest-AttachVolumeTestJSON-1421707928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:26:53 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-e332edb0-3787-47f5-ae41-13a8a096e8c4 tempest-AttachVolumeTestJSON-1421707928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:26:53 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-e332edb0-3787-47f5-ae41-13a8a096e8c4 tempest-AttachVolumeTestJSON-1421707928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:26:53 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e332edb0-3787-47f5-ae41-13a8a096e8c4 tempest-AttachVolumeTestJSON-1421707928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:26:53 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-e332edb0-3787-47f5-ae41-13a8a096e8c4 tempest-AttachVolumeTestJSON-1421707928 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:26:53 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-e332edb0-3787-47f5-ae41-13a8a096e8c4 tempest-AttachVolumeTestJSON-1421707928 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:26:53 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e332edb0-3787-47f5-ae41-13a8a096e8c4 tempest-AttachVolumeTestJSON-1421707928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c1a50d5b-8b47-41c5-b6ac-decaa9684a65 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:26:53 devstack sudo[101288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c1a50d5b-8b47-41c5-b6ac-decaa9684a65 1073741824 Aug 26 14:26:53 devstack sudo[101288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:26:54 devstack sudo[101286]: pam_unix(sudo:session): session closed for user root Aug 26 14:26:54 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-29498720-0309-4a24-be78-9a7381726e25 tempest-GroupSnapshotsTest-1811106974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4c5e19f2-9c03-4040-ad11-ae12ba409368" returned: 0 in 0.274s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:26:54 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-29498720-0309-4a24-be78-9a7381726e25 tempest-GroupSnapshotsTest-1811106974 None] Lock "cinder-quobyte-4c5e19f2-9c03-4040-ad11-ae12ba409368" released by "delete_volume" :: held 0.927s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:26:54 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-29498720-0309-4a24-be78-9a7381726e25 tempest-GroupSnapshotsTest-1811106974 None] Created reservations ['49bf7685-b361-40d3-9e3a-9d878cc9060f'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:26:54 devstack cinder-volume[94394]: WARNING cinder.db.api [None req-29498720-0309-4a24-be78-9a7381726e25 tempest-GroupSnapshotsTest-1811106974 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-164961382'] Aug 26 14:26:54 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-29498720-0309-4a24-be78-9a7381726e25 tempest-GroupSnapshotsTest-1811106974 None] Created reservations ['7c855eeb-8714-48c8-947e-58322eb14646', '31c31267-11d9-4989-8410-679f2887a53a', '17c5146f-af02-4e13-8dac-33e1a863ca62', 'ae08ad21-0e45-483b-b2db-51354266dbdd'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:26:54 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-29498720-0309-4a24-be78-9a7381726e25 tempest-GroupSnapshotsTest-1811106974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:26:54 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-29498720-0309-4a24-be78-9a7381726e25 tempest-GroupSnapshotsTest-1811106974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:26:54 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-29498720-0309-4a24-be78-9a7381726e25 tempest-GroupSnapshotsTest-1811106974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:26:54 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-29498720-0309-4a24-be78-9a7381726e25 tempest-GroupSnapshotsTest-1811106974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:26:54 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-29498720-0309-4a24-be78-9a7381726e25 tempest-GroupSnapshotsTest-1811106974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:26:54 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-29498720-0309-4a24-be78-9a7381726e25 tempest-GroupSnapshotsTest-1811106974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:26:54 devstack sudo[101294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:26:54 devstack sudo[101294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:26:54 devstack sudo[101288]: pam_unix(sudo:session): session closed for user root Aug 26 14:26:54 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e332edb0-3787-47f5-ae41-13a8a096e8c4 tempest-AttachVolumeTestJSON-1421707928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c1a50d5b-8b47-41c5-b6ac-decaa9684a65 1073741824" returned: 0 in 0.570s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:26:54 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e332edb0-3787-47f5-ae41-13a8a096e8c4 tempest-AttachVolumeTestJSON-1421707928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c1a50d5b-8b47-41c5-b6ac-decaa9684a65 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:26:54 devstack sudo[101297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c1a50d5b-8b47-41c5-b6ac-decaa9684a65 Aug 26 14:26:54 devstack sudo[101297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:26:54 devstack sudo[101294]: pam_unix(sudo:session): session closed for user root Aug 26 14:26:54 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-29498720-0309-4a24-be78-9a7381726e25 tempest-GroupSnapshotsTest-1811106974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.446s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:26:54 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-29498720-0309-4a24-be78-9a7381726e25 tempest-GroupSnapshotsTest-1811106974 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:26:54 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-29498720-0309-4a24-be78-9a7381726e25 tempest-GroupSnapshotsTest-1811106974 None] Delete group completed successfully. Aug 26 14:26:55 devstack sudo[101297]: pam_unix(sudo:session): session closed for user root Aug 26 14:26:55 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e332edb0-3787-47f5-ae41-13a8a096e8c4 tempest-AttachVolumeTestJSON-1421707928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c1a50d5b-8b47-41c5-b6ac-decaa9684a65" returned: 0 in 0.462s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:26:55 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-e332edb0-3787-47f5-ae41-13a8a096e8c4 tempest-AttachVolumeTestJSON-1421707928 None] <== create_volume: return (1099ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:26:55 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e332edb0-3787-47f5-ae41-13a8a096e8c4 tempest-AttachVolumeTestJSON-1421707928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.102s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:26:55 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-27b234b8-00e9-45b6-a9c3-4c2dfb084c4a tempest-GroupSnapshotsTest-1811106974 None] Group tempest-GroupSnapshotsTest-Group-396883876: creating Aug 26 14:26:55 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-e332edb0-3787-47f5-ae41-13a8a096e8c4 tempest-AttachVolumeTestJSON-1421707928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abfe16f8-3622-428b-9518-d177ebb9da11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1a50d5b-8b47-41c5-b6ac-decaa9684a65', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:26:55 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-e332edb0-3787-47f5-ae41-13a8a096e8c4 tempest-AttachVolumeTestJSON-1421707928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0430215e-8b08-4b68-bb98-c8bbb6b5476c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:26:55 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-e332edb0-3787-47f5-ae41-13a8a096e8c4 tempest-AttachVolumeTestJSON-1421707928 None] Volume volume-c1a50d5b-8b47-41c5-b6ac-decaa9684a65 (c1a50d5b-8b47-41c5-b6ac-decaa9684a65): created successfully Aug 26 14:26:55 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-e332edb0-3787-47f5-ae41-13a8a096e8c4 tempest-AttachVolumeTestJSON-1421707928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0430215e-8b08-4b68-bb98-c8bbb6b5476c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:26:55 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-e332edb0-3787-47f5-ae41-13a8a096e8c4 tempest-AttachVolumeTestJSON-1421707928 None] Flow 'volume_create_manager' (510cc658-be09-4fd4-b3f3-0ed208a52105) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:26:55 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-27b234b8-00e9-45b6-a9c3-4c2dfb084c4a tempest-GroupSnapshotsTest-1811106974 None] Group tempest-GroupSnapshotsTest-Group-396883876: created successfully Aug 26 14:26:55 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-e332edb0-3787-47f5-ae41-13a8a096e8c4 tempest-AttachVolumeTestJSON-1421707928 None] Created volume successfully. Aug 26 14:26:55 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-27b234b8-00e9-45b6-a9c3-4c2dfb084c4a tempest-GroupSnapshotsTest-1811106974 None] Create group completed successfully. Aug 26 14:26:55 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [req-791ae08f-c30b-43fb-b5e8-56821c610198 req-503c15eb-0563-4540-9656-42dc780b41ec tempest-AttachVolumeNegativeTest-342477261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:26:55 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [req-791ae08f-c30b-43fb-b5e8-56821c610198 req-503c15eb-0563-4540-9656-42dc780b41ec tempest-AttachVolumeNegativeTest-342477261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:26:55 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [req-791ae08f-c30b-43fb-b5e8-56821c610198 req-503c15eb-0563-4540-9656-42dc780b41ec tempest-AttachVolumeNegativeTest-342477261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:26:55 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [req-791ae08f-c30b-43fb-b5e8-56821c610198 req-503c15eb-0563-4540-9656-42dc780b41ec tempest-AttachVolumeNegativeTest-342477261 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b', 'name': 'volume-74f30e56-9a4b-44b3-8a83-c0c3889e4a19', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ddb1ec70-e06b-4c89-aea4-b9e5d1bbe4f8', 'enforce_multipath': True} {{(pid=94394) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 14:26:55 devstack cinder-volume[94394]: INFO cinder.volume.manager [req-791ae08f-c30b-43fb-b5e8-56821c610198 req-503c15eb-0563-4540-9656-42dc780b41ec tempest-AttachVolumeNegativeTest-342477261 None] attachment_update completed successfully. Aug 26 14:26:57 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-951bfdf3-ab48-4d43-95d4-4a90e259d1ea tempest-GroupSnapshotsTest-1811106974 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:26:57 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-951bfdf3-ab48-4d43-95d4-4a90e259d1ea tempest-GroupSnapshotsTest-1811106974 None] Flow 'volume_create_manager' (6e4bff69-17be-4109-b864-be0dcaed43c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:26:57 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-951bfdf3-ab48-4d43-95d4-4a90e259d1ea tempest-GroupSnapshotsTest-1811106974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (334b152a-f3e7-41e3-a0a7-29163de3c5ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:26:57 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-951bfdf3-ab48-4d43-95d4-4a90e259d1ea tempest-GroupSnapshotsTest-1811106974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (334b152a-f3e7-41e3-a0a7-29163de3c5ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:26:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1913888844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=99ac751d-4c90-4f57-b8a7-4dfe8432d6e6,host='devstack@QuobyteHD#QuobyteHD',id=b44871b2-5bd4-4b98-90ba-222a38cc4cdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be0ddeaba262430da8382e7591982d1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:26:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:26:57Z,use_quota=True,user_id='a27ee7ba07b24d918426092684738d79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(919c7675-55cb-4352-ae26-102b96c803f3),volume_type_id=919c7675-55cb-4352-ae26-102b96c803f3)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:26:57 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-951bfdf3-ab48-4d43-95d4-4a90e259d1ea tempest-GroupSnapshotsTest-1811106974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ec19ba3-9fd5-4cdc-b27f-d89521e6fa4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:26:57 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-951bfdf3-ab48-4d43-95d4-4a90e259d1ea tempest-GroupSnapshotsTest-1811106974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ec19ba3-9fd5-4cdc-b27f-d89521e6fa4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:26:57 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-951bfdf3-ab48-4d43-95d4-4a90e259d1ea tempest-GroupSnapshotsTest-1811106974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (240a805a-d08c-45f2-a1b6-eebcda9b7e1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:26:57 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-951bfdf3-ab48-4d43-95d4-4a90e259d1ea tempest-GroupSnapshotsTest-1811106974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (240a805a-d08c-45f2-a1b6-eebcda9b7e1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b44871b2-5bd4-4b98-90ba-222a38cc4cdf', 'volume_name': 'volume-b44871b2-5bd4-4b98-90ba-222a38cc4cdf', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:26:57 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-951bfdf3-ab48-4d43-95d4-4a90e259d1ea tempest-GroupSnapshotsTest-1811106974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eaf88dc7-75de-4ee8-9222-c2dcbfb0d39e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:26:57 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-951bfdf3-ab48-4d43-95d4-4a90e259d1ea tempest-GroupSnapshotsTest-1811106974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eaf88dc7-75de-4ee8-9222-c2dcbfb0d39e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:26:57 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-951bfdf3-ab48-4d43-95d4-4a90e259d1ea tempest-GroupSnapshotsTest-1811106974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (899e0573-3c61-4778-a18b-3d0a66dcadde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:26:57 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-951bfdf3-ab48-4d43-95d4-4a90e259d1ea tempest-GroupSnapshotsTest-1811106974 None] Volume b44871b2-5bd4-4b98-90ba-222a38cc4cdf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b44871b2-5bd4-4b98-90ba-222a38cc4cdf', 'volume_size': 1} Aug 26 14:26:57 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-951bfdf3-ab48-4d43-95d4-4a90e259d1ea tempest-GroupSnapshotsTest-1811106974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:26:57 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-951bfdf3-ab48-4d43-95d4-4a90e259d1ea tempest-GroupSnapshotsTest-1811106974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:26:57 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-951bfdf3-ab48-4d43-95d4-4a90e259d1ea tempest-GroupSnapshotsTest-1811106974 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=99ac751d-4c90-4f57-b8a7-4dfe8432d6e6,created_at=2026-08-26T12:26:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1913888844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=99ac751d-4c90-4f57-b8a7-4dfe8432d6e6,host='devstack@QuobyteHD#QuobyteHD',id=b44871b2-5bd4-4b98-90ba-222a38cc4cdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be0ddeaba262430da8382e7591982d1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:26:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:26:57Z,use_quota=True,user_id='a27ee7ba07b24d918426092684738d79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(919c7675-55cb-4352-ae26-102b96c803f3),volume_type_id=919c7675-55cb-4352-ae26-102b96c803f3)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:26:57 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-951bfdf3-ab48-4d43-95d4-4a90e259d1ea tempest-GroupSnapshotsTest-1811106974 None] Creating volume b44871b2-5bd4-4b98-90ba-222a38cc4cdf {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:26:57 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-951bfdf3-ab48-4d43-95d4-4a90e259d1ea tempest-GroupSnapshotsTest-1811106974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:26:57 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-951bfdf3-ab48-4d43-95d4-4a90e259d1ea tempest-GroupSnapshotsTest-1811106974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:26:57 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-951bfdf3-ab48-4d43-95d4-4a90e259d1ea tempest-GroupSnapshotsTest-1811106974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:26:57 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-951bfdf3-ab48-4d43-95d4-4a90e259d1ea tempest-GroupSnapshotsTest-1811106974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:26:57 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-951bfdf3-ab48-4d43-95d4-4a90e259d1ea tempest-GroupSnapshotsTest-1811106974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:26:57 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-951bfdf3-ab48-4d43-95d4-4a90e259d1ea tempest-GroupSnapshotsTest-1811106974 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:26:57 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-951bfdf3-ab48-4d43-95d4-4a90e259d1ea tempest-GroupSnapshotsTest-1811106974 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:26:57 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-951bfdf3-ab48-4d43-95d4-4a90e259d1ea tempest-GroupSnapshotsTest-1811106974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b44871b2-5bd4-4b98-90ba-222a38cc4cdf 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:26:57 devstack sudo[101714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b44871b2-5bd4-4b98-90ba-222a38cc4cdf 1073741824 Aug 26 14:26:57 devstack sudo[101714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:26:57 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [req-d893665b-5ec1-4f56-a8f5-bf015f7aa128 req-08957985-52bd-4388-9430-26202e4e4d27 tempest-AttachVolumeTestJSON-1421707928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:26:57 devstack sudo[101714]: pam_unix(sudo:session): session closed for user root Aug 26 14:26:57 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-951bfdf3-ab48-4d43-95d4-4a90e259d1ea tempest-GroupSnapshotsTest-1811106974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b44871b2-5bd4-4b98-90ba-222a38cc4cdf 1073741824" returned: 0 in 0.551s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:26:57 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-951bfdf3-ab48-4d43-95d4-4a90e259d1ea tempest-GroupSnapshotsTest-1811106974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b44871b2-5bd4-4b98-90ba-222a38cc4cdf {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:26:57 devstack sudo[101721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b44871b2-5bd4-4b98-90ba-222a38cc4cdf Aug 26 14:26:57 devstack sudo[101721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:26:58 devstack sudo[101721]: pam_unix(sudo:session): session closed for user root Aug 26 14:26:58 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-951bfdf3-ab48-4d43-95d4-4a90e259d1ea tempest-GroupSnapshotsTest-1811106974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b44871b2-5bd4-4b98-90ba-222a38cc4cdf" returned: 0 in 0.297s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:26:58 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-951bfdf3-ab48-4d43-95d4-4a90e259d1ea tempest-GroupSnapshotsTest-1811106974 None] <== create_volume: return (898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:26:58 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-951bfdf3-ab48-4d43-95d4-4a90e259d1ea tempest-GroupSnapshotsTest-1811106974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.900s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:26:58 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [req-d893665b-5ec1-4f56-a8f5-bf015f7aa128 req-08957985-52bd-4388-9430-26202e4e4d27 tempest-AttachVolumeTestJSON-1421707928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.788s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:26:58 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-951bfdf3-ab48-4d43-95d4-4a90e259d1ea tempest-GroupSnapshotsTest-1811106974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (899e0573-3c61-4778-a18b-3d0a66dcadde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b44871b2-5bd4-4b98-90ba-222a38cc4cdf', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:26:58 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-951bfdf3-ab48-4d43-95d4-4a90e259d1ea tempest-GroupSnapshotsTest-1811106974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78a0d3ef-d670-4f7e-9a4e-d52edc1c726a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:26:58 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [req-d893665b-5ec1-4f56-a8f5-bf015f7aa128 req-08957985-52bd-4388-9430-26202e4e4d27 tempest-AttachVolumeTestJSON-1421707928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:26:58 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-951bfdf3-ab48-4d43-95d4-4a90e259d1ea tempest-GroupSnapshotsTest-1811106974 None] Volume volume-b44871b2-5bd4-4b98-90ba-222a38cc4cdf (b44871b2-5bd4-4b98-90ba-222a38cc4cdf): created successfully Aug 26 14:26:58 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-951bfdf3-ab48-4d43-95d4-4a90e259d1ea tempest-GroupSnapshotsTest-1811106974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78a0d3ef-d670-4f7e-9a4e-d52edc1c726a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:26:58 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-951bfdf3-ab48-4d43-95d4-4a90e259d1ea tempest-GroupSnapshotsTest-1811106974 None] Flow 'volume_create_manager' (6e4bff69-17be-4109-b864-be0dcaed43c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:26:58 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-951bfdf3-ab48-4d43-95d4-4a90e259d1ea tempest-GroupSnapshotsTest-1811106974 None] Created volume successfully. Aug 26 14:26:58 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [req-d893665b-5ec1-4f56-a8f5-bf015f7aa128 req-08957985-52bd-4388-9430-26202e4e4d27 tempest-AttachVolumeTestJSON-1421707928 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b', 'name': 'volume-c1a50d5b-8b47-41c5-b6ac-decaa9684a65', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6d4b3bfa-268e-41b4-a0d3-011c7d95482c', 'enforce_multipath': True} {{(pid=94394) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 14:26:58 devstack cinder-volume[94394]: INFO cinder.volume.manager [req-d893665b-5ec1-4f56-a8f5-bf015f7aa128 req-08957985-52bd-4388-9430-26202e4e4d27 tempest-AttachVolumeTestJSON-1421707928 None] attachment_update completed successfully. Aug 26 14:26:59 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-f77ceeb6-fcd3-4c63-915b-6b9ae6976ed0 tempest-GroupSnapshotsTest-1811106974 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:26:59 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-f77ceeb6-fcd3-4c63-915b-6b9ae6976ed0 tempest-GroupSnapshotsTest-1811106974 None] Flow 'volume_create_manager' (39eaa6d5-923e-4673-97f5-201324dfa152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:26:59 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-f77ceeb6-fcd3-4c63-915b-6b9ae6976ed0 tempest-GroupSnapshotsTest-1811106974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74597dfd-846f-4912-bd98-a37019adeda3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:26:59 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-f77ceeb6-fcd3-4c63-915b-6b9ae6976ed0 tempest-GroupSnapshotsTest-1811106974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74597dfd-846f-4912-bd98-a37019adeda3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:26:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-99738389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=99ac751d-4c90-4f57-b8a7-4dfe8432d6e6,host='devstack@QuobyteHD#QuobyteHD',id=2faed028-96f9-4b02-9b1e-ad8327a75340,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be0ddeaba262430da8382e7591982d1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:26:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:26:59Z,use_quota=True,user_id='a27ee7ba07b24d918426092684738d79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(919c7675-55cb-4352-ae26-102b96c803f3),volume_type_id=919c7675-55cb-4352-ae26-102b96c803f3)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:26:59 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-f77ceeb6-fcd3-4c63-915b-6b9ae6976ed0 tempest-GroupSnapshotsTest-1811106974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1632b6e6-4832-4b75-9dc9-9301c8a15232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:26:59 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-f77ceeb6-fcd3-4c63-915b-6b9ae6976ed0 tempest-GroupSnapshotsTest-1811106974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1632b6e6-4832-4b75-9dc9-9301c8a15232) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:26:59 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-f77ceeb6-fcd3-4c63-915b-6b9ae6976ed0 tempest-GroupSnapshotsTest-1811106974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e9d6fd2-bb44-492b-874f-19055f7cadf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:26:59 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-f77ceeb6-fcd3-4c63-915b-6b9ae6976ed0 tempest-GroupSnapshotsTest-1811106974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e9d6fd2-bb44-492b-874f-19055f7cadf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2faed028-96f9-4b02-9b1e-ad8327a75340', 'volume_name': 'volume-2faed028-96f9-4b02-9b1e-ad8327a75340', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:26:59 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-f77ceeb6-fcd3-4c63-915b-6b9ae6976ed0 tempest-GroupSnapshotsTest-1811106974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9e655a7-e523-4a11-a02e-a52be97ac05b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:26:59 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-f77ceeb6-fcd3-4c63-915b-6b9ae6976ed0 tempest-GroupSnapshotsTest-1811106974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9e655a7-e523-4a11-a02e-a52be97ac05b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:26:59 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-f77ceeb6-fcd3-4c63-915b-6b9ae6976ed0 tempest-GroupSnapshotsTest-1811106974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1120fe29-f1ae-4677-997f-abc56568a0da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:26:59 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-f77ceeb6-fcd3-4c63-915b-6b9ae6976ed0 tempest-GroupSnapshotsTest-1811106974 None] Volume 2faed028-96f9-4b02-9b1e-ad8327a75340: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2faed028-96f9-4b02-9b1e-ad8327a75340', 'volume_size': 1} Aug 26 14:26:59 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-f77ceeb6-fcd3-4c63-915b-6b9ae6976ed0 tempest-GroupSnapshotsTest-1811106974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:26:59 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-f77ceeb6-fcd3-4c63-915b-6b9ae6976ed0 tempest-GroupSnapshotsTest-1811106974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:26:59 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-f77ceeb6-fcd3-4c63-915b-6b9ae6976ed0 tempest-GroupSnapshotsTest-1811106974 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=99ac751d-4c90-4f57-b8a7-4dfe8432d6e6,created_at=2026-08-26T12:26:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-99738389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=99ac751d-4c90-4f57-b8a7-4dfe8432d6e6,host='devstack@QuobyteHD#QuobyteHD',id=2faed028-96f9-4b02-9b1e-ad8327a75340,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be0ddeaba262430da8382e7591982d1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:26:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:26:59Z,use_quota=True,user_id='a27ee7ba07b24d918426092684738d79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(919c7675-55cb-4352-ae26-102b96c803f3),volume_type_id=919c7675-55cb-4352-ae26-102b96c803f3)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:26:59 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-f77ceeb6-fcd3-4c63-915b-6b9ae6976ed0 tempest-GroupSnapshotsTest-1811106974 None] Creating volume 2faed028-96f9-4b02-9b1e-ad8327a75340 {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:26:59 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-f77ceeb6-fcd3-4c63-915b-6b9ae6976ed0 tempest-GroupSnapshotsTest-1811106974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:26:59 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-f77ceeb6-fcd3-4c63-915b-6b9ae6976ed0 tempest-GroupSnapshotsTest-1811106974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:26:59 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-f77ceeb6-fcd3-4c63-915b-6b9ae6976ed0 tempest-GroupSnapshotsTest-1811106974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:26:59 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-f77ceeb6-fcd3-4c63-915b-6b9ae6976ed0 tempest-GroupSnapshotsTest-1811106974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:26:59 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-f77ceeb6-fcd3-4c63-915b-6b9ae6976ed0 tempest-GroupSnapshotsTest-1811106974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:26:59 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-f77ceeb6-fcd3-4c63-915b-6b9ae6976ed0 tempest-GroupSnapshotsTest-1811106974 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:26:59 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-f77ceeb6-fcd3-4c63-915b-6b9ae6976ed0 tempest-GroupSnapshotsTest-1811106974 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:26:59 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-f77ceeb6-fcd3-4c63-915b-6b9ae6976ed0 tempest-GroupSnapshotsTest-1811106974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2faed028-96f9-4b02-9b1e-ad8327a75340 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:26:59 devstack sudo[101730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2faed028-96f9-4b02-9b1e-ad8327a75340 1073741824 Aug 26 14:26:59 devstack sudo[101730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:26:59 devstack sudo[101730]: pam_unix(sudo:session): session closed for user root Aug 26 14:26:59 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-f77ceeb6-fcd3-4c63-915b-6b9ae6976ed0 tempest-GroupSnapshotsTest-1811106974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2faed028-96f9-4b02-9b1e-ad8327a75340 1073741824" returned: 0 in 0.475s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:26:59 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-f77ceeb6-fcd3-4c63-915b-6b9ae6976ed0 tempest-GroupSnapshotsTest-1811106974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2faed028-96f9-4b02-9b1e-ad8327a75340 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:26:59 devstack sudo[101737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2faed028-96f9-4b02-9b1e-ad8327a75340 Aug 26 14:26:59 devstack sudo[101737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:27:00 devstack sudo[101737]: pam_unix(sudo:session): session closed for user root Aug 26 14:27:00 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-f77ceeb6-fcd3-4c63-915b-6b9ae6976ed0 tempest-GroupSnapshotsTest-1811106974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2faed028-96f9-4b02-9b1e-ad8327a75340" returned: 0 in 0.339s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:27:00 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-f77ceeb6-fcd3-4c63-915b-6b9ae6976ed0 tempest-GroupSnapshotsTest-1811106974 None] <== create_volume: return (868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:27:00 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-f77ceeb6-fcd3-4c63-915b-6b9ae6976ed0 tempest-GroupSnapshotsTest-1811106974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.870s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:27:00 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-f77ceeb6-fcd3-4c63-915b-6b9ae6976ed0 tempest-GroupSnapshotsTest-1811106974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1120fe29-f1ae-4677-997f-abc56568a0da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2faed028-96f9-4b02-9b1e-ad8327a75340', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:27:00 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-f77ceeb6-fcd3-4c63-915b-6b9ae6976ed0 tempest-GroupSnapshotsTest-1811106974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e58e2c0-3370-4159-b7b6-0eee94217135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:27:00 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-f77ceeb6-fcd3-4c63-915b-6b9ae6976ed0 tempest-GroupSnapshotsTest-1811106974 None] Volume volume-2faed028-96f9-4b02-9b1e-ad8327a75340 (2faed028-96f9-4b02-9b1e-ad8327a75340): created successfully Aug 26 14:27:00 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-f77ceeb6-fcd3-4c63-915b-6b9ae6976ed0 tempest-GroupSnapshotsTest-1811106974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e58e2c0-3370-4159-b7b6-0eee94217135) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:27:00 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-f77ceeb6-fcd3-4c63-915b-6b9ae6976ed0 tempest-GroupSnapshotsTest-1811106974 None] Flow 'volume_create_manager' (39eaa6d5-923e-4673-97f5-201324dfa152) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:27:00 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-f77ceeb6-fcd3-4c63-915b-6b9ae6976ed0 tempest-GroupSnapshotsTest-1811106974 None] Created volume successfully. Aug 26 14:27:00 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-5611498f-3d5e-4db4-a7ee-aebb6a0f8972 tempest-GroupSnapshotsTest-1811106974 None] Update group completed successfully. Aug 26 14:27:02 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-df2b5f41-4c3e-4013-abb6-1f3c4de13e1e tempest-GroupSnapshotsTest-1811106974 None] Update group completed successfully. Aug 26 14:27:03 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-49d8ea4b-fbe4-42f4-8978-1848da4cf5fb tempest-GroupSnapshotsTest-1811106974 None] Update group completed successfully. Aug 26 14:27:04 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-e7da54fb-0fae-41f1-927c-805bd197f695 tempest-GroupSnapshotsTest-1811106974 None] Update group completed successfully. Aug 26 14:27:05 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [req-0855d771-d17f-4c1d-9373-80d3efd57b40 req-745fd2fc-843e-4fd6-aef1-bb48f0ed6c82 tempest-VolumesSnapshotsTestJSON-910827177 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:27:05 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [req-0855d771-d17f-4c1d-9373-80d3efd57b40 req-745fd2fc-843e-4fd6-aef1-bb48f0ed6c82 tempest-VolumesSnapshotsTestJSON-910827177 None] Flow 'volume_create_manager' (ccf30400-d059-40a6-af16-e66a105aa713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:27:05 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [req-0855d771-d17f-4c1d-9373-80d3efd57b40 req-745fd2fc-843e-4fd6-aef1-bb48f0ed6c82 tempest-VolumesSnapshotsTestJSON-910827177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61bcbec3-2085-4cc5-8392-ca9db56ef364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:27:05 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [req-0855d771-d17f-4c1d-9373-80d3efd57b40 req-745fd2fc-843e-4fd6-aef1-bb48f0ed6c82 tempest-VolumesSnapshotsTestJSON-910827177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61bcbec3-2085-4cc5-8392-ca9db56ef364) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:27:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1465669049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc2c76e4-592a-4ec6-8bb5-b309307dba60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47f8136858e343a28620620de7e99957',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:27:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:27:06Z,use_quota=True,user_id='05181dc8fe78405c8b81aa66b90403ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:27:05 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [req-0855d771-d17f-4c1d-9373-80d3efd57b40 req-745fd2fc-843e-4fd6-aef1-bb48f0ed6c82 tempest-VolumesSnapshotsTestJSON-910827177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (393f0f49-eb7c-42db-9727-cf1f0f15f7a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:27:05 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [req-0855d771-d17f-4c1d-9373-80d3efd57b40 req-745fd2fc-843e-4fd6-aef1-bb48f0ed6c82 tempest-VolumesSnapshotsTestJSON-910827177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (393f0f49-eb7c-42db-9727-cf1f0f15f7a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:27:05 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [req-0855d771-d17f-4c1d-9373-80d3efd57b40 req-745fd2fc-843e-4fd6-aef1-bb48f0ed6c82 tempest-VolumesSnapshotsTestJSON-910827177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8ccb418-0797-40d5-8841-73334bb08e54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:27:05 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [req-0855d771-d17f-4c1d-9373-80d3efd57b40 req-745fd2fc-843e-4fd6-aef1-bb48f0ed6c82 tempest-VolumesSnapshotsTestJSON-910827177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8ccb418-0797-40d5-8841-73334bb08e54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc2c76e4-592a-4ec6-8bb5-b309307dba60', 'volume_name': 'volume-fc2c76e4-592a-4ec6-8bb5-b309307dba60', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:27:05 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [req-0855d771-d17f-4c1d-9373-80d3efd57b40 req-745fd2fc-843e-4fd6-aef1-bb48f0ed6c82 tempest-VolumesSnapshotsTestJSON-910827177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0580e951-ee31-4786-a336-6ec05844b4f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:27:05 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [req-0855d771-d17f-4c1d-9373-80d3efd57b40 req-745fd2fc-843e-4fd6-aef1-bb48f0ed6c82 tempest-VolumesSnapshotsTestJSON-910827177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0580e951-ee31-4786-a336-6ec05844b4f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:27:05 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [req-0855d771-d17f-4c1d-9373-80d3efd57b40 req-745fd2fc-843e-4fd6-aef1-bb48f0ed6c82 tempest-VolumesSnapshotsTestJSON-910827177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f56f6a1-524d-4962-b58b-f3ca74c05e52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:27:05 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [req-0855d771-d17f-4c1d-9373-80d3efd57b40 req-745fd2fc-843e-4fd6-aef1-bb48f0ed6c82 tempest-VolumesSnapshotsTestJSON-910827177 None] Volume fc2c76e4-592a-4ec6-8bb5-b309307dba60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc2c76e4-592a-4ec6-8bb5-b309307dba60', 'volume_size': 1} Aug 26 14:27:05 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [req-0855d771-d17f-4c1d-9373-80d3efd57b40 req-745fd2fc-843e-4fd6-aef1-bb48f0ed6c82 tempest-VolumesSnapshotsTestJSON-910827177 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:27:05 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [req-0855d771-d17f-4c1d-9373-80d3efd57b40 req-745fd2fc-843e-4fd6-aef1-bb48f0ed6c82 tempest-VolumesSnapshotsTestJSON-910827177 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:27:05 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [req-0855d771-d17f-4c1d-9373-80d3efd57b40 req-745fd2fc-843e-4fd6-aef1-bb48f0ed6c82 tempest-VolumesSnapshotsTestJSON-910827177 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:27:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1465669049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc2c76e4-592a-4ec6-8bb5-b309307dba60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47f8136858e343a28620620de7e99957',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:27:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:27:06Z,use_quota=True,user_id='05181dc8fe78405c8b81aa66b90403ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:27:05 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [req-0855d771-d17f-4c1d-9373-80d3efd57b40 req-745fd2fc-843e-4fd6-aef1-bb48f0ed6c82 tempest-VolumesSnapshotsTestJSON-910827177 None] Creating volume fc2c76e4-592a-4ec6-8bb5-b309307dba60 {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:27:05 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [req-0855d771-d17f-4c1d-9373-80d3efd57b40 req-745fd2fc-843e-4fd6-aef1-bb48f0ed6c82 tempest-VolumesSnapshotsTestJSON-910827177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:27:05 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [req-0855d771-d17f-4c1d-9373-80d3efd57b40 req-745fd2fc-843e-4fd6-aef1-bb48f0ed6c82 tempest-VolumesSnapshotsTestJSON-910827177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:27:05 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [req-0855d771-d17f-4c1d-9373-80d3efd57b40 req-745fd2fc-843e-4fd6-aef1-bb48f0ed6c82 tempest-VolumesSnapshotsTestJSON-910827177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:27:05 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [req-0855d771-d17f-4c1d-9373-80d3efd57b40 req-745fd2fc-843e-4fd6-aef1-bb48f0ed6c82 tempest-VolumesSnapshotsTestJSON-910827177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:27:05 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [req-0855d771-d17f-4c1d-9373-80d3efd57b40 req-745fd2fc-843e-4fd6-aef1-bb48f0ed6c82 tempest-VolumesSnapshotsTestJSON-910827177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:27:05 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [req-0855d771-d17f-4c1d-9373-80d3efd57b40 req-745fd2fc-843e-4fd6-aef1-bb48f0ed6c82 tempest-VolumesSnapshotsTestJSON-910827177 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:27:05 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [req-0855d771-d17f-4c1d-9373-80d3efd57b40 req-745fd2fc-843e-4fd6-aef1-bb48f0ed6c82 tempest-VolumesSnapshotsTestJSON-910827177 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:27:05 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [req-0855d771-d17f-4c1d-9373-80d3efd57b40 req-745fd2fc-843e-4fd6-aef1-bb48f0ed6c82 tempest-VolumesSnapshotsTestJSON-910827177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-fc2c76e4-592a-4ec6-8bb5-b309307dba60 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:27:06 devstack sudo[101850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-fc2c76e4-592a-4ec6-8bb5-b309307dba60 1073741824 Aug 26 14:27:06 devstack sudo[101850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:27:06 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-4e3336da-7ffb-4d14-8060-defeb6803da6 tempest-GroupSnapshotsTest-1811106974 None] GroupSnapshot 68122192-bc66-41bc-b449-8659220519c3: creating. Aug 26 14:27:06 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-4e3336da-7ffb-4d14-8060-defeb6803da6 tempest-GroupSnapshotsTest-1811106974 None] Group snapshot 68122192-bc66-41bc-b449-8659220519c3: creating. {{(pid=94394) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 26 14:27:06 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-4e3336da-7ffb-4d14-8060-defeb6803da6 tempest-GroupSnapshotsTest-1811106974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:27:06 devstack sudo[101850]: pam_unix(sudo:session): session closed for user root Aug 26 14:27:06 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [req-0855d771-d17f-4c1d-9373-80d3efd57b40 req-745fd2fc-843e-4fd6-aef1-bb48f0ed6c82 tempest-VolumesSnapshotsTestJSON-910827177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-fc2c76e4-592a-4ec6-8bb5-b309307dba60 1073741824" returned: 0 in 0.849s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:27:06 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [req-0855d771-d17f-4c1d-9373-80d3efd57b40 req-745fd2fc-843e-4fd6-aef1-bb48f0ed6c82 tempest-VolumesSnapshotsTestJSON-910827177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-fc2c76e4-592a-4ec6-8bb5-b309307dba60 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:27:06 devstack sudo[101879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-fc2c76e4-592a-4ec6-8bb5-b309307dba60 Aug 26 14:27:06 devstack sudo[101879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:27:07 devstack sudo[101879]: pam_unix(sudo:session): session closed for user root Aug 26 14:27:07 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [req-0855d771-d17f-4c1d-9373-80d3efd57b40 req-745fd2fc-843e-4fd6-aef1-bb48f0ed6c82 tempest-VolumesSnapshotsTestJSON-910827177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-fc2c76e4-592a-4ec6-8bb5-b309307dba60" returned: 0 in 0.315s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:27:07 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [req-0855d771-d17f-4c1d-9373-80d3efd57b40 req-745fd2fc-843e-4fd6-aef1-bb48f0ed6c82 tempest-VolumesSnapshotsTestJSON-910827177 None] <== create_volume: return (1240ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:27:07 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [req-0855d771-d17f-4c1d-9373-80d3efd57b40 req-745fd2fc-843e-4fd6-aef1-bb48f0ed6c82 tempest-VolumesSnapshotsTestJSON-910827177 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.243s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:27:07 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-4e3336da-7ffb-4d14-8060-defeb6803da6 tempest-GroupSnapshotsTest-1811106974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.497s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:27:07 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [req-0855d771-d17f-4c1d-9373-80d3efd57b40 req-745fd2fc-843e-4fd6-aef1-bb48f0ed6c82 tempest-VolumesSnapshotsTestJSON-910827177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f56f6a1-524d-4962-b58b-f3ca74c05e52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc2c76e4-592a-4ec6-8bb5-b309307dba60', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:27:07 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [req-0855d771-d17f-4c1d-9373-80d3efd57b40 req-745fd2fc-843e-4fd6-aef1-bb48f0ed6c82 tempest-VolumesSnapshotsTestJSON-910827177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (288c3b0d-a4ae-4dcf-9b61-b0fa4a93d431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:27:07 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-4e3336da-7ffb-4d14-8060-defeb6803da6 tempest-GroupSnapshotsTest-1811106974 None] Creating offline snapshot 46bea4ec-fec0-4833-8a38-dcd39022a967 of volume b44871b2-5bd4-4b98-90ba-222a38cc4cdf {{(pid=94394) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 14:27:07 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [req-0855d771-d17f-4c1d-9373-80d3efd57b40 req-745fd2fc-843e-4fd6-aef1-bb48f0ed6c82 tempest-VolumesSnapshotsTestJSON-910827177 None] Volume volume-fc2c76e4-592a-4ec6-8bb5-b309307dba60 (fc2c76e4-592a-4ec6-8bb5-b309307dba60): created successfully Aug 26 14:27:07 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [req-0855d771-d17f-4c1d-9373-80d3efd57b40 req-745fd2fc-843e-4fd6-aef1-bb48f0ed6c82 tempest-VolumesSnapshotsTestJSON-910827177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (288c3b0d-a4ae-4dcf-9b61-b0fa4a93d431) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:27:07 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [req-0855d771-d17f-4c1d-9373-80d3efd57b40 req-745fd2fc-843e-4fd6-aef1-bb48f0ed6c82 tempest-VolumesSnapshotsTestJSON-910827177 None] Flow 'volume_create_manager' (ccf30400-d059-40a6-af16-e66a105aa713) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:27:07 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cc73621-73ce-40ab-86e2-215ac2d3920d]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:27:07 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4e3336da-7ffb-4d14-8060-defeb6803da6 tempest-GroupSnapshotsTest-1811106974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b44871b2-5bd4-4b98-90ba-222a38cc4cdf {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:27:07 devstack cinder-volume[94394]: INFO cinder.volume.manager [req-0855d771-d17f-4c1d-9373-80d3efd57b40 req-745fd2fc-843e-4fd6-aef1-bb48f0ed6c82 tempest-VolumesSnapshotsTestJSON-910827177 None] Created volume successfully. Aug 26 14:27:07 devstack sudo[101894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b44871b2-5bd4-4b98-90ba-222a38cc4cdf Aug 26 14:27:07 devstack sudo[101894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:27:08 devstack sudo[101894]: pam_unix(sudo:session): session closed for user root Aug 26 14:27:08 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4e3336da-7ffb-4d14-8060-defeb6803da6 tempest-GroupSnapshotsTest-1811106974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b44871b2-5bd4-4b98-90ba-222a38cc4cdf" returned: 0 in 0.754s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:27:08 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4e3336da-7ffb-4d14-8060-defeb6803da6 tempest-GroupSnapshotsTest-1811106974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b44871b2-5bd4-4b98-90ba-222a38cc4cdf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b44871b2-5bd4-4b98-90ba-222a38cc4cdf.46bea4ec-fec0-4833-8a38-dcd39022a967 1G {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:27:08 devstack sudo[101920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b44871b2-5bd4-4b98-90ba-222a38cc4cdf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b44871b2-5bd4-4b98-90ba-222a38cc4cdf.46bea4ec-fec0-4833-8a38-dcd39022a967 1G Aug 26 14:27:08 devstack sudo[101920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:27:08 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [req-f0ab8a2f-e777-4b95-9dcf-c5b1fb1d5b03 req-c1991d5a-38ec-471a-8288-6e744f509e36 tempest-VolumesSnapshotsTestJSON-910827177 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:27:09 devstack sudo[101920]: pam_unix(sudo:session): session closed for user root Aug 26 14:27:09 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4e3336da-7ffb-4d14-8060-defeb6803da6 tempest-GroupSnapshotsTest-1811106974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b44871b2-5bd4-4b98-90ba-222a38cc4cdf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b44871b2-5bd4-4b98-90ba-222a38cc4cdf.46bea4ec-fec0-4833-8a38-dcd39022a967 1G" returned: 0 in 1.020s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:27:09 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4e3336da-7ffb-4d14-8060-defeb6803da6 tempest-GroupSnapshotsTest-1811106974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b44871b2-5bd4-4b98-90ba-222a38cc4cdf -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b44871b2-5bd4-4b98-90ba-222a38cc4cdf.46bea4ec-fec0-4833-8a38-dcd39022a967 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:27:09 devstack sudo[101939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b44871b2-5bd4-4b98-90ba-222a38cc4cdf -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b44871b2-5bd4-4b98-90ba-222a38cc4cdf.46bea4ec-fec0-4833-8a38-dcd39022a967 Aug 26 14:27:09 devstack sudo[101939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:27:09 devstack sudo[101939]: pam_unix(sudo:session): session closed for user root Aug 26 14:27:09 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4e3336da-7ffb-4d14-8060-defeb6803da6 tempest-GroupSnapshotsTest-1811106974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b44871b2-5bd4-4b98-90ba-222a38cc4cdf -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b44871b2-5bd4-4b98-90ba-222a38cc4cdf.46bea4ec-fec0-4833-8a38-dcd39022a967" returned: 0 in 0.489s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:27:09 devstack cinder-volume[94394]: WARNING cinder.volume.drivers.remotefs [None req-4e3336da-7ffb-4d14-8060-defeb6803da6 tempest-GroupSnapshotsTest-1811106974 None] /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b44871b2-5bd4-4b98-90ba-222a38cc4cdf.46bea4ec-fec0-4833-8a38-dcd39022a967 is being set with open permissions: ugo+rw: NotImplementedError Aug 26 14:27:09 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4e3336da-7ffb-4d14-8060-defeb6803da6 tempest-GroupSnapshotsTest-1811106974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b44871b2-5bd4-4b98-90ba-222a38cc4cdf.46bea4ec-fec0-4833-8a38-dcd39022a967 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:27:09 devstack sudo[101958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b44871b2-5bd4-4b98-90ba-222a38cc4cdf.46bea4ec-fec0-4833-8a38-dcd39022a967 Aug 26 14:27:09 devstack sudo[101958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:27:09 devstack sudo[101958]: pam_unix(sudo:session): session closed for user root Aug 26 14:27:09 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4e3336da-7ffb-4d14-8060-defeb6803da6 tempest-GroupSnapshotsTest-1811106974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b44871b2-5bd4-4b98-90ba-222a38cc4cdf.46bea4ec-fec0-4833-8a38-dcd39022a967" returned: 0 in 0.338s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:27:09 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4e3336da-7ffb-4d14-8060-defeb6803da6 tempest-GroupSnapshotsTest-1811106974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b44871b2-5bd4-4b98-90ba-222a38cc4cdf.info {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:27:09 devstack sudo[101969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b44871b2-5bd4-4b98-90ba-222a38cc4cdf.info Aug 26 14:27:09 devstack sudo[101969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:27:10 devstack sudo[101969]: pam_unix(sudo:session): session closed for user root Aug 26 14:27:10 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4e3336da-7ffb-4d14-8060-defeb6803da6 tempest-GroupSnapshotsTest-1811106974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b44871b2-5bd4-4b98-90ba-222a38cc4cdf.info" returned: 0 in 0.272s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:27:10 devstack cinder-volume[94394]: WARNING cinder.volume.drivers.remotefs [None req-4e3336da-7ffb-4d14-8060-defeb6803da6 tempest-GroupSnapshotsTest-1811106974 None] /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b44871b2-5bd4-4b98-90ba-222a38cc4cdf.info is being set with open permissions: ugo+rw: NotImplementedError Aug 26 14:27:10 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4e3336da-7ffb-4d14-8060-defeb6803da6 tempest-GroupSnapshotsTest-1811106974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b44871b2-5bd4-4b98-90ba-222a38cc4cdf.info {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:27:10 devstack sudo[101972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b44871b2-5bd4-4b98-90ba-222a38cc4cdf.info Aug 26 14:27:10 devstack sudo[101972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:27:10 devstack sudo[101972]: pam_unix(sudo:session): session closed for user root Aug 26 14:27:10 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4e3336da-7ffb-4d14-8060-defeb6803da6 tempest-GroupSnapshotsTest-1811106974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b44871b2-5bd4-4b98-90ba-222a38cc4cdf.info" returned: 0 in 0.270s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:27:10 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-4e3336da-7ffb-4d14-8060-defeb6803da6 tempest-GroupSnapshotsTest-1811106974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.279s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:27:10 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-4e3336da-7ffb-4d14-8060-defeb6803da6 tempest-GroupSnapshotsTest-1811106974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:27:10 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-4e3336da-7ffb-4d14-8060-defeb6803da6 tempest-GroupSnapshotsTest-1811106974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:27:10 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-4e3336da-7ffb-4d14-8060-defeb6803da6 tempest-GroupSnapshotsTest-1811106974 None] Creating offline snapshot b6fa13ce-7a0c-4b20-8fa3-211acef71e54 of volume 2faed028-96f9-4b02-9b1e-ad8327a75340 {{(pid=94394) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 14:27:10 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[d205ba84-39d6-4204-a777-3c28eceef2d8]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:27:10 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4e3336da-7ffb-4d14-8060-defeb6803da6 tempest-GroupSnapshotsTest-1811106974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2faed028-96f9-4b02-9b1e-ad8327a75340 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:27:10 devstack sudo[101976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2faed028-96f9-4b02-9b1e-ad8327a75340 Aug 26 14:27:10 devstack sudo[101976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:27:11 devstack sudo[101976]: pam_unix(sudo:session): session closed for user root Aug 26 14:27:11 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4e3336da-7ffb-4d14-8060-defeb6803da6 tempest-GroupSnapshotsTest-1811106974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2faed028-96f9-4b02-9b1e-ad8327a75340" returned: 0 in 0.718s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:27:11 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4e3336da-7ffb-4d14-8060-defeb6803da6 tempest-GroupSnapshotsTest-1811106974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2faed028-96f9-4b02-9b1e-ad8327a75340,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2faed028-96f9-4b02-9b1e-ad8327a75340.b6fa13ce-7a0c-4b20-8fa3-211acef71e54 1G {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:27:11 devstack sudo[101983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2faed028-96f9-4b02-9b1e-ad8327a75340,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2faed028-96f9-4b02-9b1e-ad8327a75340.b6fa13ce-7a0c-4b20-8fa3-211acef71e54 1G Aug 26 14:27:11 devstack sudo[101983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:27:11 devstack sudo[101983]: pam_unix(sudo:session): session closed for user root Aug 26 14:27:11 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4e3336da-7ffb-4d14-8060-defeb6803da6 tempest-GroupSnapshotsTest-1811106974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2faed028-96f9-4b02-9b1e-ad8327a75340,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2faed028-96f9-4b02-9b1e-ad8327a75340.b6fa13ce-7a0c-4b20-8fa3-211acef71e54 1G" returned: 0 in 0.459s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:27:11 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4e3336da-7ffb-4d14-8060-defeb6803da6 tempest-GroupSnapshotsTest-1811106974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2faed028-96f9-4b02-9b1e-ad8327a75340 -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2faed028-96f9-4b02-9b1e-ad8327a75340.b6fa13ce-7a0c-4b20-8fa3-211acef71e54 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:27:11 devstack sudo[101988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2faed028-96f9-4b02-9b1e-ad8327a75340 -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2faed028-96f9-4b02-9b1e-ad8327a75340.b6fa13ce-7a0c-4b20-8fa3-211acef71e54 Aug 26 14:27:11 devstack sudo[101988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:27:12 devstack sudo[101988]: pam_unix(sudo:session): session closed for user root Aug 26 14:27:12 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4e3336da-7ffb-4d14-8060-defeb6803da6 tempest-GroupSnapshotsTest-1811106974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2faed028-96f9-4b02-9b1e-ad8327a75340 -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2faed028-96f9-4b02-9b1e-ad8327a75340.b6fa13ce-7a0c-4b20-8fa3-211acef71e54" returned: 0 in 0.379s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:27:12 devstack cinder-volume[94394]: WARNING cinder.volume.drivers.remotefs [None req-4e3336da-7ffb-4d14-8060-defeb6803da6 tempest-GroupSnapshotsTest-1811106974 None] /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2faed028-96f9-4b02-9b1e-ad8327a75340.b6fa13ce-7a0c-4b20-8fa3-211acef71e54 is being set with open permissions: ugo+rw: NotImplementedError Aug 26 14:27:12 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4e3336da-7ffb-4d14-8060-defeb6803da6 tempest-GroupSnapshotsTest-1811106974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2faed028-96f9-4b02-9b1e-ad8327a75340.b6fa13ce-7a0c-4b20-8fa3-211acef71e54 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:27:12 devstack sudo[101993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2faed028-96f9-4b02-9b1e-ad8327a75340.b6fa13ce-7a0c-4b20-8fa3-211acef71e54 Aug 26 14:27:12 devstack sudo[101993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:27:12 devstack sudo[101993]: pam_unix(sudo:session): session closed for user root Aug 26 14:27:12 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4e3336da-7ffb-4d14-8060-defeb6803da6 tempest-GroupSnapshotsTest-1811106974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2faed028-96f9-4b02-9b1e-ad8327a75340.b6fa13ce-7a0c-4b20-8fa3-211acef71e54" returned: 0 in 0.261s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:27:12 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4e3336da-7ffb-4d14-8060-defeb6803da6 tempest-GroupSnapshotsTest-1811106974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2faed028-96f9-4b02-9b1e-ad8327a75340.info {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:27:12 devstack sudo[101996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2faed028-96f9-4b02-9b1e-ad8327a75340.info Aug 26 14:27:12 devstack sudo[101996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:27:12 devstack sudo[101996]: pam_unix(sudo:session): session closed for user root Aug 26 14:27:12 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4e3336da-7ffb-4d14-8060-defeb6803da6 tempest-GroupSnapshotsTest-1811106974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2faed028-96f9-4b02-9b1e-ad8327a75340.info" returned: 0 in 0.300s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:27:12 devstack cinder-volume[94394]: WARNING cinder.volume.drivers.remotefs [None req-4e3336da-7ffb-4d14-8060-defeb6803da6 tempest-GroupSnapshotsTest-1811106974 None] /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2faed028-96f9-4b02-9b1e-ad8327a75340.info is being set with open permissions: ugo+rw: NotImplementedError Aug 26 14:27:12 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4e3336da-7ffb-4d14-8060-defeb6803da6 tempest-GroupSnapshotsTest-1811106974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2faed028-96f9-4b02-9b1e-ad8327a75340.info {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:27:12 devstack sudo[101999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2faed028-96f9-4b02-9b1e-ad8327a75340.info Aug 26 14:27:12 devstack sudo[101999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:27:13 devstack sudo[101999]: pam_unix(sudo:session): session closed for user root Aug 26 14:27:13 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4e3336da-7ffb-4d14-8060-defeb6803da6 tempest-GroupSnapshotsTest-1811106974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2faed028-96f9-4b02-9b1e-ad8327a75340.info" returned: 0 in 0.316s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:27:13 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-4e3336da-7ffb-4d14-8060-defeb6803da6 tempest-GroupSnapshotsTest-1811106974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.574s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:27:13 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [req-f0ab8a2f-e777-4b95-9dcf-c5b1fb1d5b03 req-c1991d5a-38ec-471a-8288-6e744f509e36 tempest-VolumesSnapshotsTestJSON-910827177 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.207s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:27:13 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [req-f0ab8a2f-e777-4b95-9dcf-c5b1fb1d5b03 req-c1991d5a-38ec-471a-8288-6e744f509e36 tempest-VolumesSnapshotsTestJSON-910827177 None] Creating offline snapshot 4d29c337-45c1-4493-9fa9-c7b35cdc1849 of volume fc2c76e4-592a-4ec6-8bb5-b309307dba60 {{(pid=94394) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 14:27:13 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac5a9faa-ccfb-4d99-b9e8-f3f8eb3c3d4b]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:27:13 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [req-f0ab8a2f-e777-4b95-9dcf-c5b1fb1d5b03 req-c1991d5a-38ec-471a-8288-6e744f509e36 tempest-VolumesSnapshotsTestJSON-910827177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-fc2c76e4-592a-4ec6-8bb5-b309307dba60 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:27:13 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-4e3336da-7ffb-4d14-8060-defeb6803da6 tempest-GroupSnapshotsTest-1811106974 None] group_snapshot 68122192-bc66-41bc-b449-8659220519c3: created successfully Aug 26 14:27:13 devstack sudo[102002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-fc2c76e4-592a-4ec6-8bb5-b309307dba60 Aug 26 14:27:13 devstack sudo[102002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:27:13 devstack sudo[102002]: pam_unix(sudo:session): session closed for user root Aug 26 14:27:13 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [req-f0ab8a2f-e777-4b95-9dcf-c5b1fb1d5b03 req-c1991d5a-38ec-471a-8288-6e744f509e36 tempest-VolumesSnapshotsTestJSON-910827177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-fc2c76e4-592a-4ec6-8bb5-b309307dba60" returned: 0 in 0.541s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:27:13 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [req-f0ab8a2f-e777-4b95-9dcf-c5b1fb1d5b03 req-c1991d5a-38ec-471a-8288-6e744f509e36 tempest-VolumesSnapshotsTestJSON-910827177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-fc2c76e4-592a-4ec6-8bb5-b309307dba60,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-fc2c76e4-592a-4ec6-8bb5-b309307dba60.4d29c337-45c1-4493-9fa9-c7b35cdc1849 1G {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:27:13 devstack sudo[102007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-fc2c76e4-592a-4ec6-8bb5-b309307dba60,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-fc2c76e4-592a-4ec6-8bb5-b309307dba60.4d29c337-45c1-4493-9fa9-c7b35cdc1849 1G Aug 26 14:27:13 devstack sudo[102007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:27:14 devstack sudo[102007]: pam_unix(sudo:session): session closed for user root Aug 26 14:27:14 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [req-f0ab8a2f-e777-4b95-9dcf-c5b1fb1d5b03 req-c1991d5a-38ec-471a-8288-6e744f509e36 tempest-VolumesSnapshotsTestJSON-910827177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-fc2c76e4-592a-4ec6-8bb5-b309307dba60,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-fc2c76e4-592a-4ec6-8bb5-b309307dba60.4d29c337-45c1-4493-9fa9-c7b35cdc1849 1G" returned: 0 in 0.714s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:27:14 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [req-f0ab8a2f-e777-4b95-9dcf-c5b1fb1d5b03 req-c1991d5a-38ec-471a-8288-6e744f509e36 tempest-VolumesSnapshotsTestJSON-910827177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc2c76e4-592a-4ec6-8bb5-b309307dba60 -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-fc2c76e4-592a-4ec6-8bb5-b309307dba60.4d29c337-45c1-4493-9fa9-c7b35cdc1849 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:27:14 devstack sudo[102015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc2c76e4-592a-4ec6-8bb5-b309307dba60 -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-fc2c76e4-592a-4ec6-8bb5-b309307dba60.4d29c337-45c1-4493-9fa9-c7b35cdc1849 Aug 26 14:27:14 devstack sudo[102015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:27:14 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-705bd5c6-af6c-4672-b026-5334737f0b49 tempest-GroupSnapshotsTest-1811106974 None] group_snapshot 68122192-bc66-41bc-b449-8659220519c3: deleting Aug 26 14:27:14 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-705bd5c6-af6c-4672-b026-5334737f0b49 tempest-GroupSnapshotsTest-1811106974 None] group_snapshot 68122192-bc66-41bc-b449-8659220519c3: deleting {{(pid=94394) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 26 14:27:14 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-705bd5c6-af6c-4672-b026-5334737f0b49 tempest-GroupSnapshotsTest-1811106974 None] Acquiring lock "cinder-quobyte-b44871b2-5bd4-4b98-90ba-222a38cc4cdf" by "delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:27:14 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-705bd5c6-af6c-4672-b026-5334737f0b49 tempest-GroupSnapshotsTest-1811106974 None] Lock "cinder-quobyte-b44871b2-5bd4-4b98-90ba-222a38cc4cdf" acquired by "delete_snapshot" :: waited 0.021s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:27:14 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-705bd5c6-af6c-4672-b026-5334737f0b49 tempest-GroupSnapshotsTest-1811106974 None] Acquiring lock "cinder-quobyte-46bea4ec-fec0-4833-8a38-dcd39022a967" by "_delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:27:14 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-705bd5c6-af6c-4672-b026-5334737f0b49 tempest-GroupSnapshotsTest-1811106974 None] Lock "cinder-quobyte-46bea4ec-fec0-4833-8a38-dcd39022a967" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:27:14 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-705bd5c6-af6c-4672-b026-5334737f0b49 tempest-GroupSnapshotsTest-1811106974 None] Deleting offline snapshot 46bea4ec-fec0-4833-8a38-dcd39022a967 of volume b44871b2-5bd4-4b98-90ba-222a38cc4cdf {{(pid=94394) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 14:27:14 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-705bd5c6-af6c-4672-b026-5334737f0b49 tempest-GroupSnapshotsTest-1811106974 None] snapshot_file for this snap is: volume-b44871b2-5bd4-4b98-90ba-222a38cc4cdf.46bea4ec-fec0-4833-8a38-dcd39022a967 {{(pid=94394) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 14:27:14 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2eb5e2c-d68a-4b34-9ea8-dbdfbfe3011d]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:27:14 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-705bd5c6-af6c-4672-b026-5334737f0b49 tempest-GroupSnapshotsTest-1811106974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b44871b2-5bd4-4b98-90ba-222a38cc4cdf.46bea4ec-fec0-4833-8a38-dcd39022a967 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:27:14 devstack sudo[102015]: pam_unix(sudo:session): session closed for user root Aug 26 14:27:14 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [req-f0ab8a2f-e777-4b95-9dcf-c5b1fb1d5b03 req-c1991d5a-38ec-471a-8288-6e744f509e36 tempest-VolumesSnapshotsTestJSON-910827177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc2c76e4-592a-4ec6-8bb5-b309307dba60 -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-fc2c76e4-592a-4ec6-8bb5-b309307dba60.4d29c337-45c1-4493-9fa9-c7b35cdc1849" returned: 0 in 0.531s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:27:14 devstack cinder-volume[94394]: WARNING cinder.volume.drivers.remotefs [req-f0ab8a2f-e777-4b95-9dcf-c5b1fb1d5b03 req-c1991d5a-38ec-471a-8288-6e744f509e36 tempest-VolumesSnapshotsTestJSON-910827177 None] /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-fc2c76e4-592a-4ec6-8bb5-b309307dba60.4d29c337-45c1-4493-9fa9-c7b35cdc1849 is being set with open permissions: ugo+rw Aug 26 14:27:14 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [req-f0ab8a2f-e777-4b95-9dcf-c5b1fb1d5b03 req-c1991d5a-38ec-471a-8288-6e744f509e36 tempest-VolumesSnapshotsTestJSON-910827177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-fc2c76e4-592a-4ec6-8bb5-b309307dba60.4d29c337-45c1-4493-9fa9-c7b35cdc1849 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:27:14 devstack sudo[102020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b44871b2-5bd4-4b98-90ba-222a38cc4cdf.46bea4ec-fec0-4833-8a38-dcd39022a967 Aug 26 14:27:14 devstack sudo[102020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:27:14 devstack sudo[102021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-fc2c76e4-592a-4ec6-8bb5-b309307dba60.4d29c337-45c1-4493-9fa9-c7b35cdc1849 Aug 26 14:27:14 devstack sudo[102021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:27:15 devstack sudo[102020]: pam_unix(sudo:session): session closed for user root Aug 26 14:27:15 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-705bd5c6-af6c-4672-b026-5334737f0b49 tempest-GroupSnapshotsTest-1811106974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b44871b2-5bd4-4b98-90ba-222a38cc4cdf.46bea4ec-fec0-4833-8a38-dcd39022a967" returned: 0 in 0.620s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:27:15 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-705bd5c6-af6c-4672-b026-5334737f0b49 tempest-GroupSnapshotsTest-1811106974 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b44871b2-5bd4-4b98-90ba-222a38cc4cdf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94394) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 14:27:15 devstack sudo[102021]: pam_unix(sudo:session): session closed for user root Aug 26 14:27:15 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [req-f0ab8a2f-e777-4b95-9dcf-c5b1fb1d5b03 req-c1991d5a-38ec-471a-8288-6e744f509e36 tempest-VolumesSnapshotsTestJSON-910827177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-fc2c76e4-592a-4ec6-8bb5-b309307dba60.4d29c337-45c1-4493-9fa9-c7b35cdc1849" returned: 0 in 0.516s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:27:15 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[471d564d-ed69-4d3f-a72f-684462f30cc1]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:27:15 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-705bd5c6-af6c-4672-b026-5334737f0b49 tempest-GroupSnapshotsTest-1811106974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b44871b2-5bd4-4b98-90ba-222a38cc4cdf {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:27:15 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [req-f0ab8a2f-e777-4b95-9dcf-c5b1fb1d5b03 req-c1991d5a-38ec-471a-8288-6e744f509e36 tempest-VolumesSnapshotsTestJSON-910827177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-fc2c76e4-592a-4ec6-8bb5-b309307dba60.info {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:27:15 devstack sudo[102029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-fc2c76e4-592a-4ec6-8bb5-b309307dba60.info Aug 26 14:27:15 devstack sudo[102029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:27:15 devstack sudo[102028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b44871b2-5bd4-4b98-90ba-222a38cc4cdf Aug 26 14:27:15 devstack sudo[102028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:27:15 devstack sudo[102029]: pam_unix(sudo:session): session closed for user root Aug 26 14:27:15 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [req-f0ab8a2f-e777-4b95-9dcf-c5b1fb1d5b03 req-c1991d5a-38ec-471a-8288-6e744f509e36 tempest-VolumesSnapshotsTestJSON-910827177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-fc2c76e4-592a-4ec6-8bb5-b309307dba60.info" returned: 0 in 0.376s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:27:15 devstack cinder-volume[94394]: WARNING cinder.volume.drivers.remotefs [req-f0ab8a2f-e777-4b95-9dcf-c5b1fb1d5b03 req-c1991d5a-38ec-471a-8288-6e744f509e36 tempest-VolumesSnapshotsTestJSON-910827177 None] /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-fc2c76e4-592a-4ec6-8bb5-b309307dba60.info is being set with open permissions: ugo+rw Aug 26 14:27:15 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [req-f0ab8a2f-e777-4b95-9dcf-c5b1fb1d5b03 req-c1991d5a-38ec-471a-8288-6e744f509e36 tempest-VolumesSnapshotsTestJSON-910827177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-fc2c76e4-592a-4ec6-8bb5-b309307dba60.info {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:27:15 devstack sudo[102059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-fc2c76e4-592a-4ec6-8bb5-b309307dba60.info Aug 26 14:27:15 devstack sudo[102059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:27:15 devstack sudo[102028]: pam_unix(sudo:session): session closed for user root Aug 26 14:27:15 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-705bd5c6-af6c-4672-b026-5334737f0b49 tempest-GroupSnapshotsTest-1811106974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b44871b2-5bd4-4b98-90ba-222a38cc4cdf" returned: 0 in 0.528s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:27:15 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-705bd5c6-af6c-4672-b026-5334737f0b49 tempest-GroupSnapshotsTest-1811106974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b44871b2-5bd4-4b98-90ba-222a38cc4cdf.46bea4ec-fec0-4833-8a38-dcd39022a967 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:27:16 devstack sudo[102062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b44871b2-5bd4-4b98-90ba-222a38cc4cdf.46bea4ec-fec0-4833-8a38-dcd39022a967 Aug 26 14:27:16 devstack sudo[102062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:27:16 devstack sudo[102059]: pam_unix(sudo:session): session closed for user root Aug 26 14:27:16 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [req-f0ab8a2f-e777-4b95-9dcf-c5b1fb1d5b03 req-c1991d5a-38ec-471a-8288-6e744f509e36 tempest-VolumesSnapshotsTestJSON-910827177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-fc2c76e4-592a-4ec6-8bb5-b309307dba60.info" returned: 0 in 0.325s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:27:16 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [req-f0ab8a2f-e777-4b95-9dcf-c5b1fb1d5b03 req-c1991d5a-38ec-471a-8288-6e744f509e36 tempest-VolumesSnapshotsTestJSON-910827177 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.195s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:27:16 devstack cinder-volume[94394]: INFO cinder.volume.manager [req-f0ab8a2f-e777-4b95-9dcf-c5b1fb1d5b03 req-c1991d5a-38ec-471a-8288-6e744f509e36 tempest-VolumesSnapshotsTestJSON-910827177 None] Create snapshot completed successfully Aug 26 14:27:16 devstack cinder-volume[94394]: DEBUG cinder.coordination [req-dd69e8be-d341-4090-9337-d2bf54de0177 req-f67b9c73-e649-4781-9ac2-7adb4cc90a47 tempest-VolumesSnapshotsTestJSON-910827177 None] Acquiring lock "cinder-4d29c337-45c1-4493-9fa9-c7b35cdc1849-delete_snapshot" by "delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:27:16 devstack cinder-volume[94394]: DEBUG cinder.coordination [req-dd69e8be-d341-4090-9337-d2bf54de0177 req-f67b9c73-e649-4781-9ac2-7adb4cc90a47 tempest-VolumesSnapshotsTestJSON-910827177 None] Lock "cinder-4d29c337-45c1-4493-9fa9-c7b35cdc1849-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:27:16 devstack cinder-volume[94394]: DEBUG cinder.coordination [req-dd69e8be-d341-4090-9337-d2bf54de0177 req-f67b9c73-e649-4781-9ac2-7adb4cc90a47 tempest-VolumesSnapshotsTestJSON-910827177 None] Acquiring lock "cinder-quobyte-fc2c76e4-592a-4ec6-8bb5-b309307dba60" by "delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:27:16 devstack sudo[102062]: pam_unix(sudo:session): session closed for user root Aug 26 14:27:16 devstack cinder-volume[94394]: DEBUG cinder.coordination [req-dd69e8be-d341-4090-9337-d2bf54de0177 req-f67b9c73-e649-4781-9ac2-7adb4cc90a47 tempest-VolumesSnapshotsTestJSON-910827177 None] Lock "cinder-quobyte-fc2c76e4-592a-4ec6-8bb5-b309307dba60" acquired by "delete_snapshot" :: waited 0.030s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:27:16 devstack cinder-volume[94394]: DEBUG cinder.coordination [req-dd69e8be-d341-4090-9337-d2bf54de0177 req-f67b9c73-e649-4781-9ac2-7adb4cc90a47 tempest-VolumesSnapshotsTestJSON-910827177 None] Acquiring lock "cinder-quobyte-4d29c337-45c1-4493-9fa9-c7b35cdc1849" by "_delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:27:16 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-705bd5c6-af6c-4672-b026-5334737f0b49 tempest-GroupSnapshotsTest-1811106974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b44871b2-5bd4-4b98-90ba-222a38cc4cdf.46bea4ec-fec0-4833-8a38-dcd39022a967" returned: 0 in 0.595s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:27:16 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-705bd5c6-af6c-4672-b026-5334737f0b49 tempest-GroupSnapshotsTest-1811106974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b44871b2-5bd4-4b98-90ba-222a38cc4cdf.46bea4ec-fec0-4833-8a38-dcd39022a967 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:27:16 devstack cinder-volume[94394]: DEBUG cinder.coordination [req-dd69e8be-d341-4090-9337-d2bf54de0177 req-f67b9c73-e649-4781-9ac2-7adb4cc90a47 tempest-VolumesSnapshotsTestJSON-910827177 None] Lock "cinder-quobyte-4d29c337-45c1-4493-9fa9-c7b35cdc1849" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:27:16 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [req-dd69e8be-d341-4090-9337-d2bf54de0177 req-f67b9c73-e649-4781-9ac2-7adb4cc90a47 tempest-VolumesSnapshotsTestJSON-910827177 None] Deleting offline snapshot 4d29c337-45c1-4493-9fa9-c7b35cdc1849 of volume fc2c76e4-592a-4ec6-8bb5-b309307dba60 {{(pid=94394) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 14:27:16 devstack sudo[102070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b44871b2-5bd4-4b98-90ba-222a38cc4cdf.46bea4ec-fec0-4833-8a38-dcd39022a967 Aug 26 14:27:16 devstack sudo[102070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:27:16 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [req-dd69e8be-d341-4090-9337-d2bf54de0177 req-f67b9c73-e649-4781-9ac2-7adb4cc90a47 tempest-VolumesSnapshotsTestJSON-910827177 None] snapshot_file for this snap is: volume-fc2c76e4-592a-4ec6-8bb5-b309307dba60.4d29c337-45c1-4493-9fa9-c7b35cdc1849 {{(pid=94394) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 14:27:16 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed3ea65d-7d32-4392-bd78-4a1f4bc9c761]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:27:16 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [req-dd69e8be-d341-4090-9337-d2bf54de0177 req-f67b9c73-e649-4781-9ac2-7adb4cc90a47 tempest-VolumesSnapshotsTestJSON-910827177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-fc2c76e4-592a-4ec6-8bb5-b309307dba60.4d29c337-45c1-4493-9fa9-c7b35cdc1849 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:27:16 devstack sudo[102072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-fc2c76e4-592a-4ec6-8bb5-b309307dba60.4d29c337-45c1-4493-9fa9-c7b35cdc1849 Aug 26 14:27:16 devstack sudo[102072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:27:16 devstack sudo[102070]: pam_unix(sudo:session): session closed for user root Aug 26 14:27:16 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-705bd5c6-af6c-4672-b026-5334737f0b49 tempest-GroupSnapshotsTest-1811106974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b44871b2-5bd4-4b98-90ba-222a38cc4cdf.46bea4ec-fec0-4833-8a38-dcd39022a967" returned: 0 in 0.294s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:27:16 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-705bd5c6-af6c-4672-b026-5334737f0b49 tempest-GroupSnapshotsTest-1811106974 None] Lock "cinder-quobyte-46bea4ec-fec0-4833-8a38-dcd39022a967" released by "_delete_snapshot" :: held 2.183s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:27:16 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-705bd5c6-af6c-4672-b026-5334737f0b49 tempest-GroupSnapshotsTest-1811106974 None] Lock "cinder-quobyte-b44871b2-5bd4-4b98-90ba-222a38cc4cdf" released by "delete_snapshot" :: held 2.217s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:27:16 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-705bd5c6-af6c-4672-b026-5334737f0b49 tempest-GroupSnapshotsTest-1811106974 None] Acquiring lock "cinder-quobyte-2faed028-96f9-4b02-9b1e-ad8327a75340" by "delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:27:16 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-705bd5c6-af6c-4672-b026-5334737f0b49 tempest-GroupSnapshotsTest-1811106974 None] Lock "cinder-quobyte-2faed028-96f9-4b02-9b1e-ad8327a75340" acquired by "delete_snapshot" :: waited 0.025s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:27:16 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-705bd5c6-af6c-4672-b026-5334737f0b49 tempest-GroupSnapshotsTest-1811106974 None] Acquiring lock "cinder-quobyte-b6fa13ce-7a0c-4b20-8fa3-211acef71e54" by "_delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:27:17 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-705bd5c6-af6c-4672-b026-5334737f0b49 tempest-GroupSnapshotsTest-1811106974 None] Lock "cinder-quobyte-b6fa13ce-7a0c-4b20-8fa3-211acef71e54" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:27:17 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-705bd5c6-af6c-4672-b026-5334737f0b49 tempest-GroupSnapshotsTest-1811106974 None] Deleting offline snapshot b6fa13ce-7a0c-4b20-8fa3-211acef71e54 of volume 2faed028-96f9-4b02-9b1e-ad8327a75340 {{(pid=94394) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 14:27:17 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-705bd5c6-af6c-4672-b026-5334737f0b49 tempest-GroupSnapshotsTest-1811106974 None] snapshot_file for this snap is: volume-2faed028-96f9-4b02-9b1e-ad8327a75340.b6fa13ce-7a0c-4b20-8fa3-211acef71e54 {{(pid=94394) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 14:27:17 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ef4a9b5-9fb0-4a9a-b867-9e570649eca9]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:27:17 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-705bd5c6-af6c-4672-b026-5334737f0b49 tempest-GroupSnapshotsTest-1811106974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2faed028-96f9-4b02-9b1e-ad8327a75340.b6fa13ce-7a0c-4b20-8fa3-211acef71e54 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:27:17 devstack sudo[102072]: pam_unix(sudo:session): session closed for user root Aug 26 14:27:17 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [req-dd69e8be-d341-4090-9337-d2bf54de0177 req-f67b9c73-e649-4781-9ac2-7adb4cc90a47 tempest-VolumesSnapshotsTestJSON-910827177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-fc2c76e4-592a-4ec6-8bb5-b309307dba60.4d29c337-45c1-4493-9fa9-c7b35cdc1849" returned: 0 in 0.513s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:27:17 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [req-dd69e8be-d341-4090-9337-d2bf54de0177 req-f67b9c73-e649-4781-9ac2-7adb4cc90a47 tempest-VolumesSnapshotsTestJSON-910827177 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fc2c76e4-592a-4ec6-8bb5-b309307dba60(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94394) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 14:27:17 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[80ac4b53-0c94-4ef9-b35c-b4d02ffe0ca1]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:27:17 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [req-dd69e8be-d341-4090-9337-d2bf54de0177 req-f67b9c73-e649-4781-9ac2-7adb4cc90a47 tempest-VolumesSnapshotsTestJSON-910827177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-fc2c76e4-592a-4ec6-8bb5-b309307dba60 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:27:17 devstack sudo[102077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2faed028-96f9-4b02-9b1e-ad8327a75340.b6fa13ce-7a0c-4b20-8fa3-211acef71e54 Aug 26 14:27:17 devstack sudo[102077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:27:17 devstack sudo[102079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-fc2c76e4-592a-4ec6-8bb5-b309307dba60 Aug 26 14:27:17 devstack sudo[102079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:27:17 devstack sudo[102077]: pam_unix(sudo:session): session closed for user root Aug 26 14:27:17 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-705bd5c6-af6c-4672-b026-5334737f0b49 tempest-GroupSnapshotsTest-1811106974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2faed028-96f9-4b02-9b1e-ad8327a75340.b6fa13ce-7a0c-4b20-8fa3-211acef71e54" returned: 0 in 0.551s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:27:17 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-705bd5c6-af6c-4672-b026-5334737f0b49 tempest-GroupSnapshotsTest-1811106974 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2faed028-96f9-4b02-9b1e-ad8327a75340(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94394) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 14:27:17 devstack sudo[102079]: pam_unix(sudo:session): session closed for user root Aug 26 14:27:17 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [req-dd69e8be-d341-4090-9337-d2bf54de0177 req-f67b9c73-e649-4781-9ac2-7adb4cc90a47 tempest-VolumesSnapshotsTestJSON-910827177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-fc2c76e4-592a-4ec6-8bb5-b309307dba60" returned: 0 in 0.440s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:27:17 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[41550457-79b0-4704-86d3-d722586bd8ce]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:27:17 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [req-dd69e8be-d341-4090-9337-d2bf54de0177 req-f67b9c73-e649-4781-9ac2-7adb4cc90a47 tempest-VolumesSnapshotsTestJSON-910827177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-fc2c76e4-592a-4ec6-8bb5-b309307dba60.4d29c337-45c1-4493-9fa9-c7b35cdc1849 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:27:17 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-705bd5c6-af6c-4672-b026-5334737f0b49 tempest-GroupSnapshotsTest-1811106974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2faed028-96f9-4b02-9b1e-ad8327a75340 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:27:17 devstack sudo[102088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-fc2c76e4-592a-4ec6-8bb5-b309307dba60.4d29c337-45c1-4493-9fa9-c7b35cdc1849 Aug 26 14:27:17 devstack sudo[102088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:27:17 devstack sudo[102089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2faed028-96f9-4b02-9b1e-ad8327a75340 Aug 26 14:27:17 devstack sudo[102089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:27:18 devstack sudo[102088]: pam_unix(sudo:session): session closed for user root Aug 26 14:27:18 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [req-dd69e8be-d341-4090-9337-d2bf54de0177 req-f67b9c73-e649-4781-9ac2-7adb4cc90a47 tempest-VolumesSnapshotsTestJSON-910827177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-fc2c76e4-592a-4ec6-8bb5-b309307dba60.4d29c337-45c1-4493-9fa9-c7b35cdc1849" returned: 0 in 0.404s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:27:18 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [req-dd69e8be-d341-4090-9337-d2bf54de0177 req-f67b9c73-e649-4781-9ac2-7adb4cc90a47 tempest-VolumesSnapshotsTestJSON-910827177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-fc2c76e4-592a-4ec6-8bb5-b309307dba60.4d29c337-45c1-4493-9fa9-c7b35cdc1849 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:27:18 devstack sudo[102096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-fc2c76e4-592a-4ec6-8bb5-b309307dba60.4d29c337-45c1-4493-9fa9-c7b35cdc1849 Aug 26 14:27:18 devstack sudo[102096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:27:18 devstack sudo[102089]: pam_unix(sudo:session): session closed for user root Aug 26 14:27:18 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-705bd5c6-af6c-4672-b026-5334737f0b49 tempest-GroupSnapshotsTest-1811106974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2faed028-96f9-4b02-9b1e-ad8327a75340" returned: 0 in 0.497s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:27:18 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-705bd5c6-af6c-4672-b026-5334737f0b49 tempest-GroupSnapshotsTest-1811106974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2faed028-96f9-4b02-9b1e-ad8327a75340.b6fa13ce-7a0c-4b20-8fa3-211acef71e54 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:27:18 devstack sudo[102101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2faed028-96f9-4b02-9b1e-ad8327a75340.b6fa13ce-7a0c-4b20-8fa3-211acef71e54 Aug 26 14:27:18 devstack sudo[102101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:27:18 devstack sudo[102096]: pam_unix(sudo:session): session closed for user root Aug 26 14:27:18 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [req-dd69e8be-d341-4090-9337-d2bf54de0177 req-f67b9c73-e649-4781-9ac2-7adb4cc90a47 tempest-VolumesSnapshotsTestJSON-910827177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-fc2c76e4-592a-4ec6-8bb5-b309307dba60.4d29c337-45c1-4493-9fa9-c7b35cdc1849" returned: 0 in 0.373s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:27:18 devstack cinder-volume[94394]: DEBUG cinder.coordination [req-dd69e8be-d341-4090-9337-d2bf54de0177 req-f67b9c73-e649-4781-9ac2-7adb4cc90a47 tempest-VolumesSnapshotsTestJSON-910827177 None] Lock "cinder-quobyte-4d29c337-45c1-4493-9fa9-c7b35cdc1849" released by "_delete_snapshot" :: held 1.856s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:27:18 devstack cinder-volume[94394]: DEBUG cinder.coordination [req-dd69e8be-d341-4090-9337-d2bf54de0177 req-f67b9c73-e649-4781-9ac2-7adb4cc90a47 tempest-VolumesSnapshotsTestJSON-910827177 None] Lock "cinder-quobyte-fc2c76e4-592a-4ec6-8bb5-b309307dba60" released by "delete_snapshot" :: held 1.914s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:27:18 devstack cinder-volume[94394]: WARNING cinder.quota [req-dd69e8be-d341-4090-9337-d2bf54de0177 req-f67b9c73-e649-4781-9ac2-7adb4cc90a47 tempest-VolumesSnapshotsTestJSON-910827177 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Aug 26 14:27:18 devstack cinder-volume[94394]: DEBUG cinder.quota [req-dd69e8be-d341-4090-9337-d2bf54de0177 req-f67b9c73-e649-4781-9ac2-7adb4cc90a47 tempest-VolumesSnapshotsTestJSON-910827177 None] Created reservations ['dc7ecb5f-2d5f-4b2b-bd60-b35cf6ae0149', '84e9dca0-0c66-4382-8565-6d244a6ace4f', '24511650-75ff-4203-9e53-f89c60370cff', '4ad8a7c0-cf73-4b13-adeb-2196caf13b2a'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:27:18 devstack sudo[102101]: pam_unix(sudo:session): session closed for user root Aug 26 14:27:18 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-705bd5c6-af6c-4672-b026-5334737f0b49 tempest-GroupSnapshotsTest-1811106974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2faed028-96f9-4b02-9b1e-ad8327a75340.b6fa13ce-7a0c-4b20-8fa3-211acef71e54" returned: 0 in 0.413s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:27:18 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-705bd5c6-af6c-4672-b026-5334737f0b49 tempest-GroupSnapshotsTest-1811106974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2faed028-96f9-4b02-9b1e-ad8327a75340.b6fa13ce-7a0c-4b20-8fa3-211acef71e54 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:27:18 devstack sudo[102108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2faed028-96f9-4b02-9b1e-ad8327a75340.b6fa13ce-7a0c-4b20-8fa3-211acef71e54 Aug 26 14:27:18 devstack sudo[102108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:27:18 devstack cinder-volume[94394]: INFO cinder.volume.manager [req-dd69e8be-d341-4090-9337-d2bf54de0177 req-f67b9c73-e649-4781-9ac2-7adb4cc90a47 tempest-VolumesSnapshotsTestJSON-910827177 None] Delete snapshot completed successfully. Aug 26 14:27:18 devstack cinder-volume[94394]: DEBUG cinder.coordination [req-dd69e8be-d341-4090-9337-d2bf54de0177 req-f67b9c73-e649-4781-9ac2-7adb4cc90a47 tempest-VolumesSnapshotsTestJSON-910827177 None] Lock "cinder-4d29c337-45c1-4493-9fa9-c7b35cdc1849-delete_snapshot" released by "delete_snapshot" :: held 2.158s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:27:18 devstack cinder-volume[94394]: DEBUG cinder.coordination [req-7351f513-6cf8-4ae4-a5de-1c4cc15f26a1 req-33ac3d9b-b75a-4de1-b91e-ea42c080a1a1 tempest-VolumesSnapshotsTestJSON-910827177 None] Acquiring lock "cinder-fc2c76e4-592a-4ec6-8bb5-b309307dba60-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:27:18 devstack cinder-volume[94394]: DEBUG cinder.coordination [req-7351f513-6cf8-4ae4-a5de-1c4cc15f26a1 req-33ac3d9b-b75a-4de1-b91e-ea42c080a1a1 tempest-VolumesSnapshotsTestJSON-910827177 None] Lock "cinder-fc2c76e4-592a-4ec6-8bb5-b309307dba60-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:27:18 devstack cinder-volume[94394]: DEBUG cinder.coordination [req-7351f513-6cf8-4ae4-a5de-1c4cc15f26a1 req-33ac3d9b-b75a-4de1-b91e-ea42c080a1a1 tempest-VolumesSnapshotsTestJSON-910827177 None] Acquiring lock "cinder-quobyte-fc2c76e4-592a-4ec6-8bb5-b309307dba60" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:27:18 devstack cinder-volume[94394]: DEBUG cinder.coordination [req-7351f513-6cf8-4ae4-a5de-1c4cc15f26a1 req-33ac3d9b-b75a-4de1-b91e-ea42c080a1a1 tempest-VolumesSnapshotsTestJSON-910827177 None] Lock "cinder-quobyte-fc2c76e4-592a-4ec6-8bb5-b309307dba60" acquired by "delete_volume" :: waited 0.022s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:27:19 devstack sudo[102108]: pam_unix(sudo:session): session closed for user root Aug 26 14:27:19 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-705bd5c6-af6c-4672-b026-5334737f0b49 tempest-GroupSnapshotsTest-1811106974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2faed028-96f9-4b02-9b1e-ad8327a75340.b6fa13ce-7a0c-4b20-8fa3-211acef71e54" returned: 0 in 0.461s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:27:19 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d7dd1af-4cc6-4dba-ba0d-2dd403aec24e]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:27:19 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [req-7351f513-6cf8-4ae4-a5de-1c4cc15f26a1 req-33ac3d9b-b75a-4de1-b91e-ea42c080a1a1 tempest-VolumesSnapshotsTestJSON-910827177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-fc2c76e4-592a-4ec6-8bb5-b309307dba60 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:27:19 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-705bd5c6-af6c-4672-b026-5334737f0b49 tempest-GroupSnapshotsTest-1811106974 None] Lock "cinder-quobyte-b6fa13ce-7a0c-4b20-8fa3-211acef71e54" released by "_delete_snapshot" :: held 2.078s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:27:19 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-705bd5c6-af6c-4672-b026-5334737f0b49 tempest-GroupSnapshotsTest-1811106974 None] Lock "cinder-quobyte-2faed028-96f9-4b02-9b1e-ad8327a75340" released by "delete_snapshot" :: held 2.127s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:27:19 devstack cinder-volume[94394]: WARNING cinder.quota [None req-705bd5c6-af6c-4672-b026-5334737f0b49 tempest-GroupSnapshotsTest-1811106974 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1905176401 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1905176401, it is now deprecated. Please use the default quota class for default quota. Aug 26 14:27:19 devstack cinder-volume[94394]: WARNING cinder.quota [None req-705bd5c6-af6c-4672-b026-5334737f0b49 tempest-GroupSnapshotsTest-1811106974 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1905176401 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1905176401, it is now deprecated. Please use the default quota class for default quota. Aug 26 14:27:19 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-705bd5c6-af6c-4672-b026-5334737f0b49 tempest-GroupSnapshotsTest-1811106974 None] Created reservations ['f590afd0-daa0-4442-84f1-f78a7610e2e5', 'c3d30c26-a8ad-489a-b069-8a9c6d257e46', '9f82aef8-75a8-4b10-8396-c48b6835c08f', '930f2981-7c7d-4507-b15d-421d9ee5d09a'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:27:19 devstack sudo[102113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-fc2c76e4-592a-4ec6-8bb5-b309307dba60 Aug 26 14:27:19 devstack sudo[102113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:27:19 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-705bd5c6-af6c-4672-b026-5334737f0b49 tempest-GroupSnapshotsTest-1811106974 None] Created reservations ['84a61563-9ba5-4f18-a5c8-ca7a795317ec', '9bb7f3b1-4968-4882-8812-d3508dc34c57', '2321496a-bbd2-49cc-a86b-a04c393f7fdf', 'cb66000d-67a5-46ce-be09-9662486030de'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:27:19 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-705bd5c6-af6c-4672-b026-5334737f0b49 tempest-GroupSnapshotsTest-1811106974 None] group_snapshot 68122192-bc66-41bc-b449-8659220519c3: deleted successfully Aug 26 14:27:19 devstack sudo[102113]: pam_unix(sudo:session): session closed for user root Aug 26 14:27:19 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [req-7351f513-6cf8-4ae4-a5de-1c4cc15f26a1 req-33ac3d9b-b75a-4de1-b91e-ea42c080a1a1 tempest-VolumesSnapshotsTestJSON-910827177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-fc2c76e4-592a-4ec6-8bb5-b309307dba60" returned: 0 in 0.534s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:27:19 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [req-7351f513-6cf8-4ae4-a5de-1c4cc15f26a1 req-33ac3d9b-b75a-4de1-b91e-ea42c080a1a1 tempest-VolumesSnapshotsTestJSON-910827177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-fc2c76e4-592a-4ec6-8bb5-b309307dba60 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:27:19 devstack sudo[102118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-fc2c76e4-592a-4ec6-8bb5-b309307dba60 Aug 26 14:27:19 devstack sudo[102118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:27:19 devstack sudo[102118]: pam_unix(sudo:session): session closed for user root Aug 26 14:27:19 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [req-7351f513-6cf8-4ae4-a5de-1c4cc15f26a1 req-33ac3d9b-b75a-4de1-b91e-ea42c080a1a1 tempest-VolumesSnapshotsTestJSON-910827177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-fc2c76e4-592a-4ec6-8bb5-b309307dba60" returned: 0 in 0.255s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:27:19 devstack cinder-volume[94394]: DEBUG cinder.coordination [req-7351f513-6cf8-4ae4-a5de-1c4cc15f26a1 req-33ac3d9b-b75a-4de1-b91e-ea42c080a1a1 tempest-VolumesSnapshotsTestJSON-910827177 None] Lock "cinder-quobyte-fc2c76e4-592a-4ec6-8bb5-b309307dba60" released by "delete_volume" :: held 0.884s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:27:19 devstack cinder-volume[94394]: DEBUG cinder.quota [req-7351f513-6cf8-4ae4-a5de-1c4cc15f26a1 req-33ac3d9b-b75a-4de1-b91e-ea42c080a1a1 tempest-VolumesSnapshotsTestJSON-910827177 None] Created reservations ['fe7b5680-9f53-4dd3-8f3f-ddc1b0d66532', 'b67a0ef2-26f8-4828-a5a2-37a0a8ac1281', '1663a053-7f18-44b3-9030-0cf5c832ad6e', '8e77870e-c495-40ff-8973-8c376ed3eec2'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:27:20 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [req-7351f513-6cf8-4ae4-a5de-1c4cc15f26a1 req-33ac3d9b-b75a-4de1-b91e-ea42c080a1a1 tempest-VolumesSnapshotsTestJSON-910827177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:27:20 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [req-7351f513-6cf8-4ae4-a5de-1c4cc15f26a1 req-33ac3d9b-b75a-4de1-b91e-ea42c080a1a1 tempest-VolumesSnapshotsTestJSON-910827177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:27:20 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [req-7351f513-6cf8-4ae4-a5de-1c4cc15f26a1 req-33ac3d9b-b75a-4de1-b91e-ea42c080a1a1 tempest-VolumesSnapshotsTestJSON-910827177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:27:20 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [req-7351f513-6cf8-4ae4-a5de-1c4cc15f26a1 req-33ac3d9b-b75a-4de1-b91e-ea42c080a1a1 tempest-VolumesSnapshotsTestJSON-910827177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:27:20 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [req-7351f513-6cf8-4ae4-a5de-1c4cc15f26a1 req-33ac3d9b-b75a-4de1-b91e-ea42c080a1a1 tempest-VolumesSnapshotsTestJSON-910827177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:27:20 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [req-7351f513-6cf8-4ae4-a5de-1c4cc15f26a1 req-33ac3d9b-b75a-4de1-b91e-ea42c080a1a1 tempest-VolumesSnapshotsTestJSON-910827177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:27:20 devstack sudo[102122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:27:20 devstack sudo[102122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:27:20 devstack sudo[102122]: pam_unix(sudo:session): session closed for user root Aug 26 14:27:20 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [req-7351f513-6cf8-4ae4-a5de-1c4cc15f26a1 req-33ac3d9b-b75a-4de1-b91e-ea42c080a1a1 tempest-VolumesSnapshotsTestJSON-910827177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.279s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:27:20 devstack cinder-volume[94394]: DEBUG cinder.manager [req-7351f513-6cf8-4ae4-a5de-1c4cc15f26a1 req-33ac3d9b-b75a-4de1-b91e-ea42c080a1a1 tempest-VolumesSnapshotsTestJSON-910827177 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:27:20 devstack cinder-volume[94394]: INFO cinder.volume.manager [req-7351f513-6cf8-4ae4-a5de-1c4cc15f26a1 req-33ac3d9b-b75a-4de1-b91e-ea42c080a1a1 tempest-VolumesSnapshotsTestJSON-910827177 None] Deleted volume successfully. Aug 26 14:27:20 devstack cinder-volume[94394]: DEBUG cinder.coordination [req-7351f513-6cf8-4ae4-a5de-1c4cc15f26a1 req-33ac3d9b-b75a-4de1-b91e-ea42c080a1a1 tempest-VolumesSnapshotsTestJSON-910827177 None] Lock "cinder-fc2c76e4-592a-4ec6-8bb5-b309307dba60-delete_volume" released by "delete_volume" :: held 1.437s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:27:20 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-573f3560-204e-4272-a1ab-3d42a8e6af15 tempest-GroupSnapshotsTest-1811106974 None] Acquiring lock "cinder-quobyte-2faed028-96f9-4b02-9b1e-ad8327a75340" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:27:21 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-573f3560-204e-4272-a1ab-3d42a8e6af15 tempest-GroupSnapshotsTest-1811106974 None] Lock "cinder-quobyte-2faed028-96f9-4b02-9b1e-ad8327a75340" acquired by "delete_volume" :: waited 0.049s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:27:21 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bf0878b-fb53-4f25-8ed0-b5c443863e4a]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:27:21 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-573f3560-204e-4272-a1ab-3d42a8e6af15 tempest-GroupSnapshotsTest-1811106974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2faed028-96f9-4b02-9b1e-ad8327a75340 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:27:21 devstack sudo[102126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2faed028-96f9-4b02-9b1e-ad8327a75340 Aug 26 14:27:21 devstack sudo[102126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:27:21 devstack sudo[102126]: pam_unix(sudo:session): session closed for user root Aug 26 14:27:21 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-573f3560-204e-4272-a1ab-3d42a8e6af15 tempest-GroupSnapshotsTest-1811106974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2faed028-96f9-4b02-9b1e-ad8327a75340" returned: 0 in 0.412s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:27:21 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-573f3560-204e-4272-a1ab-3d42a8e6af15 tempest-GroupSnapshotsTest-1811106974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2faed028-96f9-4b02-9b1e-ad8327a75340 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:27:21 devstack sudo[102131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2faed028-96f9-4b02-9b1e-ad8327a75340 Aug 26 14:27:21 devstack sudo[102131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:27:21 devstack sudo[102131]: pam_unix(sudo:session): session closed for user root Aug 26 14:27:21 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-573f3560-204e-4272-a1ab-3d42a8e6af15 tempest-GroupSnapshotsTest-1811106974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2faed028-96f9-4b02-9b1e-ad8327a75340" returned: 0 in 0.352s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:27:21 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-573f3560-204e-4272-a1ab-3d42a8e6af15 tempest-GroupSnapshotsTest-1811106974 None] Lock "cinder-quobyte-2faed028-96f9-4b02-9b1e-ad8327a75340" released by "delete_volume" :: held 0.860s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:27:21 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-573f3560-204e-4272-a1ab-3d42a8e6af15 tempest-GroupSnapshotsTest-1811106974 None] Acquiring lock "cinder-quobyte-b44871b2-5bd4-4b98-90ba-222a38cc4cdf" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:27:21 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-573f3560-204e-4272-a1ab-3d42a8e6af15 tempest-GroupSnapshotsTest-1811106974 None] Lock "cinder-quobyte-b44871b2-5bd4-4b98-90ba-222a38cc4cdf" acquired by "delete_volume" :: waited 0.028s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:27:21 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[712df1c4-1bab-4033-8854-6897f685b033]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:27:21 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-573f3560-204e-4272-a1ab-3d42a8e6af15 tempest-GroupSnapshotsTest-1811106974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b44871b2-5bd4-4b98-90ba-222a38cc4cdf {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:27:22 devstack sudo[102142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b44871b2-5bd4-4b98-90ba-222a38cc4cdf Aug 26 14:27:22 devstack sudo[102142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:27:22 devstack sudo[102142]: pam_unix(sudo:session): session closed for user root Aug 26 14:27:22 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-573f3560-204e-4272-a1ab-3d42a8e6af15 tempest-GroupSnapshotsTest-1811106974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b44871b2-5bd4-4b98-90ba-222a38cc4cdf" returned: 0 in 0.667s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:27:22 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-573f3560-204e-4272-a1ab-3d42a8e6af15 tempest-GroupSnapshotsTest-1811106974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b44871b2-5bd4-4b98-90ba-222a38cc4cdf {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:27:22 devstack sudo[102148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b44871b2-5bd4-4b98-90ba-222a38cc4cdf Aug 26 14:27:22 devstack sudo[102148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:27:22 devstack sudo[102148]: pam_unix(sudo:session): session closed for user root Aug 26 14:27:22 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-573f3560-204e-4272-a1ab-3d42a8e6af15 tempest-GroupSnapshotsTest-1811106974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b44871b2-5bd4-4b98-90ba-222a38cc4cdf" returned: 0 in 0.325s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:27:22 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-573f3560-204e-4272-a1ab-3d42a8e6af15 tempest-GroupSnapshotsTest-1811106974 None] Lock "cinder-quobyte-b44871b2-5bd4-4b98-90ba-222a38cc4cdf" released by "delete_volume" :: held 1.077s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:27:22 devstack cinder-volume[94394]: DEBUG dbcounter [-] [94394] Writing DB stats cinder:SELECT=108,cinder:UPDATE=112,cinder:INSERT=23,cinder:DELETE=4 {{(pid=94394) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 14:27:22 devstack cinder-volume[94394]: DEBUG dbcounter [-] [94394] Writing DB stats cinder:SELECT=127,cinder:UPDATE=100,cinder:DELETE=6,cinder:INSERT=26 {{(pid=94394) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 14:27:23 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-573f3560-204e-4272-a1ab-3d42a8e6af15 tempest-GroupSnapshotsTest-1811106974 None] Created reservations ['435ccef8-6886-4cb9-8b00-df035e81a31e'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:27:23 devstack cinder-volume[94394]: WARNING cinder.quota [None req-573f3560-204e-4272-a1ab-3d42a8e6af15 tempest-GroupSnapshotsTest-1811106974 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1905176401 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1905176401, it is now deprecated. Please use the default quota class for default quota. Aug 26 14:27:23 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-573f3560-204e-4272-a1ab-3d42a8e6af15 tempest-GroupSnapshotsTest-1811106974 None] Created reservations ['0d8939dd-5d9a-4061-ad1e-2e6285974aaa', '9a43d6f4-e265-4d4a-a67c-4dcf054c1d51', '4be6c54a-79c3-43e2-a82d-f4fd44097d3c', 'ed366687-9484-42d0-8f61-70c746476e9e'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:27:23 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-573f3560-204e-4272-a1ab-3d42a8e6af15 tempest-GroupSnapshotsTest-1811106974 None] Created reservations ['3e608138-60b7-457e-92f2-4ac4d61b2ced', 'e3ad5883-3752-4e7e-902d-76f339c14746', 'ee76fb02-9e9b-45ae-a0ab-fad5c95227f9', '8dbaf838-cf94-4676-b148-371fe29dd6e6'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:27:23 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-573f3560-204e-4272-a1ab-3d42a8e6af15 tempest-GroupSnapshotsTest-1811106974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:27:23 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-573f3560-204e-4272-a1ab-3d42a8e6af15 tempest-GroupSnapshotsTest-1811106974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:27:23 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-573f3560-204e-4272-a1ab-3d42a8e6af15 tempest-GroupSnapshotsTest-1811106974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:27:23 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-573f3560-204e-4272-a1ab-3d42a8e6af15 tempest-GroupSnapshotsTest-1811106974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:27:23 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-573f3560-204e-4272-a1ab-3d42a8e6af15 tempest-GroupSnapshotsTest-1811106974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:27:23 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-573f3560-204e-4272-a1ab-3d42a8e6af15 tempest-GroupSnapshotsTest-1811106974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:27:23 devstack sudo[102185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:27:23 devstack sudo[102185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:27:23 devstack sudo[102185]: pam_unix(sudo:session): session closed for user root Aug 26 14:27:23 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-573f3560-204e-4272-a1ab-3d42a8e6af15 tempest-GroupSnapshotsTest-1811106974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.533s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:27:23 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-573f3560-204e-4272-a1ab-3d42a8e6af15 tempest-GroupSnapshotsTest-1811106974 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:27:23 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-573f3560-204e-4272-a1ab-3d42a8e6af15 tempest-GroupSnapshotsTest-1811106974 None] Delete group completed successfully. Aug 26 14:27:24 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-a2e1be86-77c6-46a6-b32b-97d6355ac082 tempest-GroupSnapshotsTest-1811106974 None] Group tempest-GroupSnapshotsTest-Group-954002548: creating Aug 26 14:27:24 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-a2e1be86-77c6-46a6-b32b-97d6355ac082 tempest-GroupSnapshotsTest-1811106974 None] Group tempest-GroupSnapshotsTest-Group-954002548: created successfully Aug 26 14:27:24 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-a2e1be86-77c6-46a6-b32b-97d6355ac082 tempest-GroupSnapshotsTest-1811106974 None] Create group completed successfully. Aug 26 14:27:25 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [req-a390b0a0-f456-441b-b192-71b3bbc07eab req-63191332-870d-4603-b161-aa6e6e03c62a tempest-VolumesGetTestJSON-547743457 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:27:25 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [req-a390b0a0-f456-441b-b192-71b3bbc07eab req-63191332-870d-4603-b161-aa6e6e03c62a tempest-VolumesGetTestJSON-547743457 None] Flow 'volume_create_manager' (5a7776bc-15fb-4a1a-8e57-a7a782f2523f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:27:25 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [req-a390b0a0-f456-441b-b192-71b3bbc07eab req-63191332-870d-4603-b161-aa6e6e03c62a tempest-VolumesGetTestJSON-547743457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76343f3e-38f3-48df-ac24-547555ad5ca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:27:25 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [req-a390b0a0-f456-441b-b192-71b3bbc07eab req-63191332-870d-4603-b161-aa6e6e03c62a tempest-VolumesGetTestJSON-547743457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76343f3e-38f3-48df-ac24-547555ad5ca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:27:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1152105036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0da164a-2663-4aa1-a423-d5c9b8c9a504,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b003543c97db4ed9b3f8f420d2b85215',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:27:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:27:25Z,use_quota=True,user_id='906e54e871e94ae282ac6317af7f4f4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:27:25 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [req-a390b0a0-f456-441b-b192-71b3bbc07eab req-63191332-870d-4603-b161-aa6e6e03c62a tempest-VolumesGetTestJSON-547743457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11a0ef64-90a7-47c5-9a1c-f01be55c644c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:27:25 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [req-a390b0a0-f456-441b-b192-71b3bbc07eab req-63191332-870d-4603-b161-aa6e6e03c62a tempest-VolumesGetTestJSON-547743457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11a0ef64-90a7-47c5-9a1c-f01be55c644c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:27:25 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [req-a390b0a0-f456-441b-b192-71b3bbc07eab req-63191332-870d-4603-b161-aa6e6e03c62a tempest-VolumesGetTestJSON-547743457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15d8485c-5707-4e61-8ec3-2ed27893bd60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:27:25 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [req-a390b0a0-f456-441b-b192-71b3bbc07eab req-63191332-870d-4603-b161-aa6e6e03c62a tempest-VolumesGetTestJSON-547743457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15d8485c-5707-4e61-8ec3-2ed27893bd60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0da164a-2663-4aa1-a423-d5c9b8c9a504', 'volume_name': 'volume-f0da164a-2663-4aa1-a423-d5c9b8c9a504', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:27:25 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [req-a390b0a0-f456-441b-b192-71b3bbc07eab req-63191332-870d-4603-b161-aa6e6e03c62a tempest-VolumesGetTestJSON-547743457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a32d9b9-3575-4443-b0a3-35ab4c613738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:27:25 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [req-a390b0a0-f456-441b-b192-71b3bbc07eab req-63191332-870d-4603-b161-aa6e6e03c62a tempest-VolumesGetTestJSON-547743457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a32d9b9-3575-4443-b0a3-35ab4c613738) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:27:25 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [req-a390b0a0-f456-441b-b192-71b3bbc07eab req-63191332-870d-4603-b161-aa6e6e03c62a tempest-VolumesGetTestJSON-547743457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5164436-8f2f-48fa-972b-a1c1531846c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:27:25 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [req-a390b0a0-f456-441b-b192-71b3bbc07eab req-63191332-870d-4603-b161-aa6e6e03c62a tempest-VolumesGetTestJSON-547743457 None] Volume f0da164a-2663-4aa1-a423-d5c9b8c9a504: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0da164a-2663-4aa1-a423-d5c9b8c9a504', 'volume_size': 1} Aug 26 14:27:25 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [req-a390b0a0-f456-441b-b192-71b3bbc07eab req-63191332-870d-4603-b161-aa6e6e03c62a tempest-VolumesGetTestJSON-547743457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:27:25 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [req-a390b0a0-f456-441b-b192-71b3bbc07eab req-63191332-870d-4603-b161-aa6e6e03c62a tempest-VolumesGetTestJSON-547743457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:27:25 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [req-a390b0a0-f456-441b-b192-71b3bbc07eab req-63191332-870d-4603-b161-aa6e6e03c62a tempest-VolumesGetTestJSON-547743457 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:27:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1152105036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0da164a-2663-4aa1-a423-d5c9b8c9a504,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b003543c97db4ed9b3f8f420d2b85215',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:27:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:27:25Z,use_quota=True,user_id='906e54e871e94ae282ac6317af7f4f4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:27:25 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [req-a390b0a0-f456-441b-b192-71b3bbc07eab req-63191332-870d-4603-b161-aa6e6e03c62a tempest-VolumesGetTestJSON-547743457 None] Creating volume f0da164a-2663-4aa1-a423-d5c9b8c9a504 {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:27:25 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [req-a390b0a0-f456-441b-b192-71b3bbc07eab req-63191332-870d-4603-b161-aa6e6e03c62a tempest-VolumesGetTestJSON-547743457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:27:25 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [req-a390b0a0-f456-441b-b192-71b3bbc07eab req-63191332-870d-4603-b161-aa6e6e03c62a tempest-VolumesGetTestJSON-547743457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:27:25 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [req-a390b0a0-f456-441b-b192-71b3bbc07eab req-63191332-870d-4603-b161-aa6e6e03c62a tempest-VolumesGetTestJSON-547743457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:27:25 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [req-a390b0a0-f456-441b-b192-71b3bbc07eab req-63191332-870d-4603-b161-aa6e6e03c62a tempest-VolumesGetTestJSON-547743457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:27:25 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [req-a390b0a0-f456-441b-b192-71b3bbc07eab req-63191332-870d-4603-b161-aa6e6e03c62a tempest-VolumesGetTestJSON-547743457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:27:25 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [req-a390b0a0-f456-441b-b192-71b3bbc07eab req-63191332-870d-4603-b161-aa6e6e03c62a tempest-VolumesGetTestJSON-547743457 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:27:25 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [req-a390b0a0-f456-441b-b192-71b3bbc07eab req-63191332-870d-4603-b161-aa6e6e03c62a tempest-VolumesGetTestJSON-547743457 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:27:25 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [req-a390b0a0-f456-441b-b192-71b3bbc07eab req-63191332-870d-4603-b161-aa6e6e03c62a tempest-VolumesGetTestJSON-547743457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-f0da164a-2663-4aa1-a423-d5c9b8c9a504 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:27:25 devstack sudo[102207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-f0da164a-2663-4aa1-a423-d5c9b8c9a504 1073741824 Aug 26 14:27:25 devstack sudo[102207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:27:25 devstack sudo[102207]: pam_unix(sudo:session): session closed for user root Aug 26 14:27:25 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [req-a390b0a0-f456-441b-b192-71b3bbc07eab req-63191332-870d-4603-b161-aa6e6e03c62a tempest-VolumesGetTestJSON-547743457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-f0da164a-2663-4aa1-a423-d5c9b8c9a504 1073741824" returned: 0 in 0.467s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:27:25 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [req-a390b0a0-f456-441b-b192-71b3bbc07eab req-63191332-870d-4603-b161-aa6e6e03c62a tempest-VolumesGetTestJSON-547743457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-f0da164a-2663-4aa1-a423-d5c9b8c9a504 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:27:25 devstack sudo[102213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-f0da164a-2663-4aa1-a423-d5c9b8c9a504 Aug 26 14:27:25 devstack sudo[102213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:27:25 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f2c8f3c-d7ce-44da-8dd8-a5343309aa40 tempest-GroupSnapshotsTest-1811106974 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:27:25 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-9f2c8f3c-d7ce-44da-8dd8-a5343309aa40 tempest-GroupSnapshotsTest-1811106974 None] Flow 'volume_create_manager' (d52f427e-48f6-4e27-84e0-7d2aec6e964d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:27:25 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-9f2c8f3c-d7ce-44da-8dd8-a5343309aa40 tempest-GroupSnapshotsTest-1811106974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa8b6812-e149-457d-8a9f-4e47f3f796d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:27:25 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-9f2c8f3c-d7ce-44da-8dd8-a5343309aa40 tempest-GroupSnapshotsTest-1811106974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa8b6812-e149-457d-8a9f-4e47f3f796d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:27:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-611764604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=03326943-4247-46fa-b382-0a01ad8d4300,host='devstack@QuobyteHD#QuobyteHD',id=aa322f8d-7ca3-4eae-a15b-622b1649cf72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be0ddeaba262430da8382e7591982d1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:27:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:27:26Z,use_quota=True,user_id='a27ee7ba07b24d918426092684738d79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99f3d453-780f-4592-a82b-62108f660b12),volume_type_id=99f3d453-780f-4592-a82b-62108f660b12)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:27:25 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-9f2c8f3c-d7ce-44da-8dd8-a5343309aa40 tempest-GroupSnapshotsTest-1811106974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b7f8498-d757-4d57-9a50-67b4287b50be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:27:25 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-9f2c8f3c-d7ce-44da-8dd8-a5343309aa40 tempest-GroupSnapshotsTest-1811106974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b7f8498-d757-4d57-9a50-67b4287b50be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:27:25 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-9f2c8f3c-d7ce-44da-8dd8-a5343309aa40 tempest-GroupSnapshotsTest-1811106974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f6c8bc6-d082-4da9-b246-6992355b7d5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:27:25 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-9f2c8f3c-d7ce-44da-8dd8-a5343309aa40 tempest-GroupSnapshotsTest-1811106974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f6c8bc6-d082-4da9-b246-6992355b7d5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa322f8d-7ca3-4eae-a15b-622b1649cf72', 'volume_name': 'volume-aa322f8d-7ca3-4eae-a15b-622b1649cf72', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:27:25 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-9f2c8f3c-d7ce-44da-8dd8-a5343309aa40 tempest-GroupSnapshotsTest-1811106974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b68678e-0e43-41c3-bcf1-3bdf5c603ec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:27:25 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-9f2c8f3c-d7ce-44da-8dd8-a5343309aa40 tempest-GroupSnapshotsTest-1811106974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b68678e-0e43-41c3-bcf1-3bdf5c603ec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:27:25 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-9f2c8f3c-d7ce-44da-8dd8-a5343309aa40 tempest-GroupSnapshotsTest-1811106974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2743133-84e7-4d45-8d70-920fce0ac56d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:27:25 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-9f2c8f3c-d7ce-44da-8dd8-a5343309aa40 tempest-GroupSnapshotsTest-1811106974 None] Volume aa322f8d-7ca3-4eae-a15b-622b1649cf72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa322f8d-7ca3-4eae-a15b-622b1649cf72', 'volume_size': 1} Aug 26 14:27:25 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-9f2c8f3c-d7ce-44da-8dd8-a5343309aa40 tempest-GroupSnapshotsTest-1811106974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:27:25 devstack sudo[102213]: pam_unix(sudo:session): session closed for user root Aug 26 14:27:26 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [req-a390b0a0-f456-441b-b192-71b3bbc07eab req-63191332-870d-4603-b161-aa6e6e03c62a tempest-VolumesGetTestJSON-547743457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-f0da164a-2663-4aa1-a423-d5c9b8c9a504" returned: 0 in 0.253s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:27:26 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [req-a390b0a0-f456-441b-b192-71b3bbc07eab req-63191332-870d-4603-b161-aa6e6e03c62a tempest-VolumesGetTestJSON-547743457 None] <== create_volume: return (773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:27:26 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [req-a390b0a0-f456-441b-b192-71b3bbc07eab req-63191332-870d-4603-b161-aa6e6e03c62a tempest-VolumesGetTestJSON-547743457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.776s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:27:26 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-9f2c8f3c-d7ce-44da-8dd8-a5343309aa40 tempest-GroupSnapshotsTest-1811106974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.107s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:27:26 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-9f2c8f3c-d7ce-44da-8dd8-a5343309aa40 tempest-GroupSnapshotsTest-1811106974 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=03326943-4247-46fa-b382-0a01ad8d4300,created_at=2026-08-26T12:27:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-611764604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=03326943-4247-46fa-b382-0a01ad8d4300,host='devstack@QuobyteHD#QuobyteHD',id=aa322f8d-7ca3-4eae-a15b-622b1649cf72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be0ddeaba262430da8382e7591982d1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:27:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:27:26Z,use_quota=True,user_id='a27ee7ba07b24d918426092684738d79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99f3d453-780f-4592-a82b-62108f660b12),volume_type_id=99f3d453-780f-4592-a82b-62108f660b12)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:27:26 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-9f2c8f3c-d7ce-44da-8dd8-a5343309aa40 tempest-GroupSnapshotsTest-1811106974 None] Creating volume aa322f8d-7ca3-4eae-a15b-622b1649cf72 {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:27:26 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-9f2c8f3c-d7ce-44da-8dd8-a5343309aa40 tempest-GroupSnapshotsTest-1811106974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:27:26 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-9f2c8f3c-d7ce-44da-8dd8-a5343309aa40 tempest-GroupSnapshotsTest-1811106974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:27:26 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-9f2c8f3c-d7ce-44da-8dd8-a5343309aa40 tempest-GroupSnapshotsTest-1811106974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:27:26 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-9f2c8f3c-d7ce-44da-8dd8-a5343309aa40 tempest-GroupSnapshotsTest-1811106974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:27:26 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-9f2c8f3c-d7ce-44da-8dd8-a5343309aa40 tempest-GroupSnapshotsTest-1811106974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:27:26 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-9f2c8f3c-d7ce-44da-8dd8-a5343309aa40 tempest-GroupSnapshotsTest-1811106974 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:27:26 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-9f2c8f3c-d7ce-44da-8dd8-a5343309aa40 tempest-GroupSnapshotsTest-1811106974 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:27:26 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-9f2c8f3c-d7ce-44da-8dd8-a5343309aa40 tempest-GroupSnapshotsTest-1811106974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-aa322f8d-7ca3-4eae-a15b-622b1649cf72 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:27:26 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [req-a390b0a0-f456-441b-b192-71b3bbc07eab req-63191332-870d-4603-b161-aa6e6e03c62a tempest-VolumesGetTestJSON-547743457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5164436-8f2f-48fa-972b-a1c1531846c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0da164a-2663-4aa1-a423-d5c9b8c9a504', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:27:26 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [req-a390b0a0-f456-441b-b192-71b3bbc07eab req-63191332-870d-4603-b161-aa6e6e03c62a tempest-VolumesGetTestJSON-547743457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a0ec8ee-b66e-4820-bde7-7b29503fd977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:27:26 devstack sudo[102216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-aa322f8d-7ca3-4eae-a15b-622b1649cf72 1073741824 Aug 26 14:27:26 devstack sudo[102216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:27:26 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [req-a390b0a0-f456-441b-b192-71b3bbc07eab req-63191332-870d-4603-b161-aa6e6e03c62a tempest-VolumesGetTestJSON-547743457 None] Volume volume-f0da164a-2663-4aa1-a423-d5c9b8c9a504 (f0da164a-2663-4aa1-a423-d5c9b8c9a504): created successfully Aug 26 14:27:26 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [req-a390b0a0-f456-441b-b192-71b3bbc07eab req-63191332-870d-4603-b161-aa6e6e03c62a tempest-VolumesGetTestJSON-547743457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a0ec8ee-b66e-4820-bde7-7b29503fd977) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:27:26 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [req-a390b0a0-f456-441b-b192-71b3bbc07eab req-63191332-870d-4603-b161-aa6e6e03c62a tempest-VolumesGetTestJSON-547743457 None] Flow 'volume_create_manager' (5a7776bc-15fb-4a1a-8e57-a7a782f2523f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:27:26 devstack cinder-volume[94394]: INFO cinder.volume.manager [req-a390b0a0-f456-441b-b192-71b3bbc07eab req-63191332-870d-4603-b161-aa6e6e03c62a tempest-VolumesGetTestJSON-547743457 None] Created volume successfully. Aug 26 14:27:26 devstack cinder-volume[94394]: DEBUG cinder.coordination [req-10543e14-9884-4088-b525-6b0aea00ee00 req-5e02ee29-389e-4a88-989b-a91a07223da9 tempest-VolumesGetTestJSON-547743457 None] Acquiring lock "cinder-f0da164a-2663-4aa1-a423-d5c9b8c9a504-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:27:26 devstack cinder-volume[94394]: DEBUG cinder.coordination [req-10543e14-9884-4088-b525-6b0aea00ee00 req-5e02ee29-389e-4a88-989b-a91a07223da9 tempest-VolumesGetTestJSON-547743457 None] Lock "cinder-f0da164a-2663-4aa1-a423-d5c9b8c9a504-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:27:26 devstack sudo[102216]: pam_unix(sudo:session): session closed for user root Aug 26 14:27:26 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-9f2c8f3c-d7ce-44da-8dd8-a5343309aa40 tempest-GroupSnapshotsTest-1811106974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-aa322f8d-7ca3-4eae-a15b-622b1649cf72 1073741824" returned: 0 in 0.482s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:27:26 devstack cinder-volume[94394]: DEBUG cinder.coordination [req-10543e14-9884-4088-b525-6b0aea00ee00 req-5e02ee29-389e-4a88-989b-a91a07223da9 tempest-VolumesGetTestJSON-547743457 None] Acquiring lock "cinder-quobyte-f0da164a-2663-4aa1-a423-d5c9b8c9a504" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:27:26 devstack cinder-volume[94394]: DEBUG cinder.coordination [req-10543e14-9884-4088-b525-6b0aea00ee00 req-5e02ee29-389e-4a88-989b-a91a07223da9 tempest-VolumesGetTestJSON-547743457 None] Lock "cinder-quobyte-f0da164a-2663-4aa1-a423-d5c9b8c9a504" acquired by "delete_volume" :: waited 0.021s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:27:26 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[071a3860-1941-464f-a5ca-f25466b7ddee]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:27:26 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [req-10543e14-9884-4088-b525-6b0aea00ee00 req-5e02ee29-389e-4a88-989b-a91a07223da9 tempest-VolumesGetTestJSON-547743457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-f0da164a-2663-4aa1-a423-d5c9b8c9a504 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:27:26 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-9f2c8f3c-d7ce-44da-8dd8-a5343309aa40 tempest-GroupSnapshotsTest-1811106974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-aa322f8d-7ca3-4eae-a15b-622b1649cf72 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:27:26 devstack sudo[102223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-aa322f8d-7ca3-4eae-a15b-622b1649cf72 Aug 26 14:27:26 devstack sudo[102223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:27:26 devstack sudo[102222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-f0da164a-2663-4aa1-a423-d5c9b8c9a504 Aug 26 14:27:26 devstack sudo[102222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:27:26 devstack sudo[102223]: pam_unix(sudo:session): session closed for user root Aug 26 14:27:26 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-9f2c8f3c-d7ce-44da-8dd8-a5343309aa40 tempest-GroupSnapshotsTest-1811106974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-aa322f8d-7ca3-4eae-a15b-622b1649cf72" returned: 0 in 0.246s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:27:26 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-9f2c8f3c-d7ce-44da-8dd8-a5343309aa40 tempest-GroupSnapshotsTest-1811106974 None] <== create_volume: return (799ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:27:26 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-9f2c8f3c-d7ce-44da-8dd8-a5343309aa40 tempest-GroupSnapshotsTest-1811106974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.802s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:27:26 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-9f2c8f3c-d7ce-44da-8dd8-a5343309aa40 tempest-GroupSnapshotsTest-1811106974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2743133-84e7-4d45-8d70-920fce0ac56d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa322f8d-7ca3-4eae-a15b-622b1649cf72', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:27:26 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-9f2c8f3c-d7ce-44da-8dd8-a5343309aa40 tempest-GroupSnapshotsTest-1811106974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dab37438-d483-4f55-a017-439cdd4c3291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:27:26 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-9f2c8f3c-d7ce-44da-8dd8-a5343309aa40 tempest-GroupSnapshotsTest-1811106974 None] Volume volume-aa322f8d-7ca3-4eae-a15b-622b1649cf72 (aa322f8d-7ca3-4eae-a15b-622b1649cf72): created successfully Aug 26 14:27:26 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-9f2c8f3c-d7ce-44da-8dd8-a5343309aa40 tempest-GroupSnapshotsTest-1811106974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dab37438-d483-4f55-a017-439cdd4c3291) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:27:26 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-9f2c8f3c-d7ce-44da-8dd8-a5343309aa40 tempest-GroupSnapshotsTest-1811106974 None] Flow 'volume_create_manager' (d52f427e-48f6-4e27-84e0-7d2aec6e964d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:27:26 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-9f2c8f3c-d7ce-44da-8dd8-a5343309aa40 tempest-GroupSnapshotsTest-1811106974 None] Created volume successfully. Aug 26 14:27:26 devstack sudo[102222]: pam_unix(sudo:session): session closed for user root Aug 26 14:27:26 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [req-10543e14-9884-4088-b525-6b0aea00ee00 req-5e02ee29-389e-4a88-989b-a91a07223da9 tempest-VolumesGetTestJSON-547743457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-f0da164a-2663-4aa1-a423-d5c9b8c9a504" returned: 0 in 0.362s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:27:26 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [req-10543e14-9884-4088-b525-6b0aea00ee00 req-5e02ee29-389e-4a88-989b-a91a07223da9 tempest-VolumesGetTestJSON-547743457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-f0da164a-2663-4aa1-a423-d5c9b8c9a504 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:27:26 devstack sudo[102231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-f0da164a-2663-4aa1-a423-d5c9b8c9a504 Aug 26 14:27:26 devstack sudo[102231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:27:27 devstack sudo[102231]: pam_unix(sudo:session): session closed for user root Aug 26 14:27:27 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [req-10543e14-9884-4088-b525-6b0aea00ee00 req-5e02ee29-389e-4a88-989b-a91a07223da9 tempest-VolumesGetTestJSON-547743457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-f0da164a-2663-4aa1-a423-d5c9b8c9a504" returned: 0 in 0.263s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:27:27 devstack cinder-volume[94394]: DEBUG cinder.coordination [req-10543e14-9884-4088-b525-6b0aea00ee00 req-5e02ee29-389e-4a88-989b-a91a07223da9 tempest-VolumesGetTestJSON-547743457 None] Lock "cinder-quobyte-f0da164a-2663-4aa1-a423-d5c9b8c9a504" released by "delete_volume" :: held 0.673s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:27:27 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-a18dfee7-78b6-4429-938d-2c98555e5c0c tempest-GroupSnapshotsTest-1811106974 None] GroupSnapshot b573a3b6-f4b3-432f-bf6d-170df2feda4b: creating. Aug 26 14:27:27 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-a18dfee7-78b6-4429-938d-2c98555e5c0c tempest-GroupSnapshotsTest-1811106974 None] Group snapshot b573a3b6-f4b3-432f-bf6d-170df2feda4b: creating. {{(pid=94394) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 26 14:27:27 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-a18dfee7-78b6-4429-938d-2c98555e5c0c tempest-GroupSnapshotsTest-1811106974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:27:27 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-a18dfee7-78b6-4429-938d-2c98555e5c0c tempest-GroupSnapshotsTest-1811106974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:27:27 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-a18dfee7-78b6-4429-938d-2c98555e5c0c tempest-GroupSnapshotsTest-1811106974 None] Creating offline snapshot 5ba1601b-666b-4cb0-a2c9-21693f6e68de of volume aa322f8d-7ca3-4eae-a15b-622b1649cf72 {{(pid=94394) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 14:27:27 devstack cinder-volume[94394]: DEBUG cinder.quota [req-10543e14-9884-4088-b525-6b0aea00ee00 req-5e02ee29-389e-4a88-989b-a91a07223da9 tempest-VolumesGetTestJSON-547743457 None] Created reservations ['a855eb3c-eac3-46b9-ba8e-05bf64bec97b', 'a8b903d4-790c-43ea-a780-a2259c36d894', '3fcd07d1-9c77-4fc1-851d-b26b39f0d29a', '7e791f66-9625-47f7-8593-2f4ed917fd21'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:27:27 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdaf54a6-bd0f-4032-9407-d2be5bdfd333]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:27:27 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-a18dfee7-78b6-4429-938d-2c98555e5c0c tempest-GroupSnapshotsTest-1811106974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-aa322f8d-7ca3-4eae-a15b-622b1649cf72 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:27:27 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [req-10543e14-9884-4088-b525-6b0aea00ee00 req-5e02ee29-389e-4a88-989b-a91a07223da9 tempest-VolumesGetTestJSON-547743457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:27:27 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [req-10543e14-9884-4088-b525-6b0aea00ee00 req-5e02ee29-389e-4a88-989b-a91a07223da9 tempest-VolumesGetTestJSON-547743457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:27:27 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [req-10543e14-9884-4088-b525-6b0aea00ee00 req-5e02ee29-389e-4a88-989b-a91a07223da9 tempest-VolumesGetTestJSON-547743457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:27:27 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [req-10543e14-9884-4088-b525-6b0aea00ee00 req-5e02ee29-389e-4a88-989b-a91a07223da9 tempest-VolumesGetTestJSON-547743457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:27:27 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [req-10543e14-9884-4088-b525-6b0aea00ee00 req-5e02ee29-389e-4a88-989b-a91a07223da9 tempest-VolumesGetTestJSON-547743457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:27:27 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [req-10543e14-9884-4088-b525-6b0aea00ee00 req-5e02ee29-389e-4a88-989b-a91a07223da9 tempest-VolumesGetTestJSON-547743457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:27:27 devstack sudo[102235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:27:27 devstack sudo[102235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:27:27 devstack sudo[102234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-aa322f8d-7ca3-4eae-a15b-622b1649cf72 Aug 26 14:27:27 devstack sudo[102234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:27:27 devstack sudo[102235]: pam_unix(sudo:session): session closed for user root Aug 26 14:27:27 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [req-10543e14-9884-4088-b525-6b0aea00ee00 req-5e02ee29-389e-4a88-989b-a91a07223da9 tempest-VolumesGetTestJSON-547743457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.283s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:27:27 devstack cinder-volume[94394]: DEBUG cinder.manager [req-10543e14-9884-4088-b525-6b0aea00ee00 req-5e02ee29-389e-4a88-989b-a91a07223da9 tempest-VolumesGetTestJSON-547743457 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:27:27 devstack cinder-volume[94394]: INFO cinder.volume.manager [req-10543e14-9884-4088-b525-6b0aea00ee00 req-5e02ee29-389e-4a88-989b-a91a07223da9 tempest-VolumesGetTestJSON-547743457 None] Deleted volume successfully. Aug 26 14:27:27 devstack sudo[102234]: pam_unix(sudo:session): session closed for user root Aug 26 14:27:27 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-a18dfee7-78b6-4429-938d-2c98555e5c0c tempest-GroupSnapshotsTest-1811106974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-aa322f8d-7ca3-4eae-a15b-622b1649cf72" returned: 0 in 0.385s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:27:27 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-a18dfee7-78b6-4429-938d-2c98555e5c0c tempest-GroupSnapshotsTest-1811106974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-aa322f8d-7ca3-4eae-a15b-622b1649cf72,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-aa322f8d-7ca3-4eae-a15b-622b1649cf72.5ba1601b-666b-4cb0-a2c9-21693f6e68de 1G {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:27:27 devstack cinder-volume[94394]: DEBUG cinder.coordination [req-10543e14-9884-4088-b525-6b0aea00ee00 req-5e02ee29-389e-4a88-989b-a91a07223da9 tempest-VolumesGetTestJSON-547743457 None] Lock "cinder-f0da164a-2663-4aa1-a423-d5c9b8c9a504-delete_volume" released by "delete_volume" :: held 1.277s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:27:27 devstack sudo[102242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-aa322f8d-7ca3-4eae-a15b-622b1649cf72,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-aa322f8d-7ca3-4eae-a15b-622b1649cf72.5ba1601b-666b-4cb0-a2c9-21693f6e68de 1G Aug 26 14:27:27 devstack sudo[102242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:27:28 devstack sudo[102242]: pam_unix(sudo:session): session closed for user root Aug 26 14:27:28 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-a18dfee7-78b6-4429-938d-2c98555e5c0c tempest-GroupSnapshotsTest-1811106974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-aa322f8d-7ca3-4eae-a15b-622b1649cf72,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-aa322f8d-7ca3-4eae-a15b-622b1649cf72.5ba1601b-666b-4cb0-a2c9-21693f6e68de 1G" returned: 0 in 0.406s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:27:28 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-a18dfee7-78b6-4429-938d-2c98555e5c0c tempest-GroupSnapshotsTest-1811106974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa322f8d-7ca3-4eae-a15b-622b1649cf72 -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-aa322f8d-7ca3-4eae-a15b-622b1649cf72.5ba1601b-666b-4cb0-a2c9-21693f6e68de {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:27:28 devstack sudo[102248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa322f8d-7ca3-4eae-a15b-622b1649cf72 -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-aa322f8d-7ca3-4eae-a15b-622b1649cf72.5ba1601b-666b-4cb0-a2c9-21693f6e68de Aug 26 14:27:28 devstack sudo[102248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:27:28 devstack sudo[102248]: pam_unix(sudo:session): session closed for user root Aug 26 14:27:28 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-a18dfee7-78b6-4429-938d-2c98555e5c0c tempest-GroupSnapshotsTest-1811106974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa322f8d-7ca3-4eae-a15b-622b1649cf72 -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-aa322f8d-7ca3-4eae-a15b-622b1649cf72.5ba1601b-666b-4cb0-a2c9-21693f6e68de" returned: 0 in 0.311s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:27:28 devstack cinder-volume[94394]: WARNING cinder.volume.drivers.remotefs [None req-a18dfee7-78b6-4429-938d-2c98555e5c0c tempest-GroupSnapshotsTest-1811106974 None] /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-aa322f8d-7ca3-4eae-a15b-622b1649cf72.5ba1601b-666b-4cb0-a2c9-21693f6e68de is being set with open permissions: ugo+rw: NotImplementedError Aug 26 14:27:28 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-a18dfee7-78b6-4429-938d-2c98555e5c0c tempest-GroupSnapshotsTest-1811106974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-aa322f8d-7ca3-4eae-a15b-622b1649cf72.5ba1601b-666b-4cb0-a2c9-21693f6e68de {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:27:28 devstack sudo[102253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-aa322f8d-7ca3-4eae-a15b-622b1649cf72.5ba1601b-666b-4cb0-a2c9-21693f6e68de Aug 26 14:27:28 devstack sudo[102253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:27:28 devstack sudo[102253]: pam_unix(sudo:session): session closed for user root Aug 26 14:27:28 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-a18dfee7-78b6-4429-938d-2c98555e5c0c tempest-GroupSnapshotsTest-1811106974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-aa322f8d-7ca3-4eae-a15b-622b1649cf72.5ba1601b-666b-4cb0-a2c9-21693f6e68de" returned: 0 in 0.305s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:27:28 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-a18dfee7-78b6-4429-938d-2c98555e5c0c tempest-GroupSnapshotsTest-1811106974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-aa322f8d-7ca3-4eae-a15b-622b1649cf72.info {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:27:28 devstack sudo[102256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-aa322f8d-7ca3-4eae-a15b-622b1649cf72.info Aug 26 14:27:28 devstack sudo[102256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:27:29 devstack sudo[102256]: pam_unix(sudo:session): session closed for user root Aug 26 14:27:29 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-a18dfee7-78b6-4429-938d-2c98555e5c0c tempest-GroupSnapshotsTest-1811106974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-aa322f8d-7ca3-4eae-a15b-622b1649cf72.info" returned: 0 in 0.301s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:27:29 devstack cinder-volume[94394]: WARNING cinder.volume.drivers.remotefs [None req-a18dfee7-78b6-4429-938d-2c98555e5c0c tempest-GroupSnapshotsTest-1811106974 None] /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-aa322f8d-7ca3-4eae-a15b-622b1649cf72.info is being set with open permissions: ugo+rw: NotImplementedError Aug 26 14:27:29 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-a18dfee7-78b6-4429-938d-2c98555e5c0c tempest-GroupSnapshotsTest-1811106974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-aa322f8d-7ca3-4eae-a15b-622b1649cf72.info {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:27:29 devstack sudo[102259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-aa322f8d-7ca3-4eae-a15b-622b1649cf72.info Aug 26 14:27:29 devstack sudo[102259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:27:29 devstack sudo[102259]: pam_unix(sudo:session): session closed for user root Aug 26 14:27:29 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-a18dfee7-78b6-4429-938d-2c98555e5c0c tempest-GroupSnapshotsTest-1811106974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-aa322f8d-7ca3-4eae-a15b-622b1649cf72.info" returned: 0 in 0.321s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:27:29 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-a18dfee7-78b6-4429-938d-2c98555e5c0c tempest-GroupSnapshotsTest-1811106974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.126s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:27:29 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-a18dfee7-78b6-4429-938d-2c98555e5c0c tempest-GroupSnapshotsTest-1811106974 None] group_snapshot b573a3b6-f4b3-432f-bf6d-170df2feda4b: created successfully Aug 26 14:27:30 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-100a1ac1-ec37-406e-94ea-fa3c72cb8465 tempest-GroupSnapshotsTest-1811106974 None] group_snapshot b573a3b6-f4b3-432f-bf6d-170df2feda4b: deleting Aug 26 14:27:30 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-100a1ac1-ec37-406e-94ea-fa3c72cb8465 tempest-GroupSnapshotsTest-1811106974 None] group_snapshot b573a3b6-f4b3-432f-bf6d-170df2feda4b: deleting {{(pid=94394) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 26 14:27:30 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-100a1ac1-ec37-406e-94ea-fa3c72cb8465 tempest-GroupSnapshotsTest-1811106974 None] Acquiring lock "cinder-quobyte-aa322f8d-7ca3-4eae-a15b-622b1649cf72" by "delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:27:30 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-100a1ac1-ec37-406e-94ea-fa3c72cb8465 tempest-GroupSnapshotsTest-1811106974 None] Lock "cinder-quobyte-aa322f8d-7ca3-4eae-a15b-622b1649cf72" acquired by "delete_snapshot" :: waited 0.019s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:27:30 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-100a1ac1-ec37-406e-94ea-fa3c72cb8465 tempest-GroupSnapshotsTest-1811106974 None] Acquiring lock "cinder-quobyte-5ba1601b-666b-4cb0-a2c9-21693f6e68de" by "_delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:27:30 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-100a1ac1-ec37-406e-94ea-fa3c72cb8465 tempest-GroupSnapshotsTest-1811106974 None] Lock "cinder-quobyte-5ba1601b-666b-4cb0-a2c9-21693f6e68de" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:27:30 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-100a1ac1-ec37-406e-94ea-fa3c72cb8465 tempest-GroupSnapshotsTest-1811106974 None] Deleting offline snapshot 5ba1601b-666b-4cb0-a2c9-21693f6e68de of volume aa322f8d-7ca3-4eae-a15b-622b1649cf72 {{(pid=94394) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 14:27:30 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-100a1ac1-ec37-406e-94ea-fa3c72cb8465 tempest-GroupSnapshotsTest-1811106974 None] snapshot_file for this snap is: volume-aa322f8d-7ca3-4eae-a15b-622b1649cf72.5ba1601b-666b-4cb0-a2c9-21693f6e68de {{(pid=94394) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 14:27:30 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3e85cf6-b20f-498c-8170-bc685a50cb23]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:27:30 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-100a1ac1-ec37-406e-94ea-fa3c72cb8465 tempest-GroupSnapshotsTest-1811106974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-aa322f8d-7ca3-4eae-a15b-622b1649cf72.5ba1601b-666b-4cb0-a2c9-21693f6e68de {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:27:31 devstack sudo[102269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-aa322f8d-7ca3-4eae-a15b-622b1649cf72.5ba1601b-666b-4cb0-a2c9-21693f6e68de Aug 26 14:27:31 devstack sudo[102269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:27:31 devstack cinder-volume[94394]: INFO cinder.volume.manager [req-91dea0d5-19e3-485b-8b8e-7f9f9ec53855 req-ed2de93c-4551-4a48-b137-45adac49bde3 tempest-AttachVolumeTestJSON-1421707928 None] Terminate volume connection completed successfully. Aug 26 14:27:31 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [req-91dea0d5-19e3-485b-8b8e-7f9f9ec53855 req-ed2de93c-4551-4a48-b137-45adac49bde3 tempest-AttachVolumeTestJSON-1421707928 None] Deleting attachment 6d4b3bfa-268e-41b4-a0d3-011c7d95482c. {{(pid=94394) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 14:27:31 devstack sudo[102269]: pam_unix(sudo:session): session closed for user root Aug 26 14:27:31 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-100a1ac1-ec37-406e-94ea-fa3c72cb8465 tempest-GroupSnapshotsTest-1811106974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-aa322f8d-7ca3-4eae-a15b-622b1649cf72.5ba1601b-666b-4cb0-a2c9-21693f6e68de" returned: 0 in 0.431s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:27:31 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-100a1ac1-ec37-406e-94ea-fa3c72cb8465 tempest-GroupSnapshotsTest-1811106974 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aa322f8d-7ca3-4eae-a15b-622b1649cf72(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94394) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 14:27:31 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8423cdb-4787-4314-82cc-4034922ea5a1]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:27:31 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-100a1ac1-ec37-406e-94ea-fa3c72cb8465 tempest-GroupSnapshotsTest-1811106974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-aa322f8d-7ca3-4eae-a15b-622b1649cf72 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:27:31 devstack sudo[102279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-aa322f8d-7ca3-4eae-a15b-622b1649cf72 Aug 26 14:27:31 devstack sudo[102279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:27:31 devstack sudo[102279]: pam_unix(sudo:session): session closed for user root Aug 26 14:27:31 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-100a1ac1-ec37-406e-94ea-fa3c72cb8465 tempest-GroupSnapshotsTest-1811106974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-aa322f8d-7ca3-4eae-a15b-622b1649cf72" returned: 0 in 0.488s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:27:31 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-100a1ac1-ec37-406e-94ea-fa3c72cb8465 tempest-GroupSnapshotsTest-1811106974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-aa322f8d-7ca3-4eae-a15b-622b1649cf72.5ba1601b-666b-4cb0-a2c9-21693f6e68de {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:27:31 devstack sudo[102285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-aa322f8d-7ca3-4eae-a15b-622b1649cf72.5ba1601b-666b-4cb0-a2c9-21693f6e68de Aug 26 14:27:31 devstack sudo[102285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:27:32 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-242b98db-e18d-4f30-b8f0-3d7287f5fa20 tempest-GroupsTest-1464118442 None] Group tempest-Group1-807744219: creating Aug 26 14:27:32 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-242b98db-e18d-4f30-b8f0-3d7287f5fa20 tempest-GroupsTest-1464118442 None] Group tempest-Group1-807744219: created successfully Aug 26 14:27:32 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-242b98db-e18d-4f30-b8f0-3d7287f5fa20 tempest-GroupsTest-1464118442 None] Create group completed successfully. Aug 26 14:27:32 devstack sudo[102285]: pam_unix(sudo:session): session closed for user root Aug 26 14:27:32 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-100a1ac1-ec37-406e-94ea-fa3c72cb8465 tempest-GroupSnapshotsTest-1811106974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-aa322f8d-7ca3-4eae-a15b-622b1649cf72.5ba1601b-666b-4cb0-a2c9-21693f6e68de" returned: 0 in 0.602s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:27:32 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-100a1ac1-ec37-406e-94ea-fa3c72cb8465 tempest-GroupSnapshotsTest-1811106974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-aa322f8d-7ca3-4eae-a15b-622b1649cf72.5ba1601b-666b-4cb0-a2c9-21693f6e68de {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:27:32 devstack sudo[102299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-aa322f8d-7ca3-4eae-a15b-622b1649cf72.5ba1601b-666b-4cb0-a2c9-21693f6e68de Aug 26 14:27:32 devstack sudo[102299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:27:32 devstack sudo[102299]: pam_unix(sudo:session): session closed for user root Aug 26 14:27:32 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-100a1ac1-ec37-406e-94ea-fa3c72cb8465 tempest-GroupSnapshotsTest-1811106974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-aa322f8d-7ca3-4eae-a15b-622b1649cf72.5ba1601b-666b-4cb0-a2c9-21693f6e68de" returned: 0 in 0.260s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:27:32 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-100a1ac1-ec37-406e-94ea-fa3c72cb8465 tempest-GroupSnapshotsTest-1811106974 None] Lock "cinder-quobyte-5ba1601b-666b-4cb0-a2c9-21693f6e68de" released by "_delete_snapshot" :: held 1.949s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:27:32 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-100a1ac1-ec37-406e-94ea-fa3c72cb8465 tempest-GroupSnapshotsTest-1811106974 None] Lock "cinder-quobyte-aa322f8d-7ca3-4eae-a15b-622b1649cf72" released by "delete_snapshot" :: held 1.988s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:27:32 devstack cinder-volume[94394]: WARNING cinder.quota [None req-100a1ac1-ec37-406e-94ea-fa3c72cb8465 tempest-GroupSnapshotsTest-1811106974 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2019970180 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2019970180, it is now deprecated. Please use the default quota class for default quota. Aug 26 14:27:32 devstack cinder-volume[94394]: WARNING cinder.quota [None req-100a1ac1-ec37-406e-94ea-fa3c72cb8465 tempest-GroupSnapshotsTest-1811106974 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2019970180 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2019970180, it is now deprecated. Please use the default quota class for default quota. Aug 26 14:27:32 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-100a1ac1-ec37-406e-94ea-fa3c72cb8465 tempest-GroupSnapshotsTest-1811106974 None] Created reservations ['f3cf8d62-7d50-453a-8644-5515e6ee992b', 'd74c762a-1bf9-44f7-8325-31a4d696ad3b', '7621347c-6ab9-4c68-ac46-e2c057ab7add', 'c2dafc38-0540-4a70-b9c9-7741e6e20fda'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:27:32 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-100a1ac1-ec37-406e-94ea-fa3c72cb8465 tempest-GroupSnapshotsTest-1811106974 None] group_snapshot b573a3b6-f4b3-432f-bf6d-170df2feda4b: deleted successfully Aug 26 14:27:33 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-b91f26a0-c08d-4472-abad-8e60ede73822 tempest-GroupSnapshotsTest-1811106974 None] Acquiring lock "cinder-quobyte-aa322f8d-7ca3-4eae-a15b-622b1649cf72" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:27:33 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-b91f26a0-c08d-4472-abad-8e60ede73822 tempest-GroupSnapshotsTest-1811106974 None] Lock "cinder-quobyte-aa322f8d-7ca3-4eae-a15b-622b1649cf72" acquired by "delete_volume" :: waited 0.020s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:27:33 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[1313387a-5be2-4d19-87b1-ad50f17f5b73]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:27:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-b91f26a0-c08d-4472-abad-8e60ede73822 tempest-GroupSnapshotsTest-1811106974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-aa322f8d-7ca3-4eae-a15b-622b1649cf72 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:27:33 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-bd614c32-6e98-48b5-8404-b302f5b9a269 tempest-GroupsTest-1464118442 None] Group tempest-Group2-23197001: creating Aug 26 14:27:33 devstack cinder-volume[94394]: DEBUG oslo_service.periodic_task [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94394) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 14:27:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:27:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:27:33 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:27:33 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:27:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:27:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:27:33 devstack sudo[102303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:27:33 devstack sudo[102303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:27:33 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-bd614c32-6e98-48b5-8404-b302f5b9a269 tempest-GroupsTest-1464118442 None] Group tempest-Group2-23197001: created successfully Aug 26 14:27:33 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-bd614c32-6e98-48b5-8404-b302f5b9a269 tempest-GroupsTest-1464118442 None] Create group completed successfully. Aug 26 14:27:33 devstack sudo[102302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-aa322f8d-7ca3-4eae-a15b-622b1649cf72 Aug 26 14:27:33 devstack sudo[102302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:27:33 devstack sudo[102303]: pam_unix(sudo:session): session closed for user root Aug 26 14:27:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.339s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:27:33 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:27:33 devstack cinder-volume[94394]: DEBUG oslo_service.periodic_task [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Running periodic task VolumeManager._thread_info {{(pid=94394) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 14:27:33 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] thread count: 28 {{(pid=94394) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 14:27:33 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] thread info: [<_MainThread(MainThread, started 126600738033792)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94394) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 14:27:34 devstack sudo[102302]: pam_unix(sudo:session): session closed for user root Aug 26 14:27:34 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-b91f26a0-c08d-4472-abad-8e60ede73822 tempest-GroupSnapshotsTest-1811106974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-aa322f8d-7ca3-4eae-a15b-622b1649cf72" returned: 0 in 0.539s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:27:34 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-b91f26a0-c08d-4472-abad-8e60ede73822 tempest-GroupSnapshotsTest-1811106974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-aa322f8d-7ca3-4eae-a15b-622b1649cf72 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:27:34 devstack sudo[102313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-aa322f8d-7ca3-4eae-a15b-622b1649cf72 Aug 26 14:27:34 devstack sudo[102313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:27:34 devstack sudo[102313]: pam_unix(sudo:session): session closed for user root Aug 26 14:27:34 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-b91f26a0-c08d-4472-abad-8e60ede73822 tempest-GroupSnapshotsTest-1811106974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-aa322f8d-7ca3-4eae-a15b-622b1649cf72" returned: 0 in 0.298s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:27:34 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-b91f26a0-c08d-4472-abad-8e60ede73822 tempest-GroupSnapshotsTest-1811106974 None] Lock "cinder-quobyte-aa322f8d-7ca3-4eae-a15b-622b1649cf72" released by "delete_volume" :: held 0.931s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:27:34 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-b91f26a0-c08d-4472-abad-8e60ede73822 tempest-GroupSnapshotsTest-1811106974 None] Created reservations ['74262a10-9d81-47fa-b3c5-abf6261d8ba0'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:27:34 devstack cinder-volume[94394]: WARNING cinder.quota [None req-b91f26a0-c08d-4472-abad-8e60ede73822 tempest-GroupSnapshotsTest-1811106974 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2019970180 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2019970180, it is now deprecated. Please use the default quota class for default quota. Aug 26 14:27:34 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-b91f26a0-c08d-4472-abad-8e60ede73822 tempest-GroupSnapshotsTest-1811106974 None] Created reservations ['2bee17a7-2458-47a4-a667-03f1950a14af', '9b7a711e-d68e-4faf-b75c-4769e18fe623', 'd7b74bfe-4740-4dea-8c9a-16d554965a98', 'b4af150b-8e8e-4570-bb96-07c87d008676'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:27:34 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-b91f26a0-c08d-4472-abad-8e60ede73822 tempest-GroupSnapshotsTest-1811106974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:27:34 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-b91f26a0-c08d-4472-abad-8e60ede73822 tempest-GroupSnapshotsTest-1811106974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:27:34 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-b91f26a0-c08d-4472-abad-8e60ede73822 tempest-GroupSnapshotsTest-1811106974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:27:34 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-b91f26a0-c08d-4472-abad-8e60ede73822 tempest-GroupSnapshotsTest-1811106974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:27:34 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-b91f26a0-c08d-4472-abad-8e60ede73822 tempest-GroupSnapshotsTest-1811106974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:27:34 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-b91f26a0-c08d-4472-abad-8e60ede73822 tempest-GroupSnapshotsTest-1811106974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:27:34 devstack sudo[102320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:27:34 devstack sudo[102320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:27:35 devstack sudo[102320]: pam_unix(sudo:session): session closed for user root Aug 26 14:27:35 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-b91f26a0-c08d-4472-abad-8e60ede73822 tempest-GroupSnapshotsTest-1811106974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.511s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:27:35 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-b91f26a0-c08d-4472-abad-8e60ede73822 tempest-GroupSnapshotsTest-1811106974 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:27:35 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-b91f26a0-c08d-4472-abad-8e60ede73822 tempest-GroupSnapshotsTest-1811106974 None] Delete group completed successfully. Aug 26 14:27:35 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-f51b2b98-2488-40ee-a686-7af38babbda4 tempest-GroupsTest-1464118442 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:27:35 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-f51b2b98-2488-40ee-a686-7af38babbda4 tempest-GroupsTest-1464118442 None] Flow 'volume_create_manager' (10d8f2f2-1a56-4410-bf13-1efc34a10dcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:27:35 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-f51b2b98-2488-40ee-a686-7af38babbda4 tempest-GroupsTest-1464118442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2da6682-d793-413a-bf9f-cf416d8e13ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:27:35 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-f51b2b98-2488-40ee-a686-7af38babbda4 tempest-GroupsTest-1464118442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2da6682-d793-413a-bf9f-cf416d8e13ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:27:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1762467101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8d1de4dc-9aba-4789-ac1b-8affeffe9add,host='devstack@QuobyteHD#QuobyteHD',id=60cfe8c9-d65c-41c2-9de4-120bc5c1fd9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1aa9d232e4243b29c8fd5131f8e2e52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:27:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:27:36Z,use_quota=True,user_id='4d961995b2fe49a4af47387ab070711e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50c43290-7f80-4a7a-beab-92633cf33619),volume_type_id=50c43290-7f80-4a7a-beab-92633cf33619)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:27:35 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-f51b2b98-2488-40ee-a686-7af38babbda4 tempest-GroupsTest-1464118442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a60fa1bd-aafc-4229-92fc-5da64c81ba7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:27:35 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-f51b2b98-2488-40ee-a686-7af38babbda4 tempest-GroupsTest-1464118442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a60fa1bd-aafc-4229-92fc-5da64c81ba7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:27:35 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-f51b2b98-2488-40ee-a686-7af38babbda4 tempest-GroupsTest-1464118442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (708e2480-07b0-4bbc-a4c7-381ff4621a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:27:35 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-f51b2b98-2488-40ee-a686-7af38babbda4 tempest-GroupsTest-1464118442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (708e2480-07b0-4bbc-a4c7-381ff4621a18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60cfe8c9-d65c-41c2-9de4-120bc5c1fd9e', 'volume_name': 'volume-60cfe8c9-d65c-41c2-9de4-120bc5c1fd9e', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:27:35 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-f51b2b98-2488-40ee-a686-7af38babbda4 tempest-GroupsTest-1464118442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a708866c-d4eb-40da-8e15-a1745a44356c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:27:35 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-f51b2b98-2488-40ee-a686-7af38babbda4 tempest-GroupsTest-1464118442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a708866c-d4eb-40da-8e15-a1745a44356c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:27:35 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-f51b2b98-2488-40ee-a686-7af38babbda4 tempest-GroupsTest-1464118442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (541ed93a-d4ce-4f7f-b4cb-bc35d65a422d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:27:35 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-f51b2b98-2488-40ee-a686-7af38babbda4 tempest-GroupsTest-1464118442 None] Volume 60cfe8c9-d65c-41c2-9de4-120bc5c1fd9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60cfe8c9-d65c-41c2-9de4-120bc5c1fd9e', 'volume_size': 1} Aug 26 14:27:35 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-f51b2b98-2488-40ee-a686-7af38babbda4 tempest-GroupsTest-1464118442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:27:35 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-f51b2b98-2488-40ee-a686-7af38babbda4 tempest-GroupsTest-1464118442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:27:35 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-f51b2b98-2488-40ee-a686-7af38babbda4 tempest-GroupsTest-1464118442 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8d1de4dc-9aba-4789-ac1b-8affeffe9add,created_at=2026-08-26T12:27:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1762467101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8d1de4dc-9aba-4789-ac1b-8affeffe9add,host='devstack@QuobyteHD#QuobyteHD',id=60cfe8c9-d65c-41c2-9de4-120bc5c1fd9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1aa9d232e4243b29c8fd5131f8e2e52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:27:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:27:36Z,use_quota=True,user_id='4d961995b2fe49a4af47387ab070711e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50c43290-7f80-4a7a-beab-92633cf33619),volume_type_id=50c43290-7f80-4a7a-beab-92633cf33619)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:27:35 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-f51b2b98-2488-40ee-a686-7af38babbda4 tempest-GroupsTest-1464118442 None] Creating volume 60cfe8c9-d65c-41c2-9de4-120bc5c1fd9e {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:27:35 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-f51b2b98-2488-40ee-a686-7af38babbda4 tempest-GroupsTest-1464118442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:27:35 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-f51b2b98-2488-40ee-a686-7af38babbda4 tempest-GroupsTest-1464118442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:27:35 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-f51b2b98-2488-40ee-a686-7af38babbda4 tempest-GroupsTest-1464118442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:27:35 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-f51b2b98-2488-40ee-a686-7af38babbda4 tempest-GroupsTest-1464118442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:27:35 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-f51b2b98-2488-40ee-a686-7af38babbda4 tempest-GroupsTest-1464118442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:27:35 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-f51b2b98-2488-40ee-a686-7af38babbda4 tempest-GroupsTest-1464118442 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:27:35 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-f51b2b98-2488-40ee-a686-7af38babbda4 tempest-GroupsTest-1464118442 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:27:35 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-f51b2b98-2488-40ee-a686-7af38babbda4 tempest-GroupsTest-1464118442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-60cfe8c9-d65c-41c2-9de4-120bc5c1fd9e 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:27:35 devstack sudo[102359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-60cfe8c9-d65c-41c2-9de4-120bc5c1fd9e 1073741824 Aug 26 14:27:35 devstack sudo[102359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:27:36 devstack sudo[102359]: pam_unix(sudo:session): session closed for user root Aug 26 14:27:36 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-f51b2b98-2488-40ee-a686-7af38babbda4 tempest-GroupsTest-1464118442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-60cfe8c9-d65c-41c2-9de4-120bc5c1fd9e 1073741824" returned: 0 in 0.903s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:27:36 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-f51b2b98-2488-40ee-a686-7af38babbda4 tempest-GroupsTest-1464118442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-60cfe8c9-d65c-41c2-9de4-120bc5c1fd9e {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:27:36 devstack sudo[102386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-60cfe8c9-d65c-41c2-9de4-120bc5c1fd9e Aug 26 14:27:36 devstack sudo[102386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:27:37 devstack sudo[102386]: pam_unix(sudo:session): session closed for user root Aug 26 14:27:37 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-f51b2b98-2488-40ee-a686-7af38babbda4 tempest-GroupsTest-1464118442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-60cfe8c9-d65c-41c2-9de4-120bc5c1fd9e" returned: 0 in 0.423s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:27:37 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-f51b2b98-2488-40ee-a686-7af38babbda4 tempest-GroupsTest-1464118442 None] <== create_volume: return (1432ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:27:37 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-f51b2b98-2488-40ee-a686-7af38babbda4 tempest-GroupsTest-1464118442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.440s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:27:37 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-f51b2b98-2488-40ee-a686-7af38babbda4 tempest-GroupsTest-1464118442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (541ed93a-d4ce-4f7f-b4cb-bc35d65a422d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60cfe8c9-d65c-41c2-9de4-120bc5c1fd9e', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:27:37 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-f51b2b98-2488-40ee-a686-7af38babbda4 tempest-GroupsTest-1464118442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0641fcc5-c9f4-4908-b8b8-0a7bacaa02f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:27:37 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-f51b2b98-2488-40ee-a686-7af38babbda4 tempest-GroupsTest-1464118442 None] Volume volume-60cfe8c9-d65c-41c2-9de4-120bc5c1fd9e (60cfe8c9-d65c-41c2-9de4-120bc5c1fd9e): created successfully Aug 26 14:27:37 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-f51b2b98-2488-40ee-a686-7af38babbda4 tempest-GroupsTest-1464118442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0641fcc5-c9f4-4908-b8b8-0a7bacaa02f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:27:37 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-f51b2b98-2488-40ee-a686-7af38babbda4 tempest-GroupsTest-1464118442 None] Flow 'volume_create_manager' (10d8f2f2-1a56-4410-bf13-1efc34a10dcf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:27:37 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-f51b2b98-2488-40ee-a686-7af38babbda4 tempest-GroupsTest-1464118442 None] Created volume successfully. Aug 26 14:27:39 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-050e727e-819f-45f3-a3aa-1e9f8e39e890 tempest-GroupsTest-1464118442 None] Acquiring lock "cinder-quobyte-60cfe8c9-d65c-41c2-9de4-120bc5c1fd9e" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:27:39 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-050e727e-819f-45f3-a3aa-1e9f8e39e890 tempest-GroupsTest-1464118442 None] Lock "cinder-quobyte-60cfe8c9-d65c-41c2-9de4-120bc5c1fd9e" acquired by "delete_volume" :: waited 0.042s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:27:39 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[15f16a41-f09f-4035-ad6d-a4bf865dd9a4]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:27:39 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-050e727e-819f-45f3-a3aa-1e9f8e39e890 tempest-GroupsTest-1464118442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-60cfe8c9-d65c-41c2-9de4-120bc5c1fd9e {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:27:39 devstack sudo[102478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-60cfe8c9-d65c-41c2-9de4-120bc5c1fd9e Aug 26 14:27:39 devstack sudo[102478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:27:40 devstack sudo[102478]: pam_unix(sudo:session): session closed for user root Aug 26 14:27:40 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-050e727e-819f-45f3-a3aa-1e9f8e39e890 tempest-GroupsTest-1464118442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-60cfe8c9-d65c-41c2-9de4-120bc5c1fd9e" returned: 0 in 0.678s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:27:40 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-050e727e-819f-45f3-a3aa-1e9f8e39e890 tempest-GroupsTest-1464118442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-60cfe8c9-d65c-41c2-9de4-120bc5c1fd9e {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:27:40 devstack sudo[102485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-60cfe8c9-d65c-41c2-9de4-120bc5c1fd9e Aug 26 14:27:40 devstack sudo[102485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:27:40 devstack sudo[102485]: pam_unix(sudo:session): session closed for user root Aug 26 14:27:40 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-050e727e-819f-45f3-a3aa-1e9f8e39e890 tempest-GroupsTest-1464118442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-60cfe8c9-d65c-41c2-9de4-120bc5c1fd9e" returned: 0 in 0.361s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:27:40 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-050e727e-819f-45f3-a3aa-1e9f8e39e890 tempest-GroupsTest-1464118442 None] Lock "cinder-quobyte-60cfe8c9-d65c-41c2-9de4-120bc5c1fd9e" released by "delete_volume" :: held 1.113s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:27:40 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-050e727e-819f-45f3-a3aa-1e9f8e39e890 tempest-GroupsTest-1464118442 None] Created reservations ['8c41e76e-dbd2-4f8a-9217-767754c0f82c'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:27:40 devstack cinder-volume[94394]: WARNING cinder.quota [None req-050e727e-819f-45f3-a3aa-1e9f8e39e890 tempest-GroupsTest-1464118442 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-901070724 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-901070724, it is now deprecated. Please use the default quota class for default quota. Aug 26 14:27:40 devstack cinder-volume[94394]: WARNING cinder.quota [None req-050e727e-819f-45f3-a3aa-1e9f8e39e890 tempest-GroupsTest-1464118442 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-901070724 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-901070724, it is now deprecated. Please use the default quota class for default quota. Aug 26 14:27:41 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-050e727e-819f-45f3-a3aa-1e9f8e39e890 tempest-GroupsTest-1464118442 None] Created reservations ['3ebe24ba-70db-435f-8d06-e8c4031e14f6', 'aaa409cd-eb09-45c2-b47a-0ccde8c805ba', '134cc3f3-c201-48a1-985a-ead7cb6124fd', 'f6971996-50c5-4972-88d0-17e062e6bf1c'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:27:41 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-050e727e-819f-45f3-a3aa-1e9f8e39e890 tempest-GroupsTest-1464118442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:27:41 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-050e727e-819f-45f3-a3aa-1e9f8e39e890 tempest-GroupsTest-1464118442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:27:41 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-050e727e-819f-45f3-a3aa-1e9f8e39e890 tempest-GroupsTest-1464118442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:27:41 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-050e727e-819f-45f3-a3aa-1e9f8e39e890 tempest-GroupsTest-1464118442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:27:41 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-050e727e-819f-45f3-a3aa-1e9f8e39e890 tempest-GroupsTest-1464118442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:27:41 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-050e727e-819f-45f3-a3aa-1e9f8e39e890 tempest-GroupsTest-1464118442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:27:41 devstack sudo[102494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:27:41 devstack sudo[102494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:27:41 devstack sudo[102494]: pam_unix(sudo:session): session closed for user root Aug 26 14:27:41 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-050e727e-819f-45f3-a3aa-1e9f8e39e890 tempest-GroupsTest-1464118442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.361s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:27:41 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-050e727e-819f-45f3-a3aa-1e9f8e39e890 tempest-GroupsTest-1464118442 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:27:41 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-050e727e-819f-45f3-a3aa-1e9f8e39e890 tempest-GroupsTest-1464118442 None] Delete group completed successfully. Aug 26 14:27:42 devstack cinder-volume[94394]: INFO cinder.volume.manager [req-a4c882a7-f212-4f37-ad8e-ce8e77d37ffb req-5707bb0e-c7b6-4691-935f-fafc83b3de20 tempest-AttachVolumeNegativeTest-342477261 None] Terminate volume connection completed successfully. Aug 26 14:27:42 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [req-a4c882a7-f212-4f37-ad8e-ce8e77d37ffb req-5707bb0e-c7b6-4691-935f-fafc83b3de20 tempest-AttachVolumeNegativeTest-342477261 None] Deleting attachment ddb1ec70-e06b-4c89-aea4-b9e5d1bbe4f8. {{(pid=94394) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 14:27:42 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-6b7c5d82-7f71-40a3-9947-113c2adfe517 tempest-GroupsTest-1464118442 None] Created reservations ['d86a68dd-6fee-4740-a335-1f3ca64d3466'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:27:42 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-6b7c5d82-7f71-40a3-9947-113c2adfe517 tempest-GroupsTest-1464118442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:27:42 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-6b7c5d82-7f71-40a3-9947-113c2adfe517 tempest-GroupsTest-1464118442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:27:42 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-6b7c5d82-7f71-40a3-9947-113c2adfe517 tempest-GroupsTest-1464118442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:27:42 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-6b7c5d82-7f71-40a3-9947-113c2adfe517 tempest-GroupsTest-1464118442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:27:42 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-6b7c5d82-7f71-40a3-9947-113c2adfe517 tempest-GroupsTest-1464118442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:27:42 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-6b7c5d82-7f71-40a3-9947-113c2adfe517 tempest-GroupsTest-1464118442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:27:42 devstack sudo[102504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:27:42 devstack sudo[102504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:27:43 devstack sudo[102504]: pam_unix(sudo:session): session closed for user root Aug 26 14:27:43 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-6b7c5d82-7f71-40a3-9947-113c2adfe517 tempest-GroupsTest-1464118442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.411s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:27:43 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-6b7c5d82-7f71-40a3-9947-113c2adfe517 tempest-GroupsTest-1464118442 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:27:43 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-6b7c5d82-7f71-40a3-9947-113c2adfe517 tempest-GroupsTest-1464118442 None] Delete group completed successfully. Aug 26 14:27:44 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-214085f3-02ff-44e2-afd9-73b67f107874 tempest-GroupsTest-1464118442 None] Group tempest-GroupsTest-Group-1681371582: creating Aug 26 14:27:44 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-214085f3-02ff-44e2-afd9-73b67f107874 tempest-GroupsTest-1464118442 None] Group tempest-GroupsTest-Group-1681371582: created successfully Aug 26 14:27:44 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-214085f3-02ff-44e2-afd9-73b67f107874 tempest-GroupsTest-1464118442 None] Create group completed successfully. Aug 26 14:27:44 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-ac9f1659-2254-42e8-ba18-5c231def95e7 tempest-GroupSnapshotsV319Test-175723620 None] Group tempest-GroupSnapshotsV319Test-Group-934324275: creating Aug 26 14:27:44 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-ac9f1659-2254-42e8-ba18-5c231def95e7 tempest-GroupSnapshotsV319Test-175723620 None] Group tempest-GroupSnapshotsV319Test-Group-934324275: created successfully Aug 26 14:27:44 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-ac9f1659-2254-42e8-ba18-5c231def95e7 tempest-GroupSnapshotsV319Test-175723620 None] Create group completed successfully. Aug 26 14:27:46 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e96da0f-b154-4efd-9af6-0666d74bfd81 tempest-GroupSnapshotsV319Test-175723620 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:27:46 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-4e96da0f-b154-4efd-9af6-0666d74bfd81 tempest-GroupSnapshotsV319Test-175723620 None] Flow 'volume_create_manager' (86213547-0bc6-4749-9ab9-f11515ada200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:27:46 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-4e96da0f-b154-4efd-9af6-0666d74bfd81 tempest-GroupSnapshotsV319Test-175723620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c0d5506-3904-403f-bb39-2954d318e2cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:27:46 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-4e96da0f-b154-4efd-9af6-0666d74bfd81 tempest-GroupSnapshotsV319Test-175723620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c0d5506-3904-403f-bb39-2954d318e2cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:27:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1967115419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e264a723-3c58-4d82-a1b5-7f285bb645b3,host='devstack@QuobyteHD#QuobyteHD',id=c9075825-c8cf-49e0-890c-d406feddeaf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39f673ed483e453cb52e66ba65d437c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:27:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:27:46Z,use_quota=True,user_id='a1ba54de3df1432c99cdf658121e2a84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fd82635-7ae9-42fd-b461-26c167ca395b),volume_type_id=6fd82635-7ae9-42fd-b461-26c167ca395b)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:27:46 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-4e96da0f-b154-4efd-9af6-0666d74bfd81 tempest-GroupSnapshotsV319Test-175723620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (136cec76-9a72-4be0-833e-b2ac81463012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:27:46 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-4e96da0f-b154-4efd-9af6-0666d74bfd81 tempest-GroupSnapshotsV319Test-175723620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (136cec76-9a72-4be0-833e-b2ac81463012) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:27:46 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-4e96da0f-b154-4efd-9af6-0666d74bfd81 tempest-GroupSnapshotsV319Test-175723620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48c59c0d-ad0b-4dba-a84b-82f93f1f2c07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:27:46 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-4e96da0f-b154-4efd-9af6-0666d74bfd81 tempest-GroupSnapshotsV319Test-175723620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48c59c0d-ad0b-4dba-a84b-82f93f1f2c07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9075825-c8cf-49e0-890c-d406feddeaf2', 'volume_name': 'volume-c9075825-c8cf-49e0-890c-d406feddeaf2', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:27:46 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-4e96da0f-b154-4efd-9af6-0666d74bfd81 tempest-GroupSnapshotsV319Test-175723620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (069a9233-0601-48d0-9758-e2604e39d661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:27:46 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-4e96da0f-b154-4efd-9af6-0666d74bfd81 tempest-GroupSnapshotsV319Test-175723620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (069a9233-0601-48d0-9758-e2604e39d661) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:27:46 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-4e96da0f-b154-4efd-9af6-0666d74bfd81 tempest-GroupSnapshotsV319Test-175723620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7359a22d-2b84-4605-8307-f50e4caa756d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:27:46 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-4e96da0f-b154-4efd-9af6-0666d74bfd81 tempest-GroupSnapshotsV319Test-175723620 None] Volume c9075825-c8cf-49e0-890c-d406feddeaf2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9075825-c8cf-49e0-890c-d406feddeaf2', 'volume_size': 1} Aug 26 14:27:46 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-4e96da0f-b154-4efd-9af6-0666d74bfd81 tempest-GroupSnapshotsV319Test-175723620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:27:46 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-4e96da0f-b154-4efd-9af6-0666d74bfd81 tempest-GroupSnapshotsV319Test-175723620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:27:46 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-4e96da0f-b154-4efd-9af6-0666d74bfd81 tempest-GroupSnapshotsV319Test-175723620 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e264a723-3c58-4d82-a1b5-7f285bb645b3,created_at=2026-08-26T12:27:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1967115419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e264a723-3c58-4d82-a1b5-7f285bb645b3,host='devstack@QuobyteHD#QuobyteHD',id=c9075825-c8cf-49e0-890c-d406feddeaf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39f673ed483e453cb52e66ba65d437c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:27:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:27:46Z,use_quota=True,user_id='a1ba54de3df1432c99cdf658121e2a84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fd82635-7ae9-42fd-b461-26c167ca395b),volume_type_id=6fd82635-7ae9-42fd-b461-26c167ca395b)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:27:46 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-4e96da0f-b154-4efd-9af6-0666d74bfd81 tempest-GroupSnapshotsV319Test-175723620 None] Creating volume c9075825-c8cf-49e0-890c-d406feddeaf2 {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:27:46 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-4e96da0f-b154-4efd-9af6-0666d74bfd81 tempest-GroupSnapshotsV319Test-175723620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:27:46 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-4e96da0f-b154-4efd-9af6-0666d74bfd81 tempest-GroupSnapshotsV319Test-175723620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:27:46 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-4e96da0f-b154-4efd-9af6-0666d74bfd81 tempest-GroupSnapshotsV319Test-175723620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:27:46 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-4e96da0f-b154-4efd-9af6-0666d74bfd81 tempest-GroupSnapshotsV319Test-175723620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:27:46 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-4e96da0f-b154-4efd-9af6-0666d74bfd81 tempest-GroupSnapshotsV319Test-175723620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:27:46 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-4e96da0f-b154-4efd-9af6-0666d74bfd81 tempest-GroupSnapshotsV319Test-175723620 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:27:46 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-4e96da0f-b154-4efd-9af6-0666d74bfd81 tempest-GroupSnapshotsV319Test-175723620 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:27:46 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4e96da0f-b154-4efd-9af6-0666d74bfd81 tempest-GroupSnapshotsV319Test-175723620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c9075825-c8cf-49e0-890c-d406feddeaf2 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:27:46 devstack sudo[102535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c9075825-c8cf-49e0-890c-d406feddeaf2 1073741824 Aug 26 14:27:46 devstack sudo[102535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:27:46 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd779054-bf20-4523-be0e-ef009678d2cf tempest-GroupsTest-1464118442 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:27:46 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-fd779054-bf20-4523-be0e-ef009678d2cf tempest-GroupsTest-1464118442 None] Flow 'volume_create_manager' (cbb63012-d68c-45f4-a519-2ed19f438bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:27:46 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-fd779054-bf20-4523-be0e-ef009678d2cf tempest-GroupsTest-1464118442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c094eb6-53bb-4002-983d-7cd9d14feea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:27:46 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-fd779054-bf20-4523-be0e-ef009678d2cf tempest-GroupsTest-1464118442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c094eb6-53bb-4002-983d-7cd9d14feea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:27:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-47263159',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2aeca824-8a99-4cd3-bc5f-61e13f9d7f88,host='devstack@QuobyteHD#QuobyteHD',id=2b88898b-5e30-49ce-ae4f-3a29ad0c4b79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1aa9d232e4243b29c8fd5131f8e2e52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:27:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:27:47Z,use_quota=True,user_id='4d961995b2fe49a4af47387ab070711e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cafc1880-64c1-4815-9b51-6cae9170e3bc),volume_type_id=cafc1880-64c1-4815-9b51-6cae9170e3bc)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:27:46 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-fd779054-bf20-4523-be0e-ef009678d2cf tempest-GroupsTest-1464118442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc7bd34a-0619-45c8-a31d-cc87127c9b81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:27:46 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-fd779054-bf20-4523-be0e-ef009678d2cf tempest-GroupsTest-1464118442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc7bd34a-0619-45c8-a31d-cc87127c9b81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:27:46 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-fd779054-bf20-4523-be0e-ef009678d2cf tempest-GroupsTest-1464118442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ebfe5b3-e8c4-4ce4-8b50-c274087888bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:27:46 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-fd779054-bf20-4523-be0e-ef009678d2cf tempest-GroupsTest-1464118442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ebfe5b3-e8c4-4ce4-8b50-c274087888bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b88898b-5e30-49ce-ae4f-3a29ad0c4b79', 'volume_name': 'volume-2b88898b-5e30-49ce-ae4f-3a29ad0c4b79', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:27:46 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-fd779054-bf20-4523-be0e-ef009678d2cf tempest-GroupsTest-1464118442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad957558-bb5d-45e2-ae8d-6196c2fb8c5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:27:46 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-fd779054-bf20-4523-be0e-ef009678d2cf tempest-GroupsTest-1464118442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad957558-bb5d-45e2-ae8d-6196c2fb8c5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:27:46 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-fd779054-bf20-4523-be0e-ef009678d2cf tempest-GroupsTest-1464118442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (befc5e2a-2605-4b51-8f71-2d6b00c2fad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:27:46 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-fd779054-bf20-4523-be0e-ef009678d2cf tempest-GroupsTest-1464118442 None] Volume 2b88898b-5e30-49ce-ae4f-3a29ad0c4b79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b88898b-5e30-49ce-ae4f-3a29ad0c4b79', 'volume_size': 1} Aug 26 14:27:46 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-fd779054-bf20-4523-be0e-ef009678d2cf tempest-GroupsTest-1464118442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:27:47 devstack sudo[102535]: pam_unix(sudo:session): session closed for user root Aug 26 14:27:47 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4e96da0f-b154-4efd-9af6-0666d74bfd81 tempest-GroupSnapshotsV319Test-175723620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c9075825-c8cf-49e0-890c-d406feddeaf2 1073741824" returned: 0 in 0.605s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:27:47 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4e96da0f-b154-4efd-9af6-0666d74bfd81 tempest-GroupSnapshotsV319Test-175723620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c9075825-c8cf-49e0-890c-d406feddeaf2 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:27:47 devstack sudo[102541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c9075825-c8cf-49e0-890c-d406feddeaf2 Aug 26 14:27:47 devstack sudo[102541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:27:47 devstack sudo[102541]: pam_unix(sudo:session): session closed for user root Aug 26 14:27:47 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4e96da0f-b154-4efd-9af6-0666d74bfd81 tempest-GroupSnapshotsV319Test-175723620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c9075825-c8cf-49e0-890c-d406feddeaf2" returned: 0 in 0.305s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:27:47 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-4e96da0f-b154-4efd-9af6-0666d74bfd81 tempest-GroupSnapshotsV319Test-175723620 None] <== create_volume: return (973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:27:47 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-4e96da0f-b154-4efd-9af6-0666d74bfd81 tempest-GroupSnapshotsV319Test-175723620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.977s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:27:47 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-fd779054-bf20-4523-be0e-ef009678d2cf tempest-GroupsTest-1464118442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.706s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:27:47 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-fd779054-bf20-4523-be0e-ef009678d2cf tempest-GroupsTest-1464118442 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2aeca824-8a99-4cd3-bc5f-61e13f9d7f88,created_at=2026-08-26T12:27:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-47263159',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2aeca824-8a99-4cd3-bc5f-61e13f9d7f88,host='devstack@QuobyteHD#QuobyteHD',id=2b88898b-5e30-49ce-ae4f-3a29ad0c4b79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1aa9d232e4243b29c8fd5131f8e2e52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:27:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:27:47Z,use_quota=True,user_id='4d961995b2fe49a4af47387ab070711e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cafc1880-64c1-4815-9b51-6cae9170e3bc),volume_type_id=cafc1880-64c1-4815-9b51-6cae9170e3bc)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:27:47 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-fd779054-bf20-4523-be0e-ef009678d2cf tempest-GroupsTest-1464118442 None] Creating volume 2b88898b-5e30-49ce-ae4f-3a29ad0c4b79 {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:27:47 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-fd779054-bf20-4523-be0e-ef009678d2cf tempest-GroupsTest-1464118442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:27:47 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-fd779054-bf20-4523-be0e-ef009678d2cf tempest-GroupsTest-1464118442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:27:47 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-fd779054-bf20-4523-be0e-ef009678d2cf tempest-GroupsTest-1464118442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:27:47 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-fd779054-bf20-4523-be0e-ef009678d2cf tempest-GroupsTest-1464118442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:27:47 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-fd779054-bf20-4523-be0e-ef009678d2cf tempest-GroupsTest-1464118442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:27:47 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-fd779054-bf20-4523-be0e-ef009678d2cf tempest-GroupsTest-1464118442 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:27:47 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-fd779054-bf20-4523-be0e-ef009678d2cf tempest-GroupsTest-1464118442 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:27:47 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-fd779054-bf20-4523-be0e-ef009678d2cf tempest-GroupsTest-1464118442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2b88898b-5e30-49ce-ae4f-3a29ad0c4b79 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:27:47 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-4e96da0f-b154-4efd-9af6-0666d74bfd81 tempest-GroupSnapshotsV319Test-175723620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7359a22d-2b84-4605-8307-f50e4caa756d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9075825-c8cf-49e0-890c-d406feddeaf2', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:27:47 devstack sudo[102544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2b88898b-5e30-49ce-ae4f-3a29ad0c4b79 1073741824 Aug 26 14:27:47 devstack sudo[102544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:27:47 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-4e96da0f-b154-4efd-9af6-0666d74bfd81 tempest-GroupSnapshotsV319Test-175723620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b26bd09-1bc8-483a-8bf2-b013d52e79de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:27:47 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-4e96da0f-b154-4efd-9af6-0666d74bfd81 tempest-GroupSnapshotsV319Test-175723620 None] Volume volume-c9075825-c8cf-49e0-890c-d406feddeaf2 (c9075825-c8cf-49e0-890c-d406feddeaf2): created successfully Aug 26 14:27:47 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-4e96da0f-b154-4efd-9af6-0666d74bfd81 tempest-GroupSnapshotsV319Test-175723620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b26bd09-1bc8-483a-8bf2-b013d52e79de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:27:47 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-4e96da0f-b154-4efd-9af6-0666d74bfd81 tempest-GroupSnapshotsV319Test-175723620 None] Flow 'volume_create_manager' (86213547-0bc6-4749-9ab9-f11515ada200) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:27:47 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-4e96da0f-b154-4efd-9af6-0666d74bfd81 tempest-GroupSnapshotsV319Test-175723620 None] Created volume successfully. Aug 26 14:27:48 devstack sudo[102544]: pam_unix(sudo:session): session closed for user root Aug 26 14:27:48 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-fd779054-bf20-4523-be0e-ef009678d2cf tempest-GroupsTest-1464118442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2b88898b-5e30-49ce-ae4f-3a29ad0c4b79 1073741824" returned: 0 in 0.588s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:27:48 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-fd779054-bf20-4523-be0e-ef009678d2cf tempest-GroupsTest-1464118442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2b88898b-5e30-49ce-ae4f-3a29ad0c4b79 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:27:48 devstack sudo[102550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2b88898b-5e30-49ce-ae4f-3a29ad0c4b79 Aug 26 14:27:48 devstack sudo[102550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:27:48 devstack sudo[102550]: pam_unix(sudo:session): session closed for user root Aug 26 14:27:48 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-fd779054-bf20-4523-be0e-ef009678d2cf tempest-GroupsTest-1464118442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2b88898b-5e30-49ce-ae4f-3a29ad0c4b79" returned: 0 in 0.290s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:27:48 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-fd779054-bf20-4523-be0e-ef009678d2cf tempest-GroupsTest-1464118442 None] <== create_volume: return (924ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:27:48 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-fd779054-bf20-4523-be0e-ef009678d2cf tempest-GroupsTest-1464118442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.928s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:27:48 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-fd779054-bf20-4523-be0e-ef009678d2cf tempest-GroupsTest-1464118442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (befc5e2a-2605-4b51-8f71-2d6b00c2fad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b88898b-5e30-49ce-ae4f-3a29ad0c4b79', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:27:48 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-fd779054-bf20-4523-be0e-ef009678d2cf tempest-GroupsTest-1464118442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fb86260-1923-42e4-a662-9420151f7ee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:27:48 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-fd779054-bf20-4523-be0e-ef009678d2cf tempest-GroupsTest-1464118442 None] Volume volume-2b88898b-5e30-49ce-ae4f-3a29ad0c4b79 (2b88898b-5e30-49ce-ae4f-3a29ad0c4b79): created successfully Aug 26 14:27:48 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-fd779054-bf20-4523-be0e-ef009678d2cf tempest-GroupsTest-1464118442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fb86260-1923-42e4-a662-9420151f7ee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:27:48 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-fd779054-bf20-4523-be0e-ef009678d2cf tempest-GroupsTest-1464118442 None] Flow 'volume_create_manager' (cbb63012-d68c-45f4-a519-2ed19f438bc1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:27:48 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-fd779054-bf20-4523-be0e-ef009678d2cf tempest-GroupsTest-1464118442 None] Created volume successfully. Aug 26 14:27:49 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-ce934997-47e3-4875-abe0-fea3451ef36d tempest-GroupSnapshotsV319Test-175723620 None] GroupSnapshot d25763d5-086c-453b-8bc7-c4fbabb5cc3d: creating. Aug 26 14:27:49 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-ce934997-47e3-4875-abe0-fea3451ef36d tempest-GroupSnapshotsV319Test-175723620 None] Group snapshot d25763d5-086c-453b-8bc7-c4fbabb5cc3d: creating. {{(pid=94394) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 26 14:27:49 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-ce934997-47e3-4875-abe0-fea3451ef36d tempest-GroupSnapshotsV319Test-175723620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:27:49 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-ce934997-47e3-4875-abe0-fea3451ef36d tempest-GroupSnapshotsV319Test-175723620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:27:49 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-ce934997-47e3-4875-abe0-fea3451ef36d tempest-GroupSnapshotsV319Test-175723620 None] Creating offline snapshot 13d3d90b-e8b0-4c1a-8414-c49dc8a0c053 of volume c9075825-c8cf-49e0-890c-d406feddeaf2 {{(pid=94394) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 14:27:49 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f90cfa3-d4f5-4955-b737-fac62e1ed2da]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:27:49 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-ce934997-47e3-4875-abe0-fea3451ef36d tempest-GroupSnapshotsV319Test-175723620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c9075825-c8cf-49e0-890c-d406feddeaf2 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:27:49 devstack sudo[102554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c9075825-c8cf-49e0-890c-d406feddeaf2 Aug 26 14:27:49 devstack sudo[102554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:27:50 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-c97ed285-0054-428b-80f4-80b26d359675 tempest-GroupsTest-1464118442 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:27:50 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-c97ed285-0054-428b-80f4-80b26d359675 tempest-GroupsTest-1464118442 None] Flow 'volume_create_manager' (266fe82d-09af-4b65-8358-6bc4bd81a1f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:27:50 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-c97ed285-0054-428b-80f4-80b26d359675 tempest-GroupsTest-1464118442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf896b06-c723-472d-b48b-f23a7e789c42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:27:50 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-c97ed285-0054-428b-80f4-80b26d359675 tempest-GroupsTest-1464118442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf896b06-c723-472d-b48b-f23a7e789c42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:27:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-35401789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2aeca824-8a99-4cd3-bc5f-61e13f9d7f88,host='devstack@QuobyteHD#QuobyteHD',id=5b9244ea-4004-415f-b223-80c2d2e6f55d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1aa9d232e4243b29c8fd5131f8e2e52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:27:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:27:50Z,use_quota=True,user_id='4d961995b2fe49a4af47387ab070711e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cafc1880-64c1-4815-9b51-6cae9170e3bc),volume_type_id=cafc1880-64c1-4815-9b51-6cae9170e3bc)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:27:50 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-c97ed285-0054-428b-80f4-80b26d359675 tempest-GroupsTest-1464118442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87e8ec3c-6ae5-4b14-8ee9-eb7d680d9f9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:27:50 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-c97ed285-0054-428b-80f4-80b26d359675 tempest-GroupsTest-1464118442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87e8ec3c-6ae5-4b14-8ee9-eb7d680d9f9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:27:50 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-c97ed285-0054-428b-80f4-80b26d359675 tempest-GroupsTest-1464118442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (108f2c13-ec18-43ac-a93d-a3559fd6c55a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:27:50 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-c97ed285-0054-428b-80f4-80b26d359675 tempest-GroupsTest-1464118442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (108f2c13-ec18-43ac-a93d-a3559fd6c55a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b9244ea-4004-415f-b223-80c2d2e6f55d', 'volume_name': 'volume-5b9244ea-4004-415f-b223-80c2d2e6f55d', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:27:50 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-c97ed285-0054-428b-80f4-80b26d359675 tempest-GroupsTest-1464118442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6eec8d50-0bc5-443b-8255-a5377352cd0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:27:50 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-c97ed285-0054-428b-80f4-80b26d359675 tempest-GroupsTest-1464118442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6eec8d50-0bc5-443b-8255-a5377352cd0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:27:50 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-c97ed285-0054-428b-80f4-80b26d359675 tempest-GroupsTest-1464118442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32cc14f4-2975-4dd5-8a9c-6896277ede02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:27:50 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-c97ed285-0054-428b-80f4-80b26d359675 tempest-GroupsTest-1464118442 None] Volume 5b9244ea-4004-415f-b223-80c2d2e6f55d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b9244ea-4004-415f-b223-80c2d2e6f55d', 'volume_size': 1} Aug 26 14:27:50 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-c97ed285-0054-428b-80f4-80b26d359675 tempest-GroupsTest-1464118442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:27:50 devstack sudo[102554]: pam_unix(sudo:session): session closed for user root Aug 26 14:27:50 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-ce934997-47e3-4875-abe0-fea3451ef36d tempest-GroupSnapshotsV319Test-175723620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c9075825-c8cf-49e0-890c-d406feddeaf2" returned: 0 in 0.513s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:27:50 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-ce934997-47e3-4875-abe0-fea3451ef36d tempest-GroupSnapshotsV319Test-175723620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c9075825-c8cf-49e0-890c-d406feddeaf2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c9075825-c8cf-49e0-890c-d406feddeaf2.13d3d90b-e8b0-4c1a-8414-c49dc8a0c053 1G {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:27:50 devstack sudo[102559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c9075825-c8cf-49e0-890c-d406feddeaf2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c9075825-c8cf-49e0-890c-d406feddeaf2.13d3d90b-e8b0-4c1a-8414-c49dc8a0c053 1G Aug 26 14:27:50 devstack sudo[102559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:27:50 devstack sudo[102559]: pam_unix(sudo:session): session closed for user root Aug 26 14:27:50 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-ce934997-47e3-4875-abe0-fea3451ef36d tempest-GroupSnapshotsV319Test-175723620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c9075825-c8cf-49e0-890c-d406feddeaf2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c9075825-c8cf-49e0-890c-d406feddeaf2.13d3d90b-e8b0-4c1a-8414-c49dc8a0c053 1G" returned: 0 in 0.439s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:27:50 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-ce934997-47e3-4875-abe0-fea3451ef36d tempest-GroupSnapshotsV319Test-175723620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9075825-c8cf-49e0-890c-d406feddeaf2 -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c9075825-c8cf-49e0-890c-d406feddeaf2.13d3d90b-e8b0-4c1a-8414-c49dc8a0c053 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:27:50 devstack sudo[102564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9075825-c8cf-49e0-890c-d406feddeaf2 -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c9075825-c8cf-49e0-890c-d406feddeaf2.13d3d90b-e8b0-4c1a-8414-c49dc8a0c053 Aug 26 14:27:50 devstack sudo[102564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:27:51 devstack sudo[102564]: pam_unix(sudo:session): session closed for user root Aug 26 14:27:51 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-ce934997-47e3-4875-abe0-fea3451ef36d tempest-GroupSnapshotsV319Test-175723620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9075825-c8cf-49e0-890c-d406feddeaf2 -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c9075825-c8cf-49e0-890c-d406feddeaf2.13d3d90b-e8b0-4c1a-8414-c49dc8a0c053" returned: 0 in 0.357s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:27:51 devstack cinder-volume[94394]: WARNING cinder.volume.drivers.remotefs [None req-ce934997-47e3-4875-abe0-fea3451ef36d tempest-GroupSnapshotsV319Test-175723620 None] /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c9075825-c8cf-49e0-890c-d406feddeaf2.13d3d90b-e8b0-4c1a-8414-c49dc8a0c053 is being set with open permissions: ugo+rw: NotImplementedError Aug 26 14:27:51 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-ce934997-47e3-4875-abe0-fea3451ef36d tempest-GroupSnapshotsV319Test-175723620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c9075825-c8cf-49e0-890c-d406feddeaf2.13d3d90b-e8b0-4c1a-8414-c49dc8a0c053 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:27:51 devstack sudo[102573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c9075825-c8cf-49e0-890c-d406feddeaf2.13d3d90b-e8b0-4c1a-8414-c49dc8a0c053 Aug 26 14:27:51 devstack sudo[102573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:27:51 devstack sudo[102573]: pam_unix(sudo:session): session closed for user root Aug 26 14:27:51 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-ce934997-47e3-4875-abe0-fea3451ef36d tempest-GroupSnapshotsV319Test-175723620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c9075825-c8cf-49e0-890c-d406feddeaf2.13d3d90b-e8b0-4c1a-8414-c49dc8a0c053" returned: 0 in 0.340s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:27:51 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-ce934997-47e3-4875-abe0-fea3451ef36d tempest-GroupSnapshotsV319Test-175723620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c9075825-c8cf-49e0-890c-d406feddeaf2.info {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:27:51 devstack sudo[102576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c9075825-c8cf-49e0-890c-d406feddeaf2.info Aug 26 14:27:51 devstack sudo[102576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:27:51 devstack sudo[102576]: pam_unix(sudo:session): session closed for user root Aug 26 14:27:51 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-ce934997-47e3-4875-abe0-fea3451ef36d tempest-GroupSnapshotsV319Test-175723620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c9075825-c8cf-49e0-890c-d406feddeaf2.info" returned: 0 in 0.304s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:27:51 devstack cinder-volume[94394]: WARNING cinder.volume.drivers.remotefs [None req-ce934997-47e3-4875-abe0-fea3451ef36d tempest-GroupSnapshotsV319Test-175723620 None] /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c9075825-c8cf-49e0-890c-d406feddeaf2.info is being set with open permissions: ugo+rw: NotImplementedError Aug 26 14:27:51 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-ce934997-47e3-4875-abe0-fea3451ef36d tempest-GroupSnapshotsV319Test-175723620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c9075825-c8cf-49e0-890c-d406feddeaf2.info {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:27:51 devstack sudo[102579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c9075825-c8cf-49e0-890c-d406feddeaf2.info Aug 26 14:27:51 devstack sudo[102579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:27:52 devstack sudo[102579]: pam_unix(sudo:session): session closed for user root Aug 26 14:27:52 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-ce934997-47e3-4875-abe0-fea3451ef36d tempest-GroupSnapshotsV319Test-175723620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c9075825-c8cf-49e0-890c-d406feddeaf2.info" returned: 0 in 0.294s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:27:52 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-ce934997-47e3-4875-abe0-fea3451ef36d tempest-GroupSnapshotsV319Test-175723620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.378s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:27:52 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-c97ed285-0054-428b-80f4-80b26d359675 tempest-GroupsTest-1464118442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.915s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:27:52 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-c97ed285-0054-428b-80f4-80b26d359675 tempest-GroupsTest-1464118442 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2aeca824-8a99-4cd3-bc5f-61e13f9d7f88,created_at=2026-08-26T12:27:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-35401789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2aeca824-8a99-4cd3-bc5f-61e13f9d7f88,host='devstack@QuobyteHD#QuobyteHD',id=5b9244ea-4004-415f-b223-80c2d2e6f55d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1aa9d232e4243b29c8fd5131f8e2e52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:27:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:27:50Z,use_quota=True,user_id='4d961995b2fe49a4af47387ab070711e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cafc1880-64c1-4815-9b51-6cae9170e3bc),volume_type_id=cafc1880-64c1-4815-9b51-6cae9170e3bc)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:27:52 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-c97ed285-0054-428b-80f4-80b26d359675 tempest-GroupsTest-1464118442 None] Creating volume 5b9244ea-4004-415f-b223-80c2d2e6f55d {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:27:52 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-c97ed285-0054-428b-80f4-80b26d359675 tempest-GroupsTest-1464118442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:27:52 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-c97ed285-0054-428b-80f4-80b26d359675 tempest-GroupsTest-1464118442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:27:52 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-c97ed285-0054-428b-80f4-80b26d359675 tempest-GroupsTest-1464118442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:27:52 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-c97ed285-0054-428b-80f4-80b26d359675 tempest-GroupsTest-1464118442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:27:52 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-c97ed285-0054-428b-80f4-80b26d359675 tempest-GroupsTest-1464118442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:27:52 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-c97ed285-0054-428b-80f4-80b26d359675 tempest-GroupsTest-1464118442 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:27:52 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-c97ed285-0054-428b-80f4-80b26d359675 tempest-GroupsTest-1464118442 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:27:52 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-c97ed285-0054-428b-80f4-80b26d359675 tempest-GroupsTest-1464118442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5b9244ea-4004-415f-b223-80c2d2e6f55d 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:27:52 devstack sudo[102583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5b9244ea-4004-415f-b223-80c2d2e6f55d 1073741824 Aug 26 14:27:52 devstack sudo[102583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:27:52 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-ce934997-47e3-4875-abe0-fea3451ef36d tempest-GroupSnapshotsV319Test-175723620 None] group_snapshot d25763d5-086c-453b-8bc7-c4fbabb5cc3d: created successfully Aug 26 14:27:52 devstack sudo[102583]: pam_unix(sudo:session): session closed for user root Aug 26 14:27:52 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-c97ed285-0054-428b-80f4-80b26d359675 tempest-GroupsTest-1464118442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5b9244ea-4004-415f-b223-80c2d2e6f55d 1073741824" returned: 0 in 0.670s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:27:52 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-c97ed285-0054-428b-80f4-80b26d359675 tempest-GroupsTest-1464118442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5b9244ea-4004-415f-b223-80c2d2e6f55d {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:27:52 devstack sudo[102589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5b9244ea-4004-415f-b223-80c2d2e6f55d Aug 26 14:27:52 devstack sudo[102589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:27:53 devstack sudo[102589]: pam_unix(sudo:session): session closed for user root Aug 26 14:27:53 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-c97ed285-0054-428b-80f4-80b26d359675 tempest-GroupsTest-1464118442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5b9244ea-4004-415f-b223-80c2d2e6f55d" returned: 0 in 0.345s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:27:53 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-c97ed285-0054-428b-80f4-80b26d359675 tempest-GroupsTest-1464118442 None] <== create_volume: return (1075ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:27:53 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-c97ed285-0054-428b-80f4-80b26d359675 tempest-GroupsTest-1464118442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.078s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:27:53 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-c97ed285-0054-428b-80f4-80b26d359675 tempest-GroupsTest-1464118442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32cc14f4-2975-4dd5-8a9c-6896277ede02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b9244ea-4004-415f-b223-80c2d2e6f55d', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:27:53 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-c97ed285-0054-428b-80f4-80b26d359675 tempest-GroupsTest-1464118442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a59c6e49-7aa0-48a6-a601-1f532acd82f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:27:53 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-c97ed285-0054-428b-80f4-80b26d359675 tempest-GroupsTest-1464118442 None] Volume volume-5b9244ea-4004-415f-b223-80c2d2e6f55d (5b9244ea-4004-415f-b223-80c2d2e6f55d): created successfully Aug 26 14:27:53 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-c97ed285-0054-428b-80f4-80b26d359675 tempest-GroupsTest-1464118442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a59c6e49-7aa0-48a6-a601-1f532acd82f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:27:53 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-c97ed285-0054-428b-80f4-80b26d359675 tempest-GroupsTest-1464118442 None] Flow 'volume_create_manager' (266fe82d-09af-4b65-8358-6bc4bd81a1f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:27:53 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-c97ed285-0054-428b-80f4-80b26d359675 tempest-GroupsTest-1464118442 None] Created volume successfully. Aug 26 14:27:53 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-e32da9f2-738b-418f-9a15-dcb106f1ada6 tempest-GroupSnapshotsV319Test-175723620 None] group_snapshot d25763d5-086c-453b-8bc7-c4fbabb5cc3d: deleting Aug 26 14:27:53 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-e32da9f2-738b-418f-9a15-dcb106f1ada6 tempest-GroupSnapshotsV319Test-175723620 None] group_snapshot d25763d5-086c-453b-8bc7-c4fbabb5cc3d: deleting {{(pid=94394) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 26 14:27:53 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-e32da9f2-738b-418f-9a15-dcb106f1ada6 tempest-GroupSnapshotsV319Test-175723620 None] Acquiring lock "cinder-quobyte-c9075825-c8cf-49e0-890c-d406feddeaf2" by "delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:27:53 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-e32da9f2-738b-418f-9a15-dcb106f1ada6 tempest-GroupSnapshotsV319Test-175723620 None] Lock "cinder-quobyte-c9075825-c8cf-49e0-890c-d406feddeaf2" acquired by "delete_snapshot" :: waited 0.025s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:27:53 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-e32da9f2-738b-418f-9a15-dcb106f1ada6 tempest-GroupSnapshotsV319Test-175723620 None] Acquiring lock "cinder-quobyte-13d3d90b-e8b0-4c1a-8414-c49dc8a0c053" by "_delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:27:53 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-e32da9f2-738b-418f-9a15-dcb106f1ada6 tempest-GroupSnapshotsV319Test-175723620 None] Lock "cinder-quobyte-13d3d90b-e8b0-4c1a-8414-c49dc8a0c053" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:27:53 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-e32da9f2-738b-418f-9a15-dcb106f1ada6 tempest-GroupSnapshotsV319Test-175723620 None] Deleting offline snapshot 13d3d90b-e8b0-4c1a-8414-c49dc8a0c053 of volume c9075825-c8cf-49e0-890c-d406feddeaf2 {{(pid=94394) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 14:27:53 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-e32da9f2-738b-418f-9a15-dcb106f1ada6 tempest-GroupSnapshotsV319Test-175723620 None] snapshot_file for this snap is: volume-c9075825-c8cf-49e0-890c-d406feddeaf2.13d3d90b-e8b0-4c1a-8414-c49dc8a0c053 {{(pid=94394) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 14:27:53 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e093a64-1624-407b-b94c-b19489362eb0]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:27:53 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e32da9f2-738b-418f-9a15-dcb106f1ada6 tempest-GroupSnapshotsV319Test-175723620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c9075825-c8cf-49e0-890c-d406feddeaf2.13d3d90b-e8b0-4c1a-8414-c49dc8a0c053 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:27:53 devstack sudo[102605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c9075825-c8cf-49e0-890c-d406feddeaf2.13d3d90b-e8b0-4c1a-8414-c49dc8a0c053 Aug 26 14:27:53 devstack sudo[102605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:27:53 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-a5f05fd0-f42d-47f7-b27c-141f8352f3e2 tempest-GroupsTest-1464118442 None] Update group completed successfully. Aug 26 14:27:54 devstack sudo[102605]: pam_unix(sudo:session): session closed for user root Aug 26 14:27:54 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e32da9f2-738b-418f-9a15-dcb106f1ada6 tempest-GroupSnapshotsV319Test-175723620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c9075825-c8cf-49e0-890c-d406feddeaf2.13d3d90b-e8b0-4c1a-8414-c49dc8a0c053" returned: 0 in 0.534s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:27:54 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-e32da9f2-738b-418f-9a15-dcb106f1ada6 tempest-GroupSnapshotsV319Test-175723620 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c9075825-c8cf-49e0-890c-d406feddeaf2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94394) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 14:27:54 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[216bba99-016a-4c7f-81aa-4b51dd9327a2]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:27:54 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e32da9f2-738b-418f-9a15-dcb106f1ada6 tempest-GroupSnapshotsV319Test-175723620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c9075825-c8cf-49e0-890c-d406feddeaf2 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:27:54 devstack sudo[102615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c9075825-c8cf-49e0-890c-d406feddeaf2 Aug 26 14:27:54 devstack sudo[102615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:27:54 devstack sudo[102615]: pam_unix(sudo:session): session closed for user root Aug 26 14:27:54 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e32da9f2-738b-418f-9a15-dcb106f1ada6 tempest-GroupSnapshotsV319Test-175723620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c9075825-c8cf-49e0-890c-d406feddeaf2" returned: 0 in 0.391s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:27:54 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e32da9f2-738b-418f-9a15-dcb106f1ada6 tempest-GroupSnapshotsV319Test-175723620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c9075825-c8cf-49e0-890c-d406feddeaf2.13d3d90b-e8b0-4c1a-8414-c49dc8a0c053 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:27:54 devstack sudo[102621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c9075825-c8cf-49e0-890c-d406feddeaf2.13d3d90b-e8b0-4c1a-8414-c49dc8a0c053 Aug 26 14:27:54 devstack sudo[102621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:27:54 devstack sudo[102621]: pam_unix(sudo:session): session closed for user root Aug 26 14:27:54 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e32da9f2-738b-418f-9a15-dcb106f1ada6 tempest-GroupSnapshotsV319Test-175723620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c9075825-c8cf-49e0-890c-d406feddeaf2.13d3d90b-e8b0-4c1a-8414-c49dc8a0c053" returned: 0 in 0.415s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:27:54 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e32da9f2-738b-418f-9a15-dcb106f1ada6 tempest-GroupSnapshotsV319Test-175723620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c9075825-c8cf-49e0-890c-d406feddeaf2.13d3d90b-e8b0-4c1a-8414-c49dc8a0c053 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:27:55 devstack sudo[102628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c9075825-c8cf-49e0-890c-d406feddeaf2.13d3d90b-e8b0-4c1a-8414-c49dc8a0c053 Aug 26 14:27:55 devstack sudo[102628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:27:55 devstack sudo[102628]: pam_unix(sudo:session): session closed for user root Aug 26 14:27:55 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e32da9f2-738b-418f-9a15-dcb106f1ada6 tempest-GroupSnapshotsV319Test-175723620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c9075825-c8cf-49e0-890c-d406feddeaf2.13d3d90b-e8b0-4c1a-8414-c49dc8a0c053" returned: 0 in 0.294s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:27:55 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-e32da9f2-738b-418f-9a15-dcb106f1ada6 tempest-GroupSnapshotsV319Test-175723620 None] Lock "cinder-quobyte-13d3d90b-e8b0-4c1a-8414-c49dc8a0c053" released by "_delete_snapshot" :: held 1.787s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:27:55 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-e32da9f2-738b-418f-9a15-dcb106f1ada6 tempest-GroupSnapshotsV319Test-175723620 None] Lock "cinder-quobyte-c9075825-c8cf-49e0-890c-d406feddeaf2" released by "delete_snapshot" :: held 1.824s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:27:55 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-cecd70ec-f457-46c3-af88-b0bcf1f9e38a tempest-GroupsTest-1464118442 None] Update group completed successfully. Aug 26 14:27:55 devstack cinder-volume[94394]: WARNING cinder.quota [None req-e32da9f2-738b-418f-9a15-dcb106f1ada6 tempest-GroupSnapshotsV319Test-175723620 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-410969105 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-410969105, it is now deprecated. Please use the default quota class for default quota. Aug 26 14:27:55 devstack cinder-volume[94394]: WARNING cinder.quota [None req-e32da9f2-738b-418f-9a15-dcb106f1ada6 tempest-GroupSnapshotsV319Test-175723620 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-410969105 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-410969105, it is now deprecated. Please use the default quota class for default quota. Aug 26 14:27:55 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-e32da9f2-738b-418f-9a15-dcb106f1ada6 tempest-GroupSnapshotsV319Test-175723620 None] Created reservations ['844f5a88-6260-41b3-a266-9dde69a811a5', 'a35aae27-dd0c-44f8-b0f5-8c543a499835', 'a18f6efe-85de-4907-b02f-3c0a842ea2c1', '79351e56-3ed3-4cd5-befb-7f46bc4ed6b8'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:27:55 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-e32da9f2-738b-418f-9a15-dcb106f1ada6 tempest-GroupSnapshotsV319Test-175723620 None] group_snapshot d25763d5-086c-453b-8bc7-c4fbabb5cc3d: deleted successfully Aug 26 14:27:56 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-add92d0f-bbf4-4dd5-aa18-480ede621be5 tempest-GroupSnapshotsV319Test-175723620 None] Acquiring lock "cinder-quobyte-c9075825-c8cf-49e0-890c-d406feddeaf2" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:27:56 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-add92d0f-bbf4-4dd5-aa18-480ede621be5 tempest-GroupSnapshotsV319Test-175723620 None] Lock "cinder-quobyte-c9075825-c8cf-49e0-890c-d406feddeaf2" acquired by "delete_volume" :: waited 0.050s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:27:56 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[a69892c9-0bf8-4285-b227-0db65dfc1c40]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:27:56 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-add92d0f-bbf4-4dd5-aa18-480ede621be5 tempest-GroupSnapshotsV319Test-175723620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c9075825-c8cf-49e0-890c-d406feddeaf2 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:27:56 devstack sudo[102686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c9075825-c8cf-49e0-890c-d406feddeaf2 Aug 26 14:27:56 devstack sudo[102686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:27:56 devstack sudo[102686]: pam_unix(sudo:session): session closed for user root Aug 26 14:27:56 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-add92d0f-bbf4-4dd5-aa18-480ede621be5 tempest-GroupSnapshotsV319Test-175723620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c9075825-c8cf-49e0-890c-d406feddeaf2" returned: 0 in 0.431s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:27:56 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-add92d0f-bbf4-4dd5-aa18-480ede621be5 tempest-GroupSnapshotsV319Test-175723620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c9075825-c8cf-49e0-890c-d406feddeaf2 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:27:56 devstack sudo[102705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c9075825-c8cf-49e0-890c-d406feddeaf2 Aug 26 14:27:56 devstack sudo[102705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:27:57 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-f20c3b7a-cbea-46da-9aca-62068d9a5949 tempest-GroupsTest-1464118442 None] Acquiring lock "cinder-quobyte-2b88898b-5e30-49ce-ae4f-3a29ad0c4b79" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:27:57 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-f20c3b7a-cbea-46da-9aca-62068d9a5949 tempest-GroupsTest-1464118442 None] Lock "cinder-quobyte-2b88898b-5e30-49ce-ae4f-3a29ad0c4b79" acquired by "delete_volume" :: waited 0.029s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:27:57 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[86138b18-9ab8-4114-8566-8008cd8b6e49]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:27:57 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-f20c3b7a-cbea-46da-9aca-62068d9a5949 tempest-GroupsTest-1464118442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2b88898b-5e30-49ce-ae4f-3a29ad0c4b79 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:27:57 devstack sudo[102705]: pam_unix(sudo:session): session closed for user root Aug 26 14:27:57 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-add92d0f-bbf4-4dd5-aa18-480ede621be5 tempest-GroupSnapshotsV319Test-175723620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c9075825-c8cf-49e0-890c-d406feddeaf2" returned: 0 in 0.344s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:27:57 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-add92d0f-bbf4-4dd5-aa18-480ede621be5 tempest-GroupSnapshotsV319Test-175723620 None] Lock "cinder-quobyte-c9075825-c8cf-49e0-890c-d406feddeaf2" released by "delete_volume" :: held 0.913s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:27:57 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-add92d0f-bbf4-4dd5-aa18-480ede621be5 tempest-GroupSnapshotsV319Test-175723620 None] Created reservations ['068a5293-dfa1-4124-8f84-152c296e3c33'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:27:57 devstack cinder-volume[94394]: WARNING cinder.quota [None req-add92d0f-bbf4-4dd5-aa18-480ede621be5 tempest-GroupSnapshotsV319Test-175723620 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-410969105 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-410969105, it is now deprecated. Please use the default quota class for default quota. Aug 26 14:27:57 devstack sudo[102721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2b88898b-5e30-49ce-ae4f-3a29ad0c4b79 Aug 26 14:27:57 devstack sudo[102721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:27:57 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-add92d0f-bbf4-4dd5-aa18-480ede621be5 tempest-GroupSnapshotsV319Test-175723620 None] Created reservations ['bb0c2943-8dba-44fa-b98e-d15c336c2144', 'b25c4c37-467f-4e8e-a71d-bbc87bdd13f8', '31f84635-0577-44c7-b044-012689076214', 'ebe19065-4ac8-46f1-9475-2ac620eb4053'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:27:57 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-add92d0f-bbf4-4dd5-aa18-480ede621be5 tempest-GroupSnapshotsV319Test-175723620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:27:57 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-add92d0f-bbf4-4dd5-aa18-480ede621be5 tempest-GroupSnapshotsV319Test-175723620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:27:57 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-add92d0f-bbf4-4dd5-aa18-480ede621be5 tempest-GroupSnapshotsV319Test-175723620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:27:57 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-add92d0f-bbf4-4dd5-aa18-480ede621be5 tempest-GroupSnapshotsV319Test-175723620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:27:57 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-add92d0f-bbf4-4dd5-aa18-480ede621be5 tempest-GroupSnapshotsV319Test-175723620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:27:57 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-add92d0f-bbf4-4dd5-aa18-480ede621be5 tempest-GroupSnapshotsV319Test-175723620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:27:57 devstack sudo[102723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:27:57 devstack sudo[102723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:27:57 devstack sudo[102721]: pam_unix(sudo:session): session closed for user root Aug 26 14:27:57 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-f20c3b7a-cbea-46da-9aca-62068d9a5949 tempest-GroupsTest-1464118442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2b88898b-5e30-49ce-ae4f-3a29ad0c4b79" returned: 0 in 0.562s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:27:57 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-f20c3b7a-cbea-46da-9aca-62068d9a5949 tempest-GroupsTest-1464118442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2b88898b-5e30-49ce-ae4f-3a29ad0c4b79 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:27:57 devstack sudo[102728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2b88898b-5e30-49ce-ae4f-3a29ad0c4b79 Aug 26 14:27:57 devstack sudo[102728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:27:57 devstack sudo[102723]: pam_unix(sudo:session): session closed for user root Aug 26 14:27:57 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-add92d0f-bbf4-4dd5-aa18-480ede621be5 tempest-GroupSnapshotsV319Test-175723620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.343s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:27:57 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-add92d0f-bbf4-4dd5-aa18-480ede621be5 tempest-GroupSnapshotsV319Test-175723620 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:27:57 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-add92d0f-bbf4-4dd5-aa18-480ede621be5 tempest-GroupSnapshotsV319Test-175723620 None] Delete group completed successfully. Aug 26 14:27:58 devstack sudo[102728]: pam_unix(sudo:session): session closed for user root Aug 26 14:27:58 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-f20c3b7a-cbea-46da-9aca-62068d9a5949 tempest-GroupsTest-1464118442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2b88898b-5e30-49ce-ae4f-3a29ad0c4b79" returned: 0 in 0.331s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:27:58 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-f20c3b7a-cbea-46da-9aca-62068d9a5949 tempest-GroupsTest-1464118442 None] Lock "cinder-quobyte-2b88898b-5e30-49ce-ae4f-3a29ad0c4b79" released by "delete_volume" :: held 0.944s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:27:58 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-f20c3b7a-cbea-46da-9aca-62068d9a5949 tempest-GroupsTest-1464118442 None] Acquiring lock "cinder-quobyte-5b9244ea-4004-415f-b223-80c2d2e6f55d" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:27:58 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-f20c3b7a-cbea-46da-9aca-62068d9a5949 tempest-GroupsTest-1464118442 None] Lock "cinder-quobyte-5b9244ea-4004-415f-b223-80c2d2e6f55d" acquired by "delete_volume" :: waited 0.017s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:27:58 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b3d3bbc-2361-4157-ae92-e55dd8e505af]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:27:58 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-f20c3b7a-cbea-46da-9aca-62068d9a5949 tempest-GroupsTest-1464118442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5b9244ea-4004-415f-b223-80c2d2e6f55d {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:27:58 devstack sudo[102734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5b9244ea-4004-415f-b223-80c2d2e6f55d Aug 26 14:27:58 devstack sudo[102734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:27:58 devstack sudo[102734]: pam_unix(sudo:session): session closed for user root Aug 26 14:27:58 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-f20c3b7a-cbea-46da-9aca-62068d9a5949 tempest-GroupsTest-1464118442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5b9244ea-4004-415f-b223-80c2d2e6f55d" returned: 0 in 0.647s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:27:58 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-f20c3b7a-cbea-46da-9aca-62068d9a5949 tempest-GroupsTest-1464118442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5b9244ea-4004-415f-b223-80c2d2e6f55d {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:27:58 devstack sudo[102739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5b9244ea-4004-415f-b223-80c2d2e6f55d Aug 26 14:27:58 devstack sudo[102739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:27:59 devstack sudo[102739]: pam_unix(sudo:session): session closed for user root Aug 26 14:27:59 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-f20c3b7a-cbea-46da-9aca-62068d9a5949 tempest-GroupsTest-1464118442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5b9244ea-4004-415f-b223-80c2d2e6f55d" returned: 0 in 0.359s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:27:59 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-f20c3b7a-cbea-46da-9aca-62068d9a5949 tempest-GroupsTest-1464118442 None] Lock "cinder-quobyte-5b9244ea-4004-415f-b223-80c2d2e6f55d" released by "delete_volume" :: held 1.086s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:27:59 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-f20c3b7a-cbea-46da-9aca-62068d9a5949 tempest-GroupsTest-1464118442 None] Created reservations ['1e4f0e35-f98d-4b1e-85c0-3e00d0f61b2a'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:27:59 devstack cinder-volume[94394]: WARNING cinder.quota [None req-f20c3b7a-cbea-46da-9aca-62068d9a5949 tempest-GroupsTest-1464118442 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1365892903 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1365892903, it is now deprecated. Please use the default quota class for default quota. Aug 26 14:27:59 devstack cinder-volume[94394]: WARNING cinder.quota [None req-f20c3b7a-cbea-46da-9aca-62068d9a5949 tempest-GroupsTest-1464118442 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1365892903 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1365892903, it is now deprecated. Please use the default quota class for default quota. Aug 26 14:27:59 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-f20c3b7a-cbea-46da-9aca-62068d9a5949 tempest-GroupsTest-1464118442 None] Created reservations ['c8bfcbc9-0434-4488-81d8-f2b8123f43fe', '621d98b3-408c-41df-9f52-85a190380998', 'fbfac56f-4b61-4860-a44d-2a487c04a5ee', 'd2aef76c-10dd-4603-89b9-b71c8f80ef59'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:27:59 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-f20c3b7a-cbea-46da-9aca-62068d9a5949 tempest-GroupsTest-1464118442 None] Created reservations ['69a498d2-9f5c-4eb4-b38f-0381b6232052', '9c951928-8cde-4cc1-aab6-bfa2c7d304dc', '6ce32b82-3417-46b4-ae31-49c882e83ea2', '5632cbab-0548-4c64-b36f-cdaf093bf142'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:27:59 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-f20c3b7a-cbea-46da-9aca-62068d9a5949 tempest-GroupsTest-1464118442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:27:59 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-f20c3b7a-cbea-46da-9aca-62068d9a5949 tempest-GroupsTest-1464118442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:27:59 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-f20c3b7a-cbea-46da-9aca-62068d9a5949 tempest-GroupsTest-1464118442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:27:59 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-f20c3b7a-cbea-46da-9aca-62068d9a5949 tempest-GroupsTest-1464118442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:27:59 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-f20c3b7a-cbea-46da-9aca-62068d9a5949 tempest-GroupsTest-1464118442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:27:59 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-f20c3b7a-cbea-46da-9aca-62068d9a5949 tempest-GroupsTest-1464118442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:27:59 devstack sudo[102743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:27:59 devstack sudo[102743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:28:00 devstack sudo[102743]: pam_unix(sudo:session): session closed for user root Aug 26 14:28:00 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-f20c3b7a-cbea-46da-9aca-62068d9a5949 tempest-GroupsTest-1464118442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.401s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:28:00 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-f20c3b7a-cbea-46da-9aca-62068d9a5949 tempest-GroupsTest-1464118442 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:28:00 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-f20c3b7a-cbea-46da-9aca-62068d9a5949 tempest-GroupsTest-1464118442 None] Delete group completed successfully. Aug 26 14:28:08 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-7aed5726-da75-467d-9e01-69ad9f19f4be tempest-GroupsV314Test-2037079592 None] Group tempest-GroupsV314Test-Group-846770604: creating Aug 26 14:28:08 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-7aed5726-da75-467d-9e01-69ad9f19f4be tempest-GroupsV314Test-2037079592 None] Group tempest-GroupsV314Test-Group-846770604: created successfully Aug 26 14:28:08 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-7aed5726-da75-467d-9e01-69ad9f19f4be tempest-GroupsV314Test-2037079592 None] Create group completed successfully. Aug 26 14:28:10 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-57bb6b08-0e38-4491-a44d-57ba43dca2e9 tempest-GroupsV314Test-2037079592 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:28:10 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-57bb6b08-0e38-4491-a44d-57ba43dca2e9 tempest-GroupsV314Test-2037079592 None] Flow 'volume_create_manager' (ad855ec7-1476-4298-ae3c-53ba447781fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:28:10 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-57bb6b08-0e38-4491-a44d-57ba43dca2e9 tempest-GroupsV314Test-2037079592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2950a310-5e50-4869-b235-16c582f3a894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:28:10 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-57bb6b08-0e38-4491-a44d-57ba43dca2e9 tempest-GroupsV314Test-2037079592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2950a310-5e50-4869-b235-16c582f3a894) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:28:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1002199721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f17db700-450f-484c-8b0e-d50b3916eb34,host='devstack@QuobyteHD#QuobyteHD',id=43e1f484-b978-49e9-9df7-08f016f56beb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='976dfc234d6541b681e00623d0b57e0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:28:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:28:11Z,use_quota=True,user_id='4ce24d8159af46be99a501fbd2299a84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df50e9aa-d980-46db-a3c9-d8524d03a162),volume_type_id=df50e9aa-d980-46db-a3c9-d8524d03a162)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:28:10 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-57bb6b08-0e38-4491-a44d-57ba43dca2e9 tempest-GroupsV314Test-2037079592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92fe39f2-7a8e-4889-9bc9-e11393b64dde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:28:10 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-57bb6b08-0e38-4491-a44d-57ba43dca2e9 tempest-GroupsV314Test-2037079592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92fe39f2-7a8e-4889-9bc9-e11393b64dde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:28:10 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-57bb6b08-0e38-4491-a44d-57ba43dca2e9 tempest-GroupsV314Test-2037079592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68184ef8-36d9-42bb-80f1-850c1c50946e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:28:10 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-57bb6b08-0e38-4491-a44d-57ba43dca2e9 tempest-GroupsV314Test-2037079592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68184ef8-36d9-42bb-80f1-850c1c50946e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43e1f484-b978-49e9-9df7-08f016f56beb', 'volume_name': 'volume-43e1f484-b978-49e9-9df7-08f016f56beb', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:28:10 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-57bb6b08-0e38-4491-a44d-57ba43dca2e9 tempest-GroupsV314Test-2037079592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d081eb6-c010-4a8c-af36-5be330d5c6a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:28:10 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-57bb6b08-0e38-4491-a44d-57ba43dca2e9 tempest-GroupsV314Test-2037079592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d081eb6-c010-4a8c-af36-5be330d5c6a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:28:10 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-57bb6b08-0e38-4491-a44d-57ba43dca2e9 tempest-GroupsV314Test-2037079592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2fa2675-db66-4499-bc08-4e57c77d2ce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:28:10 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-57bb6b08-0e38-4491-a44d-57ba43dca2e9 tempest-GroupsV314Test-2037079592 None] Volume 43e1f484-b978-49e9-9df7-08f016f56beb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43e1f484-b978-49e9-9df7-08f016f56beb', 'volume_size': 1} Aug 26 14:28:10 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-57bb6b08-0e38-4491-a44d-57ba43dca2e9 tempest-GroupsV314Test-2037079592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:28:10 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-57bb6b08-0e38-4491-a44d-57ba43dca2e9 tempest-GroupsV314Test-2037079592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:28:10 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-57bb6b08-0e38-4491-a44d-57ba43dca2e9 tempest-GroupsV314Test-2037079592 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f17db700-450f-484c-8b0e-d50b3916eb34,created_at=2026-08-26T12:28:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1002199721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f17db700-450f-484c-8b0e-d50b3916eb34,host='devstack@QuobyteHD#QuobyteHD',id=43e1f484-b978-49e9-9df7-08f016f56beb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='976dfc234d6541b681e00623d0b57e0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:28:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:28:11Z,use_quota=True,user_id='4ce24d8159af46be99a501fbd2299a84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df50e9aa-d980-46db-a3c9-d8524d03a162),volume_type_id=df50e9aa-d980-46db-a3c9-d8524d03a162)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:28:10 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-57bb6b08-0e38-4491-a44d-57ba43dca2e9 tempest-GroupsV314Test-2037079592 None] Creating volume 43e1f484-b978-49e9-9df7-08f016f56beb {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:28:10 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-57bb6b08-0e38-4491-a44d-57ba43dca2e9 tempest-GroupsV314Test-2037079592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:28:10 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-57bb6b08-0e38-4491-a44d-57ba43dca2e9 tempest-GroupsV314Test-2037079592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:28:10 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-57bb6b08-0e38-4491-a44d-57ba43dca2e9 tempest-GroupsV314Test-2037079592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:28:10 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-57bb6b08-0e38-4491-a44d-57ba43dca2e9 tempest-GroupsV314Test-2037079592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:28:10 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-57bb6b08-0e38-4491-a44d-57ba43dca2e9 tempest-GroupsV314Test-2037079592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:28:10 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-57bb6b08-0e38-4491-a44d-57ba43dca2e9 tempest-GroupsV314Test-2037079592 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:28:10 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-57bb6b08-0e38-4491-a44d-57ba43dca2e9 tempest-GroupsV314Test-2037079592 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:28:10 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-57bb6b08-0e38-4491-a44d-57ba43dca2e9 tempest-GroupsV314Test-2037079592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-43e1f484-b978-49e9-9df7-08f016f56beb 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:28:10 devstack sudo[102779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-43e1f484-b978-49e9-9df7-08f016f56beb 1073741824 Aug 26 14:28:10 devstack sudo[102779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:28:11 devstack sudo[102779]: pam_unix(sudo:session): session closed for user root Aug 26 14:28:11 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-57bb6b08-0e38-4491-a44d-57ba43dca2e9 tempest-GroupsV314Test-2037079592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-43e1f484-b978-49e9-9df7-08f016f56beb 1073741824" returned: 0 in 0.628s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:28:11 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-57bb6b08-0e38-4491-a44d-57ba43dca2e9 tempest-GroupsV314Test-2037079592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-43e1f484-b978-49e9-9df7-08f016f56beb {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:28:11 devstack sudo[102810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-43e1f484-b978-49e9-9df7-08f016f56beb Aug 26 14:28:11 devstack sudo[102810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:28:11 devstack sudo[102810]: pam_unix(sudo:session): session closed for user root Aug 26 14:28:11 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-57bb6b08-0e38-4491-a44d-57ba43dca2e9 tempest-GroupsV314Test-2037079592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-43e1f484-b978-49e9-9df7-08f016f56beb" returned: 0 in 0.308s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:28:11 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-57bb6b08-0e38-4491-a44d-57ba43dca2e9 tempest-GroupsV314Test-2037079592 None] <== create_volume: return (1026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:28:11 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-57bb6b08-0e38-4491-a44d-57ba43dca2e9 tempest-GroupsV314Test-2037079592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.030s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:28:11 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-57bb6b08-0e38-4491-a44d-57ba43dca2e9 tempest-GroupsV314Test-2037079592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2fa2675-db66-4499-bc08-4e57c77d2ce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43e1f484-b978-49e9-9df7-08f016f56beb', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:28:11 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-57bb6b08-0e38-4491-a44d-57ba43dca2e9 tempest-GroupsV314Test-2037079592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (610eadee-8c12-4dba-abef-b0af44ad39df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:28:11 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-57bb6b08-0e38-4491-a44d-57ba43dca2e9 tempest-GroupsV314Test-2037079592 None] Volume volume-43e1f484-b978-49e9-9df7-08f016f56beb (43e1f484-b978-49e9-9df7-08f016f56beb): created successfully Aug 26 14:28:11 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-57bb6b08-0e38-4491-a44d-57ba43dca2e9 tempest-GroupsV314Test-2037079592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (610eadee-8c12-4dba-abef-b0af44ad39df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:28:11 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-57bb6b08-0e38-4491-a44d-57ba43dca2e9 tempest-GroupsV314Test-2037079592 None] Flow 'volume_create_manager' (ad855ec7-1476-4298-ae3c-53ba447781fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:28:11 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-57bb6b08-0e38-4491-a44d-57ba43dca2e9 tempest-GroupsV314Test-2037079592 None] Created volume successfully. Aug 26 14:28:13 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-5956fe53-6f3c-437d-bd51-4faa4c30a8d5 tempest-GroupsV314Test-2037079592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:28:13 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-5956fe53-6f3c-437d-bd51-4faa4c30a8d5 tempest-GroupsV314Test-2037079592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:28:13 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-5956fe53-6f3c-437d-bd51-4faa4c30a8d5 tempest-GroupsV314Test-2037079592 None] Cloning volume 43e1f484-b978-49e9-9df7-08f016f56beb to volume 6b220991-f0bb-423c-9000-b26e7ab4bf84 Aug 26 14:28:13 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-5956fe53-6f3c-437d-bd51-4faa4c30a8d5 tempest-GroupsV314Test-2037079592 None] Creating offline snapshot 96715c4c-06b1-4872-8dc1-03c0875d9a95 of volume 43e1f484-b978-49e9-9df7-08f016f56beb {{(pid=94394) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 14:28:13 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f901d13-bcc6-4133-a3ed-25e7b44bb613]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:28:13 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-5956fe53-6f3c-437d-bd51-4faa4c30a8d5 tempest-GroupsV314Test-2037079592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-43e1f484-b978-49e9-9df7-08f016f56beb {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:28:14 devstack sudo[102817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-43e1f484-b978-49e9-9df7-08f016f56beb Aug 26 14:28:14 devstack sudo[102817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:28:14 devstack sudo[102817]: pam_unix(sudo:session): session closed for user root Aug 26 14:28:14 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-5956fe53-6f3c-437d-bd51-4faa4c30a8d5 tempest-GroupsV314Test-2037079592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-43e1f484-b978-49e9-9df7-08f016f56beb" returned: 0 in 0.547s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:28:14 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-5956fe53-6f3c-437d-bd51-4faa4c30a8d5 tempest-GroupsV314Test-2037079592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-43e1f484-b978-49e9-9df7-08f016f56beb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-43e1f484-b978-49e9-9df7-08f016f56beb.96715c4c-06b1-4872-8dc1-03c0875d9a95 1G {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:28:14 devstack sudo[102823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-43e1f484-b978-49e9-9df7-08f016f56beb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-43e1f484-b978-49e9-9df7-08f016f56beb.96715c4c-06b1-4872-8dc1-03c0875d9a95 1G Aug 26 14:28:14 devstack sudo[102823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:28:14 devstack sudo[102823]: pam_unix(sudo:session): session closed for user root Aug 26 14:28:14 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-5956fe53-6f3c-437d-bd51-4faa4c30a8d5 tempest-GroupsV314Test-2037079592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-43e1f484-b978-49e9-9df7-08f016f56beb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-43e1f484-b978-49e9-9df7-08f016f56beb.96715c4c-06b1-4872-8dc1-03c0875d9a95 1G" returned: 0 in 0.529s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:28:14 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-5956fe53-6f3c-437d-bd51-4faa4c30a8d5 tempest-GroupsV314Test-2037079592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43e1f484-b978-49e9-9df7-08f016f56beb -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-43e1f484-b978-49e9-9df7-08f016f56beb.96715c4c-06b1-4872-8dc1-03c0875d9a95 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:28:15 devstack sudo[102839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43e1f484-b978-49e9-9df7-08f016f56beb -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-43e1f484-b978-49e9-9df7-08f016f56beb.96715c4c-06b1-4872-8dc1-03c0875d9a95 Aug 26 14:28:15 devstack sudo[102839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:28:15 devstack sudo[102839]: pam_unix(sudo:session): session closed for user root Aug 26 14:28:15 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-5956fe53-6f3c-437d-bd51-4faa4c30a8d5 tempest-GroupsV314Test-2037079592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43e1f484-b978-49e9-9df7-08f016f56beb -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-43e1f484-b978-49e9-9df7-08f016f56beb.96715c4c-06b1-4872-8dc1-03c0875d9a95" returned: 0 in 0.465s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:28:15 devstack cinder-volume[94394]: WARNING cinder.volume.drivers.remotefs [None req-5956fe53-6f3c-437d-bd51-4faa4c30a8d5 tempest-GroupsV314Test-2037079592 None] /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-43e1f484-b978-49e9-9df7-08f016f56beb.96715c4c-06b1-4872-8dc1-03c0875d9a95 is being set with open permissions: ugo+rw: NotImplementedError Aug 26 14:28:15 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-5956fe53-6f3c-437d-bd51-4faa4c30a8d5 tempest-GroupsV314Test-2037079592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-43e1f484-b978-49e9-9df7-08f016f56beb.96715c4c-06b1-4872-8dc1-03c0875d9a95 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:28:15 devstack sudo[102850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-43e1f484-b978-49e9-9df7-08f016f56beb.96715c4c-06b1-4872-8dc1-03c0875d9a95 Aug 26 14:28:15 devstack sudo[102850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:28:15 devstack sudo[102850]: pam_unix(sudo:session): session closed for user root Aug 26 14:28:15 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-5956fe53-6f3c-437d-bd51-4faa4c30a8d5 tempest-GroupsV314Test-2037079592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-43e1f484-b978-49e9-9df7-08f016f56beb.96715c4c-06b1-4872-8dc1-03c0875d9a95" returned: 0 in 0.291s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:28:15 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-5956fe53-6f3c-437d-bd51-4faa4c30a8d5 tempest-GroupsV314Test-2037079592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-43e1f484-b978-49e9-9df7-08f016f56beb.info {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:28:15 devstack sudo[102853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-43e1f484-b978-49e9-9df7-08f016f56beb.info Aug 26 14:28:15 devstack sudo[102853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:28:16 devstack sudo[102853]: pam_unix(sudo:session): session closed for user root Aug 26 14:28:16 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-5956fe53-6f3c-437d-bd51-4faa4c30a8d5 tempest-GroupsV314Test-2037079592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-43e1f484-b978-49e9-9df7-08f016f56beb.info" returned: 0 in 0.310s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:28:16 devstack cinder-volume[94394]: WARNING cinder.volume.drivers.remotefs [None req-5956fe53-6f3c-437d-bd51-4faa4c30a8d5 tempest-GroupsV314Test-2037079592 None] /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-43e1f484-b978-49e9-9df7-08f016f56beb.info is being set with open permissions: ugo+rw: NotImplementedError Aug 26 14:28:16 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-5956fe53-6f3c-437d-bd51-4faa4c30a8d5 tempest-GroupsV314Test-2037079592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-43e1f484-b978-49e9-9df7-08f016f56beb.info {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:28:16 devstack sudo[102856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-43e1f484-b978-49e9-9df7-08f016f56beb.info Aug 26 14:28:16 devstack sudo[102856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:28:16 devstack sudo[102856]: pam_unix(sudo:session): session closed for user root Aug 26 14:28:16 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-5956fe53-6f3c-437d-bd51-4faa4c30a8d5 tempest-GroupsV314Test-2037079592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-43e1f484-b978-49e9-9df7-08f016f56beb.info" returned: 0 in 0.280s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:28:16 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-5956fe53-6f3c-437d-bd51-4faa4c30a8d5 tempest-GroupsV314Test-2037079592 None] Acquiring lock "cinder-quobyte-6b220991-f0bb-423c-9000-b26e7ab4bf84" by "_copy_volume_from_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:28:16 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-5956fe53-6f3c-437d-bd51-4faa4c30a8d5 tempest-GroupsV314Test-2037079592 None] Lock "cinder-quobyte-6b220991-f0bb-423c-9000-b26e7ab4bf84" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:28:16 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-5956fe53-6f3c-437d-bd51-4faa4c30a8d5 tempest-GroupsV314Test-2037079592 None] snapshot: 96715c4c-06b1-4872-8dc1-03c0875d9a95, volume: 6b220991-f0bb-423c-9000-b26e7ab4bf84, {{(pid=94394) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 26 14:28:16 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-5956fe53-6f3c-437d-bd51-4faa4c30a8d5 tempest-GroupsV314Test-2037079592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:28:16 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-5956fe53-6f3c-437d-bd51-4faa4c30a8d5 tempest-GroupsV314Test-2037079592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:28:16 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-5956fe53-6f3c-437d-bd51-4faa4c30a8d5 tempest-GroupsV314Test-2037079592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:28:16 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-5956fe53-6f3c-437d-bd51-4faa4c30a8d5 tempest-GroupsV314Test-2037079592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:28:16 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-5956fe53-6f3c-437d-bd51-4faa4c30a8d5 tempest-GroupsV314Test-2037079592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:28:16 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3985be4-4106-46be-80d3-b4fa61d448cd]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:28:16 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-5956fe53-6f3c-437d-bd51-4faa4c30a8d5 tempest-GroupsV314Test-2037079592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-43e1f484-b978-49e9-9df7-08f016f56beb.96715c4c-06b1-4872-8dc1-03c0875d9a95 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:28:16 devstack sudo[102860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-43e1f484-b978-49e9-9df7-08f016f56beb.96715c4c-06b1-4872-8dc1-03c0875d9a95 Aug 26 14:28:16 devstack sudo[102860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:28:16 devstack sudo[102860]: pam_unix(sudo:session): session closed for user root Aug 26 14:28:16 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-5956fe53-6f3c-437d-bd51-4faa4c30a8d5 tempest-GroupsV314Test-2037079592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-43e1f484-b978-49e9-9df7-08f016f56beb.96715c4c-06b1-4872-8dc1-03c0875d9a95" returned: 0 in 0.447s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:28:16 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-5956fe53-6f3c-437d-bd51-4faa4c30a8d5 tempest-GroupsV314Test-2037079592 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-43e1f484-b978-49e9-9df7-08f016f56beb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94394) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 14:28:16 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[0368d0ff-ee6a-4bd7-be8a-b9ef540664e5]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:28:16 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-5956fe53-6f3c-437d-bd51-4faa4c30a8d5 tempest-GroupsV314Test-2037079592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-43e1f484-b978-49e9-9df7-08f016f56beb {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:28:17 devstack sudo[102866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-43e1f484-b978-49e9-9df7-08f016f56beb Aug 26 14:28:17 devstack sudo[102866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:28:17 devstack sudo[102866]: pam_unix(sudo:session): session closed for user root Aug 26 14:28:17 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-5956fe53-6f3c-437d-bd51-4faa4c30a8d5 tempest-GroupsV314Test-2037079592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-43e1f484-b978-49e9-9df7-08f016f56beb" returned: 0 in 0.609s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:28:17 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-5956fe53-6f3c-437d-bd51-4faa4c30a8d5 tempest-GroupsV314Test-2037079592 None] will copy from snapshot at /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-43e1f484-b978-49e9-9df7-08f016f56beb {{(pid=94394) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 26 14:28:17 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-5956fe53-6f3c-437d-bd51-4faa4c30a8d5 tempest-GroupsV314Test-2037079592 None] Creating direct copy from snapshot {{(pid=94394) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 26 14:28:17 devstack cinder-volume[94394]: DEBUG cinder.utils [None req-5956fe53-6f3c-437d-bd51-4faa4c30a8d5 tempest-GroupsV314Test-2037079592 None] Path /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6b220991-f0bb-423c-9000-b26e7ab4bf84 not found in is_blk_device check {{(pid=94394) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 26 14:28:17 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-5956fe53-6f3c-437d-bd51-4faa4c30a8d5 tempest-GroupsV314Test-2037079592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-43e1f484-b978-49e9-9df7-08f016f56beb /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6b220991-f0bb-423c-9000-b26e7ab4bf84 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:28:17 devstack sudo[102887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-43e1f484-b978-49e9-9df7-08f016f56beb /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6b220991-f0bb-423c-9000-b26e7ab4bf84 Aug 26 14:28:17 devstack sudo[102887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:28:23 devstack cinder-volume[94394]: DEBUG dbcounter [-] [94394] Writing DB stats cinder:SELECT=130,cinder:UPDATE=114,cinder:INSERT=25,cinder:DELETE=5 {{(pid=94394) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 14:28:23 devstack cinder-volume[94394]: DEBUG dbcounter [-] [94394] Writing DB stats cinder:SELECT=111,cinder:INSERT=32,cinder:UPDATE=138,cinder:DELETE=3 {{(pid=94394) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 14:28:23 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-724c949b-c9be-400e-bcba-b3a0637af404 tempest-AttachVolumeNegativeTest-342477261 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:28:23 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-724c949b-c9be-400e-bcba-b3a0637af404 tempest-AttachVolumeNegativeTest-342477261 None] Flow 'volume_create_manager' (d82a5117-5b9e-4ce8-ac9f-8de83e96fe5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:28:23 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-724c949b-c9be-400e-bcba-b3a0637af404 tempest-AttachVolumeNegativeTest-342477261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (def5ba8f-2722-4d1c-a957-f3ac3291217d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:28:23 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-724c949b-c9be-400e-bcba-b3a0637af404 tempest-AttachVolumeNegativeTest-342477261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (def5ba8f-2722-4d1c-a957-f3ac3291217d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:28:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-646491290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4369af1-8cf2-4de7-8b06-17ee4d045395,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2ee4807719a490e87da9514d245fd2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:28:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:28:23Z,use_quota=True,user_id='3453249502664779b9b949032cd68e96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:28:23 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-724c949b-c9be-400e-bcba-b3a0637af404 tempest-AttachVolumeNegativeTest-342477261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c50a19c-5299-40fd-a0d1-4eded1cbe383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:28:23 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-724c949b-c9be-400e-bcba-b3a0637af404 tempest-AttachVolumeNegativeTest-342477261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c50a19c-5299-40fd-a0d1-4eded1cbe383) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:28:23 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-724c949b-c9be-400e-bcba-b3a0637af404 tempest-AttachVolumeNegativeTest-342477261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ac91568-b5b3-4a9a-a41a-423dd6f11338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:28:23 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-724c949b-c9be-400e-bcba-b3a0637af404 tempest-AttachVolumeNegativeTest-342477261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ac91568-b5b3-4a9a-a41a-423dd6f11338) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4369af1-8cf2-4de7-8b06-17ee4d045395', 'volume_name': 'volume-c4369af1-8cf2-4de7-8b06-17ee4d045395', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:28:23 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-724c949b-c9be-400e-bcba-b3a0637af404 tempest-AttachVolumeNegativeTest-342477261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f3369c2-b1f7-4894-a61f-72a0988ac883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:28:23 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-724c949b-c9be-400e-bcba-b3a0637af404 tempest-AttachVolumeNegativeTest-342477261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f3369c2-b1f7-4894-a61f-72a0988ac883) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:28:23 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-724c949b-c9be-400e-bcba-b3a0637af404 tempest-AttachVolumeNegativeTest-342477261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e5bbc63-0912-4d7e-b2b4-008a616b7ad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:28:23 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-724c949b-c9be-400e-bcba-b3a0637af404 tempest-AttachVolumeNegativeTest-342477261 None] Volume c4369af1-8cf2-4de7-8b06-17ee4d045395: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4369af1-8cf2-4de7-8b06-17ee4d045395', 'volume_size': 1} Aug 26 14:28:23 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-724c949b-c9be-400e-bcba-b3a0637af404 tempest-AttachVolumeNegativeTest-342477261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:28:25 devstack sudo[102887]: pam_unix(sudo:session): session closed for user root Aug 26 14:28:25 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-5956fe53-6f3c-437d-bd51-4faa4c30a8d5 tempest-GroupsV314Test-2037079592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-43e1f484-b978-49e9-9df7-08f016f56beb /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6b220991-f0bb-423c-9000-b26e7ab4bf84" returned: 0 in 8.186s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:28:25 devstack cinder-volume[94394]: DEBUG cinder.image.image_utils [None req-5956fe53-6f3c-437d-bd51-4faa4c30a8d5 tempest-GroupsV314Test-2037079592 None] Image conversion details: src /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-43e1f484-b978-49e9-9df7-08f016f56beb, size 1024.00 MB, duration 8.19 sec, destination /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6b220991-f0bb-423c-9000-b26e7ab4bf84 {{(pid=94394) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 14:28:25 devstack cinder-volume[94394]: INFO cinder.image.image_utils [None req-5956fe53-6f3c-437d-bd51-4faa4c30a8d5 tempest-GroupsV314Test-2037079592 None] Converted 1024.00 MB image at 125.08 MB/s Aug 26 14:28:25 devstack cinder-volume[94394]: WARNING cinder.volume.drivers.remotefs [None req-5956fe53-6f3c-437d-bd51-4faa4c30a8d5 tempest-GroupsV314Test-2037079592 None] /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6b220991-f0bb-423c-9000-b26e7ab4bf84 is being set with open permissions: ugo+rw: NotImplementedError Aug 26 14:28:25 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-5956fe53-6f3c-437d-bd51-4faa4c30a8d5 tempest-GroupsV314Test-2037079592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6b220991-f0bb-423c-9000-b26e7ab4bf84 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:28:25 devstack sudo[103008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6b220991-f0bb-423c-9000-b26e7ab4bf84 Aug 26 14:28:25 devstack sudo[103008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:28:26 devstack sudo[103008]: pam_unix(sudo:session): session closed for user root Aug 26 14:28:26 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-5956fe53-6f3c-437d-bd51-4faa4c30a8d5 tempest-GroupsV314Test-2037079592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6b220991-f0bb-423c-9000-b26e7ab4bf84" returned: 0 in 0.380s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:28:26 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-5956fe53-6f3c-437d-bd51-4faa4c30a8d5 tempest-GroupsV314Test-2037079592 None] Lock "cinder-quobyte-6b220991-f0bb-423c-9000-b26e7ab4bf84" released by "_copy_volume_from_snapshot" :: held 9.733s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:28:26 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-5956fe53-6f3c-437d-bd51-4faa4c30a8d5 tempest-GroupsV314Test-2037079592 None] Acquiring lock "cinder-quobyte-96715c4c-06b1-4872-8dc1-03c0875d9a95" by "_delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:28:26 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-5956fe53-6f3c-437d-bd51-4faa4c30a8d5 tempest-GroupsV314Test-2037079592 None] Lock "cinder-quobyte-96715c4c-06b1-4872-8dc1-03c0875d9a95" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:28:26 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-5956fe53-6f3c-437d-bd51-4faa4c30a8d5 tempest-GroupsV314Test-2037079592 None] Deleting offline snapshot 96715c4c-06b1-4872-8dc1-03c0875d9a95 of volume 43e1f484-b978-49e9-9df7-08f016f56beb {{(pid=94394) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 14:28:26 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-5956fe53-6f3c-437d-bd51-4faa4c30a8d5 tempest-GroupsV314Test-2037079592 None] snapshot_file for this snap is: volume-43e1f484-b978-49e9-9df7-08f016f56beb.96715c4c-06b1-4872-8dc1-03c0875d9a95 {{(pid=94394) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 14:28:26 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc6e6d0f-4eca-4c2d-99e4-5063abe440f1]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:28:26 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-5956fe53-6f3c-437d-bd51-4faa4c30a8d5 tempest-GroupsV314Test-2037079592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-43e1f484-b978-49e9-9df7-08f016f56beb.96715c4c-06b1-4872-8dc1-03c0875d9a95 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:28:26 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9b1dac2-637a-4eb3-a163-57314407896e tempest-VolumeQuotasNegativeTestJSON-2060541904 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:28:26 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-e9b1dac2-637a-4eb3-a163-57314407896e tempest-VolumeQuotasNegativeTestJSON-2060541904 None] Flow 'volume_create_manager' (9a087025-8085-489a-aac8-b4f8811e305b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:28:26 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-e9b1dac2-637a-4eb3-a163-57314407896e tempest-VolumeQuotasNegativeTestJSON-2060541904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25657a61-25e1-4b95-86a8-efa28bd90ad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:28:26 devstack sudo[103012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-43e1f484-b978-49e9-9df7-08f016f56beb.96715c4c-06b1-4872-8dc1-03c0875d9a95 Aug 26 14:28:26 devstack sudo[103012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:28:26 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-e9b1dac2-637a-4eb3-a163-57314407896e tempest-VolumeQuotasNegativeTestJSON-2060541904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25657a61-25e1-4b95-86a8-efa28bd90ad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:28:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1375813149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b654d913-5d86-4b75-96b6-f78a3e9965fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4b0b2803a3c44f09780be087e90b1af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:28:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:28:26Z,use_quota=True,user_id='f36b8df1ecd3498bb15202593cddab38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:28:26 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-e9b1dac2-637a-4eb3-a163-57314407896e tempest-VolumeQuotasNegativeTestJSON-2060541904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16b30312-8897-45f4-9afb-fc357367746a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:28:26 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-e9b1dac2-637a-4eb3-a163-57314407896e tempest-VolumeQuotasNegativeTestJSON-2060541904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16b30312-8897-45f4-9afb-fc357367746a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:28:26 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-e9b1dac2-637a-4eb3-a163-57314407896e tempest-VolumeQuotasNegativeTestJSON-2060541904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7597b61f-0d42-4ded-a034-6d859ea6e3bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:28:26 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-e9b1dac2-637a-4eb3-a163-57314407896e tempest-VolumeQuotasNegativeTestJSON-2060541904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7597b61f-0d42-4ded-a034-6d859ea6e3bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b654d913-5d86-4b75-96b6-f78a3e9965fb', 'volume_name': 'volume-b654d913-5d86-4b75-96b6-f78a3e9965fb', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:28:26 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-e9b1dac2-637a-4eb3-a163-57314407896e tempest-VolumeQuotasNegativeTestJSON-2060541904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7051089c-15e3-434d-bccb-14b1a21ae02e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:28:26 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-e9b1dac2-637a-4eb3-a163-57314407896e tempest-VolumeQuotasNegativeTestJSON-2060541904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7051089c-15e3-434d-bccb-14b1a21ae02e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:28:26 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-e9b1dac2-637a-4eb3-a163-57314407896e tempest-VolumeQuotasNegativeTestJSON-2060541904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9bda4af-c9d9-4fd0-be1a-70f75a616992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:28:26 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-e9b1dac2-637a-4eb3-a163-57314407896e tempest-VolumeQuotasNegativeTestJSON-2060541904 None] Volume b654d913-5d86-4b75-96b6-f78a3e9965fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b654d913-5d86-4b75-96b6-f78a3e9965fb', 'volume_size': 1} Aug 26 14:28:26 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e9b1dac2-637a-4eb3-a163-57314407896e tempest-VolumeQuotasNegativeTestJSON-2060541904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:28:26 devstack sudo[103012]: pam_unix(sudo:session): session closed for user root Aug 26 14:28:26 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-5956fe53-6f3c-437d-bd51-4faa4c30a8d5 tempest-GroupsV314Test-2037079592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-43e1f484-b978-49e9-9df7-08f016f56beb.96715c4c-06b1-4872-8dc1-03c0875d9a95" returned: 0 in 0.434s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:28:26 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-5956fe53-6f3c-437d-bd51-4faa4c30a8d5 tempest-GroupsV314Test-2037079592 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-43e1f484-b978-49e9-9df7-08f016f56beb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94394) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 14:28:26 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa610743-336f-4198-83b6-59bd2c8f92ec]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:28:26 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-5956fe53-6f3c-437d-bd51-4faa4c30a8d5 tempest-GroupsV314Test-2037079592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-43e1f484-b978-49e9-9df7-08f016f56beb {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:28:26 devstack sudo[103018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-43e1f484-b978-49e9-9df7-08f016f56beb Aug 26 14:28:26 devstack sudo[103018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:28:27 devstack sudo[103018]: pam_unix(sudo:session): session closed for user root Aug 26 14:28:27 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-5956fe53-6f3c-437d-bd51-4faa4c30a8d5 tempest-GroupsV314Test-2037079592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-43e1f484-b978-49e9-9df7-08f016f56beb" returned: 0 in 0.610s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:28:27 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-5956fe53-6f3c-437d-bd51-4faa4c30a8d5 tempest-GroupsV314Test-2037079592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-43e1f484-b978-49e9-9df7-08f016f56beb.96715c4c-06b1-4872-8dc1-03c0875d9a95 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:28:27 devstack sudo[103023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-43e1f484-b978-49e9-9df7-08f016f56beb.96715c4c-06b1-4872-8dc1-03c0875d9a95 Aug 26 14:28:27 devstack sudo[103023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:28:27 devstack sudo[103023]: pam_unix(sudo:session): session closed for user root Aug 26 14:28:27 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-5956fe53-6f3c-437d-bd51-4faa4c30a8d5 tempest-GroupsV314Test-2037079592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-43e1f484-b978-49e9-9df7-08f016f56beb.96715c4c-06b1-4872-8dc1-03c0875d9a95" returned: 0 in 0.321s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:28:27 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-5956fe53-6f3c-437d-bd51-4faa4c30a8d5 tempest-GroupsV314Test-2037079592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-43e1f484-b978-49e9-9df7-08f016f56beb.96715c4c-06b1-4872-8dc1-03c0875d9a95 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:28:27 devstack sudo[103028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-43e1f484-b978-49e9-9df7-08f016f56beb.96715c4c-06b1-4872-8dc1-03c0875d9a95 Aug 26 14:28:27 devstack sudo[103028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:28:27 devstack sudo[103028]: pam_unix(sudo:session): session closed for user root Aug 26 14:28:27 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-5956fe53-6f3c-437d-bd51-4faa4c30a8d5 tempest-GroupsV314Test-2037079592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-43e1f484-b978-49e9-9df7-08f016f56beb.96715c4c-06b1-4872-8dc1-03c0875d9a95" returned: 0 in 0.246s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:28:27 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-5956fe53-6f3c-437d-bd51-4faa4c30a8d5 tempest-GroupsV314Test-2037079592 None] Lock "cinder-quobyte-96715c4c-06b1-4872-8dc1-03c0875d9a95" released by "_delete_snapshot" :: held 1.756s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:28:28 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-5956fe53-6f3c-437d-bd51-4faa4c30a8d5 tempest-GroupsV314Test-2037079592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.210s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:28:28 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-724c949b-c9be-400e-bcba-b3a0637af404 tempest-AttachVolumeNegativeTest-342477261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.441s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:28:28 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-724c949b-c9be-400e-bcba-b3a0637af404 tempest-AttachVolumeNegativeTest-342477261 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:28:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-646491290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4369af1-8cf2-4de7-8b06-17ee4d045395,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2ee4807719a490e87da9514d245fd2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:28:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:28:23Z,use_quota=True,user_id='3453249502664779b9b949032cd68e96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:28:28 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-724c949b-c9be-400e-bcba-b3a0637af404 tempest-AttachVolumeNegativeTest-342477261 None] Creating volume c4369af1-8cf2-4de7-8b06-17ee4d045395 {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:28:28 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-724c949b-c9be-400e-bcba-b3a0637af404 tempest-AttachVolumeNegativeTest-342477261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:28:28 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-724c949b-c9be-400e-bcba-b3a0637af404 tempest-AttachVolumeNegativeTest-342477261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:28:28 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-724c949b-c9be-400e-bcba-b3a0637af404 tempest-AttachVolumeNegativeTest-342477261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:28:28 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-724c949b-c9be-400e-bcba-b3a0637af404 tempest-AttachVolumeNegativeTest-342477261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:28:28 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-724c949b-c9be-400e-bcba-b3a0637af404 tempest-AttachVolumeNegativeTest-342477261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:28:28 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-724c949b-c9be-400e-bcba-b3a0637af404 tempest-AttachVolumeNegativeTest-342477261 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:28:28 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-724c949b-c9be-400e-bcba-b3a0637af404 tempest-AttachVolumeNegativeTest-342477261 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:28:28 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-724c949b-c9be-400e-bcba-b3a0637af404 tempest-AttachVolumeNegativeTest-342477261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c4369af1-8cf2-4de7-8b06-17ee4d045395 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:28:28 devstack sudo[103031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c4369af1-8cf2-4de7-8b06-17ee4d045395 1073741824 Aug 26 14:28:28 devstack sudo[103031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:28:28 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-5956fe53-6f3c-437d-bd51-4faa4c30a8d5 tempest-GroupsV314Test-2037079592 None] Create group from source-group-f17db700-450f-484c-8b0e-d50b3916eb34 completed successfully. Aug 26 14:28:28 devstack sudo[103031]: pam_unix(sudo:session): session closed for user root Aug 26 14:28:28 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-724c949b-c9be-400e-bcba-b3a0637af404 tempest-AttachVolumeNegativeTest-342477261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c4369af1-8cf2-4de7-8b06-17ee4d045395 1073741824" returned: 0 in 0.463s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:28:28 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-724c949b-c9be-400e-bcba-b3a0637af404 tempest-AttachVolumeNegativeTest-342477261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c4369af1-8cf2-4de7-8b06-17ee4d045395 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:28:28 devstack sudo[103036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c4369af1-8cf2-4de7-8b06-17ee4d045395 Aug 26 14:28:28 devstack sudo[103036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:28:28 devstack sudo[103036]: pam_unix(sudo:session): session closed for user root Aug 26 14:28:28 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-724c949b-c9be-400e-bcba-b3a0637af404 tempest-AttachVolumeNegativeTest-342477261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c4369af1-8cf2-4de7-8b06-17ee4d045395" returned: 0 in 0.256s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:28:28 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-724c949b-c9be-400e-bcba-b3a0637af404 tempest-AttachVolumeNegativeTest-342477261 None] <== create_volume: return (764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:28:28 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-724c949b-c9be-400e-bcba-b3a0637af404 tempest-AttachVolumeNegativeTest-342477261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.769s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:28:28 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e9b1dac2-637a-4eb3-a163-57314407896e tempest-VolumeQuotasNegativeTestJSON-2060541904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.354s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:28:28 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-e9b1dac2-637a-4eb3-a163-57314407896e tempest-VolumeQuotasNegativeTestJSON-2060541904 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:28:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1375813149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b654d913-5d86-4b75-96b6-f78a3e9965fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4b0b2803a3c44f09780be087e90b1af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:28:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:28:26Z,use_quota=True,user_id='f36b8df1ecd3498bb15202593cddab38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:28:28 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-e9b1dac2-637a-4eb3-a163-57314407896e tempest-VolumeQuotasNegativeTestJSON-2060541904 None] Creating volume b654d913-5d86-4b75-96b6-f78a3e9965fb {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:28:28 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e9b1dac2-637a-4eb3-a163-57314407896e tempest-VolumeQuotasNegativeTestJSON-2060541904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:28:28 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e9b1dac2-637a-4eb3-a163-57314407896e tempest-VolumeQuotasNegativeTestJSON-2060541904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:28:28 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-e9b1dac2-637a-4eb3-a163-57314407896e tempest-VolumeQuotasNegativeTestJSON-2060541904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:28:28 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-e9b1dac2-637a-4eb3-a163-57314407896e tempest-VolumeQuotasNegativeTestJSON-2060541904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:28:28 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e9b1dac2-637a-4eb3-a163-57314407896e tempest-VolumeQuotasNegativeTestJSON-2060541904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:28:28 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-e9b1dac2-637a-4eb3-a163-57314407896e tempest-VolumeQuotasNegativeTestJSON-2060541904 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:28:28 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-e9b1dac2-637a-4eb3-a163-57314407896e tempest-VolumeQuotasNegativeTestJSON-2060541904 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:28:28 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e9b1dac2-637a-4eb3-a163-57314407896e tempest-VolumeQuotasNegativeTestJSON-2060541904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b654d913-5d86-4b75-96b6-f78a3e9965fb 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:28:28 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-724c949b-c9be-400e-bcba-b3a0637af404 tempest-AttachVolumeNegativeTest-342477261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e5bbc63-0912-4d7e-b2b4-008a616b7ad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4369af1-8cf2-4de7-8b06-17ee4d045395', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:28:28 devstack sudo[103039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b654d913-5d86-4b75-96b6-f78a3e9965fb 1073741824 Aug 26 14:28:28 devstack sudo[103039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:28:28 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-724c949b-c9be-400e-bcba-b3a0637af404 tempest-AttachVolumeNegativeTest-342477261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa7ddcd9-ef64-404b-a226-c7a4b7186c9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:28:28 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-724c949b-c9be-400e-bcba-b3a0637af404 tempest-AttachVolumeNegativeTest-342477261 None] Volume volume-c4369af1-8cf2-4de7-8b06-17ee4d045395 (c4369af1-8cf2-4de7-8b06-17ee4d045395): created successfully Aug 26 14:28:28 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-724c949b-c9be-400e-bcba-b3a0637af404 tempest-AttachVolumeNegativeTest-342477261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa7ddcd9-ef64-404b-a226-c7a4b7186c9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:28:28 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-724c949b-c9be-400e-bcba-b3a0637af404 tempest-AttachVolumeNegativeTest-342477261 None] Flow 'volume_create_manager' (d82a5117-5b9e-4ce8-ac9f-8de83e96fe5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:28:28 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-724c949b-c9be-400e-bcba-b3a0637af404 tempest-AttachVolumeNegativeTest-342477261 None] Created volume successfully. Aug 26 14:28:29 devstack sudo[103039]: pam_unix(sudo:session): session closed for user root Aug 26 14:28:29 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e9b1dac2-637a-4eb3-a163-57314407896e tempest-VolumeQuotasNegativeTestJSON-2060541904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b654d913-5d86-4b75-96b6-f78a3e9965fb 1073741824" returned: 0 in 0.520s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:28:29 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e9b1dac2-637a-4eb3-a163-57314407896e tempest-VolumeQuotasNegativeTestJSON-2060541904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b654d913-5d86-4b75-96b6-f78a3e9965fb {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:28:29 devstack sudo[103049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b654d913-5d86-4b75-96b6-f78a3e9965fb Aug 26 14:28:29 devstack sudo[103049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:28:29 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-37a5ec9b-2ec5-4dd3-968a-4d1f21fd6d3b tempest-GroupsV314Test-2037079592 None] Acquiring lock "cinder-quobyte-6b220991-f0bb-423c-9000-b26e7ab4bf84" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:28:29 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-37a5ec9b-2ec5-4dd3-968a-4d1f21fd6d3b tempest-GroupsV314Test-2037079592 None] Lock "cinder-quobyte-6b220991-f0bb-423c-9000-b26e7ab4bf84" acquired by "delete_volume" :: waited 0.042s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:28:29 devstack sudo[103049]: pam_unix(sudo:session): session closed for user root Aug 26 14:28:29 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e9b1dac2-637a-4eb3-a163-57314407896e tempest-VolumeQuotasNegativeTestJSON-2060541904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b654d913-5d86-4b75-96b6-f78a3e9965fb" returned: 0 in 0.479s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:28:29 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-e9b1dac2-637a-4eb3-a163-57314407896e tempest-VolumeQuotasNegativeTestJSON-2060541904 None] <== create_volume: return (1073ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:28:29 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e9b1dac2-637a-4eb3-a163-57314407896e tempest-VolumeQuotasNegativeTestJSON-2060541904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.077s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:28:29 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7549e42-f589-4133-8bd7-5e83a7c4f925]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:28:29 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-37a5ec9b-2ec5-4dd3-968a-4d1f21fd6d3b tempest-GroupsV314Test-2037079592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6b220991-f0bb-423c-9000-b26e7ab4bf84 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:28:29 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-e9b1dac2-637a-4eb3-a163-57314407896e tempest-VolumeQuotasNegativeTestJSON-2060541904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9bda4af-c9d9-4fd0-be1a-70f75a616992) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b654d913-5d86-4b75-96b6-f78a3e9965fb', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:28:29 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-e9b1dac2-637a-4eb3-a163-57314407896e tempest-VolumeQuotasNegativeTestJSON-2060541904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7113230c-49a0-4321-bd34-a71460bd473a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:28:29 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-e9b1dac2-637a-4eb3-a163-57314407896e tempest-VolumeQuotasNegativeTestJSON-2060541904 None] Volume volume-b654d913-5d86-4b75-96b6-f78a3e9965fb (b654d913-5d86-4b75-96b6-f78a3e9965fb): created successfully Aug 26 14:28:29 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-e9b1dac2-637a-4eb3-a163-57314407896e tempest-VolumeQuotasNegativeTestJSON-2060541904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7113230c-49a0-4321-bd34-a71460bd473a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:28:29 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-e9b1dac2-637a-4eb3-a163-57314407896e tempest-VolumeQuotasNegativeTestJSON-2060541904 None] Flow 'volume_create_manager' (9a087025-8085-489a-aac8-b4f8811e305b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:28:30 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-e9b1dac2-637a-4eb3-a163-57314407896e tempest-VolumeQuotasNegativeTestJSON-2060541904 None] Created volume successfully. Aug 26 14:28:30 devstack sudo[103059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6b220991-f0bb-423c-9000-b26e7ab4bf84 Aug 26 14:28:30 devstack sudo[103059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:28:30 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [req-9b7cbff1-f017-40e7-a9c3-a60c87bd61fb req-a10f7ae8-0055-4802-b311-e0d5dd39ad1f tempest-AttachVolumeNegativeTest-342477261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:28:30 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [req-9b7cbff1-f017-40e7-a9c3-a60c87bd61fb req-a10f7ae8-0055-4802-b311-e0d5dd39ad1f tempest-AttachVolumeNegativeTest-342477261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:28:30 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [req-9b7cbff1-f017-40e7-a9c3-a60c87bd61fb req-a10f7ae8-0055-4802-b311-e0d5dd39ad1f tempest-AttachVolumeNegativeTest-342477261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:28:30 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [req-9b7cbff1-f017-40e7-a9c3-a60c87bd61fb req-a10f7ae8-0055-4802-b311-e0d5dd39ad1f tempest-AttachVolumeNegativeTest-342477261 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b', 'name': 'volume-c4369af1-8cf2-4de7-8b06-17ee4d045395', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd0406334-30b5-4327-83a4-0d27b90862ef', 'enforce_multipath': True} {{(pid=94394) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 14:28:30 devstack cinder-volume[94394]: INFO cinder.volume.manager [req-9b7cbff1-f017-40e7-a9c3-a60c87bd61fb req-a10f7ae8-0055-4802-b311-e0d5dd39ad1f tempest-AttachVolumeNegativeTest-342477261 None] attachment_update completed successfully. Aug 26 14:28:30 devstack sudo[103059]: pam_unix(sudo:session): session closed for user root Aug 26 14:28:30 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-37a5ec9b-2ec5-4dd3-968a-4d1f21fd6d3b tempest-GroupsV314Test-2037079592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6b220991-f0bb-423c-9000-b26e7ab4bf84" returned: 0 in 0.490s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:28:30 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-37a5ec9b-2ec5-4dd3-968a-4d1f21fd6d3b tempest-GroupsV314Test-2037079592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6b220991-f0bb-423c-9000-b26e7ab4bf84 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:28:30 devstack sudo[103112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6b220991-f0bb-423c-9000-b26e7ab4bf84 Aug 26 14:28:30 devstack sudo[103112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:28:30 devstack sudo[103112]: pam_unix(sudo:session): session closed for user root Aug 26 14:28:30 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-37a5ec9b-2ec5-4dd3-968a-4d1f21fd6d3b tempest-GroupsV314Test-2037079592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6b220991-f0bb-423c-9000-b26e7ab4bf84" returned: 0 in 0.295s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:28:30 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-37a5ec9b-2ec5-4dd3-968a-4d1f21fd6d3b tempest-GroupsV314Test-2037079592 None] Lock "cinder-quobyte-6b220991-f0bb-423c-9000-b26e7ab4bf84" released by "delete_volume" :: held 0.861s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:28:30 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-37a5ec9b-2ec5-4dd3-968a-4d1f21fd6d3b tempest-GroupsV314Test-2037079592 None] Created reservations ['cb53d712-ac93-4531-98ee-64a086af7da5'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:28:30 devstack cinder-volume[94394]: WARNING cinder.quota [None req-37a5ec9b-2ec5-4dd3-968a-4d1f21fd6d3b tempest-GroupsV314Test-2037079592 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-333754935 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-333754935, it is now deprecated. Please use the default quota class for default quota. Aug 26 14:28:30 devstack cinder-volume[94394]: WARNING cinder.quota [None req-37a5ec9b-2ec5-4dd3-968a-4d1f21fd6d3b tempest-GroupsV314Test-2037079592 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-333754935 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-333754935, it is now deprecated. Please use the default quota class for default quota. Aug 26 14:28:30 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-37a5ec9b-2ec5-4dd3-968a-4d1f21fd6d3b tempest-GroupsV314Test-2037079592 None] Created reservations ['81877cd6-1b6e-4926-9df1-a4256fed5fae', '7e728239-e121-4020-8da2-eacd0b06b0c4', '50aad485-4375-4c72-87df-8c82b0f5cc64', 'd6cfae1f-59b5-461f-9be0-af7cbbe8ca76'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:28:31 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-37a5ec9b-2ec5-4dd3-968a-4d1f21fd6d3b tempest-GroupsV314Test-2037079592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:28:31 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-37a5ec9b-2ec5-4dd3-968a-4d1f21fd6d3b tempest-GroupsV314Test-2037079592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:28:31 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-37a5ec9b-2ec5-4dd3-968a-4d1f21fd6d3b tempest-GroupsV314Test-2037079592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:28:31 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-37a5ec9b-2ec5-4dd3-968a-4d1f21fd6d3b tempest-GroupsV314Test-2037079592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:28:31 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-37a5ec9b-2ec5-4dd3-968a-4d1f21fd6d3b tempest-GroupsV314Test-2037079592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:28:31 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-37a5ec9b-2ec5-4dd3-968a-4d1f21fd6d3b tempest-GroupsV314Test-2037079592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:28:31 devstack sudo[103456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:28:31 devstack sudo[103456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:28:31 devstack sudo[103456]: pam_unix(sudo:session): session closed for user root Aug 26 14:28:31 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-37a5ec9b-2ec5-4dd3-968a-4d1f21fd6d3b tempest-GroupsV314Test-2037079592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.332s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:28:31 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-37a5ec9b-2ec5-4dd3-968a-4d1f21fd6d3b tempest-GroupsV314Test-2037079592 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:28:31 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-37a5ec9b-2ec5-4dd3-968a-4d1f21fd6d3b tempest-GroupsV314Test-2037079592 None] Delete group completed successfully. Aug 26 14:28:31 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-78a1e99c-8b45-416e-9858-ba69eafa2d01 tempest-VolumeQuotasNegativeTestJSON-2060541904 None] Acquiring lock "cinder-b654d913-5d86-4b75-96b6-f78a3e9965fb-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:28:31 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-78a1e99c-8b45-416e-9858-ba69eafa2d01 tempest-VolumeQuotasNegativeTestJSON-2060541904 None] Lock "cinder-b654d913-5d86-4b75-96b6-f78a3e9965fb-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:28:31 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-78a1e99c-8b45-416e-9858-ba69eafa2d01 tempest-VolumeQuotasNegativeTestJSON-2060541904 None] Acquiring lock "cinder-quobyte-b654d913-5d86-4b75-96b6-f78a3e9965fb" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:28:31 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-78a1e99c-8b45-416e-9858-ba69eafa2d01 tempest-VolumeQuotasNegativeTestJSON-2060541904 None] Lock "cinder-quobyte-b654d913-5d86-4b75-96b6-f78a3e9965fb" acquired by "delete_volume" :: waited 0.023s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:28:31 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[81f32e56-cbe5-42a4-a71b-a3ace0df24fb]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:28:31 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-78a1e99c-8b45-416e-9858-ba69eafa2d01 tempest-VolumeQuotasNegativeTestJSON-2060541904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b654d913-5d86-4b75-96b6-f78a3e9965fb {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:28:32 devstack sudo[103459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b654d913-5d86-4b75-96b6-f78a3e9965fb Aug 26 14:28:32 devstack sudo[103459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:28:32 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-6d055792-bbdd-42a5-b6c9-a65b6458b368 tempest-GroupsV314Test-2037079592 None] Acquiring lock "cinder-quobyte-43e1f484-b978-49e9-9df7-08f016f56beb" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:28:32 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-6d055792-bbdd-42a5-b6c9-a65b6458b368 tempest-GroupsV314Test-2037079592 None] Lock "cinder-quobyte-43e1f484-b978-49e9-9df7-08f016f56beb" acquired by "delete_volume" :: waited 0.030s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:28:32 devstack sudo[103459]: pam_unix(sudo:session): session closed for user root Aug 26 14:28:32 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[e47f168a-3691-4579-9feb-8349e1e26ab1]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:28:32 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-6d055792-bbdd-42a5-b6c9-a65b6458b368 tempest-GroupsV314Test-2037079592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-43e1f484-b978-49e9-9df7-08f016f56beb {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:28:32 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-78a1e99c-8b45-416e-9858-ba69eafa2d01 tempest-VolumeQuotasNegativeTestJSON-2060541904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b654d913-5d86-4b75-96b6-f78a3e9965fb" returned: 0 in 0.540s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:28:32 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-78a1e99c-8b45-416e-9858-ba69eafa2d01 tempest-VolumeQuotasNegativeTestJSON-2060541904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b654d913-5d86-4b75-96b6-f78a3e9965fb {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:28:32 devstack sudo[103465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b654d913-5d86-4b75-96b6-f78a3e9965fb Aug 26 14:28:32 devstack sudo[103465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:28:32 devstack sudo[103464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-43e1f484-b978-49e9-9df7-08f016f56beb Aug 26 14:28:32 devstack sudo[103464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:28:32 devstack sudo[103465]: pam_unix(sudo:session): session closed for user root Aug 26 14:28:32 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-78a1e99c-8b45-416e-9858-ba69eafa2d01 tempest-VolumeQuotasNegativeTestJSON-2060541904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b654d913-5d86-4b75-96b6-f78a3e9965fb" returned: 0 in 0.428s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:28:32 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-78a1e99c-8b45-416e-9858-ba69eafa2d01 tempest-VolumeQuotasNegativeTestJSON-2060541904 None] Lock "cinder-quobyte-b654d913-5d86-4b75-96b6-f78a3e9965fb" released by "delete_volume" :: held 1.024s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:28:33 devstack sudo[103464]: pam_unix(sudo:session): session closed for user root Aug 26 14:28:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-6d055792-bbdd-42a5-b6c9-a65b6458b368 tempest-GroupsV314Test-2037079592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-43e1f484-b978-49e9-9df7-08f016f56beb" returned: 0 in 0.534s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:28:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-6d055792-bbdd-42a5-b6c9-a65b6458b368 tempest-GroupsV314Test-2037079592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-43e1f484-b978-49e9-9df7-08f016f56beb {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:28:33 devstack sudo[103477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-43e1f484-b978-49e9-9df7-08f016f56beb Aug 26 14:28:33 devstack sudo[103477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:28:33 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-78a1e99c-8b45-416e-9858-ba69eafa2d01 tempest-VolumeQuotasNegativeTestJSON-2060541904 None] Created reservations ['fe1eb6a5-4b61-4a2e-b954-a390b4f66eb2', '146b510d-b3a1-4e32-b658-6a32cb4fae30', '37cba7c8-b16c-4e0f-8707-7a3baf139f05', '5296b351-d2a3-4cd9-bb23-5b3b2e85410d'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:28:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-78a1e99c-8b45-416e-9858-ba69eafa2d01 tempest-VolumeQuotasNegativeTestJSON-2060541904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:28:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-78a1e99c-8b45-416e-9858-ba69eafa2d01 tempest-VolumeQuotasNegativeTestJSON-2060541904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:28:33 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-78a1e99c-8b45-416e-9858-ba69eafa2d01 tempest-VolumeQuotasNegativeTestJSON-2060541904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:28:33 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-78a1e99c-8b45-416e-9858-ba69eafa2d01 tempest-VolumeQuotasNegativeTestJSON-2060541904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:28:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-78a1e99c-8b45-416e-9858-ba69eafa2d01 tempest-VolumeQuotasNegativeTestJSON-2060541904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:28:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-78a1e99c-8b45-416e-9858-ba69eafa2d01 tempest-VolumeQuotasNegativeTestJSON-2060541904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:28:33 devstack sudo[103479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:28:33 devstack sudo[103479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:28:33 devstack cinder-volume[94394]: INFO cinder.volume.manager [req-9ebf22bd-299c-45cd-afcc-3107602551f1 req-99d8e638-4ff9-4f9e-816c-77aec176fc0e tempest-AttachVolumeNegativeTest-342477261 None] Terminate volume connection completed successfully. Aug 26 14:28:33 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [req-9ebf22bd-299c-45cd-afcc-3107602551f1 req-99d8e638-4ff9-4f9e-816c-77aec176fc0e tempest-AttachVolumeNegativeTest-342477261 None] Deleting attachment d0406334-30b5-4327-83a4-0d27b90862ef. {{(pid=94394) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 14:28:33 devstack sudo[103477]: pam_unix(sudo:session): session closed for user root Aug 26 14:28:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-6d055792-bbdd-42a5-b6c9-a65b6458b368 tempest-GroupsV314Test-2037079592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-43e1f484-b978-49e9-9df7-08f016f56beb" returned: 0 in 0.358s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:28:33 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-6d055792-bbdd-42a5-b6c9-a65b6458b368 tempest-GroupsV314Test-2037079592 None] Lock "cinder-quobyte-43e1f484-b978-49e9-9df7-08f016f56beb" released by "delete_volume" :: held 0.986s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:28:33 devstack sudo[103479]: pam_unix(sudo:session): session closed for user root Aug 26 14:28:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-78a1e99c-8b45-416e-9858-ba69eafa2d01 tempest-VolumeQuotasNegativeTestJSON-2060541904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.339s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:28:33 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-78a1e99c-8b45-416e-9858-ba69eafa2d01 tempest-VolumeQuotasNegativeTestJSON-2060541904 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:28:33 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-78a1e99c-8b45-416e-9858-ba69eafa2d01 tempest-VolumeQuotasNegativeTestJSON-2060541904 None] Deleted volume successfully. Aug 26 14:28:33 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-6d055792-bbdd-42a5-b6c9-a65b6458b368 tempest-GroupsV314Test-2037079592 None] Created reservations ['02ac2330-7992-4bfa-92a5-50828042914a'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:28:33 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-78a1e99c-8b45-416e-9858-ba69eafa2d01 tempest-VolumeQuotasNegativeTestJSON-2060541904 None] Lock "cinder-b654d913-5d86-4b75-96b6-f78a3e9965fb-delete_volume" released by "delete_volume" :: held 1.661s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:28:33 devstack cinder-volume[94394]: DEBUG oslo_service.periodic_task [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94394) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 14:28:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:28:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:28:33 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:28:33 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:28:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:28:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:28:33 devstack sudo[103509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:28:33 devstack sudo[103509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:28:33 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-6d055792-bbdd-42a5-b6c9-a65b6458b368 tempest-GroupsV314Test-2037079592 None] Created reservations ['2a98ee44-54b5-4c3f-b700-f593a2d22801', '85e8dd1f-2342-4afa-8541-e774a68d9c48', '66dc6ef8-658d-4858-af1d-1a3c2422471a', '33d16862-3f8c-48ac-a634-602f5110d79a'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:28:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-6d055792-bbdd-42a5-b6c9-a65b6458b368 tempest-GroupsV314Test-2037079592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:28:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-6d055792-bbdd-42a5-b6c9-a65b6458b368 tempest-GroupsV314Test-2037079592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:28:33 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-6d055792-bbdd-42a5-b6c9-a65b6458b368 tempest-GroupsV314Test-2037079592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:28:33 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-6d055792-bbdd-42a5-b6c9-a65b6458b368 tempest-GroupsV314Test-2037079592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:28:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-6d055792-bbdd-42a5-b6c9-a65b6458b368 tempest-GroupsV314Test-2037079592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:28:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-6d055792-bbdd-42a5-b6c9-a65b6458b368 tempest-GroupsV314Test-2037079592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:28:33 devstack sudo[103511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:28:33 devstack sudo[103511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:28:33 devstack sudo[103509]: pam_unix(sudo:session): session closed for user root Aug 26 14:28:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.400s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:28:33 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:28:33 devstack cinder-volume[94394]: DEBUG oslo_service.periodic_task [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Running periodic task VolumeManager._thread_info {{(pid=94394) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 14:28:33 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] thread count: 28 {{(pid=94394) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 14:28:33 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] thread info: [<_MainThread(MainThread, started 126600738033792)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94394) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 14:28:34 devstack sudo[103511]: pam_unix(sudo:session): session closed for user root Aug 26 14:28:34 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-6d055792-bbdd-42a5-b6c9-a65b6458b368 tempest-GroupsV314Test-2037079592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.317s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:28:34 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-6d055792-bbdd-42a5-b6c9-a65b6458b368 tempest-GroupsV314Test-2037079592 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:28:34 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-6d055792-bbdd-42a5-b6c9-a65b6458b368 tempest-GroupsV314Test-2037079592 None] Delete group completed successfully. Aug 26 14:28:42 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ce1b4f1-cf6c-4007-92a2-b06dbf0619d0 tempest-VolumeTypesAccessTest-1671576380 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:28:42 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-0ce1b4f1-cf6c-4007-92a2-b06dbf0619d0 tempest-VolumeTypesAccessTest-1671576380 None] Flow 'volume_create_manager' (566c6207-aec9-49db-9c71-1c31559721d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:28:42 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-0ce1b4f1-cf6c-4007-92a2-b06dbf0619d0 tempest-VolumeTypesAccessTest-1671576380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32cade5f-d5b3-42c0-95e7-202d9b9ba333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:28:42 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-0ce1b4f1-cf6c-4007-92a2-b06dbf0619d0 tempest-VolumeTypesAccessTest-1671576380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32cade5f-d5b3-42c0-95e7-202d9b9ba333) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:28:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-2126086765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb1a8181-f685-4cae-9fe5-ced13776bc3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a76e3ee071f54c69b050eedec9438607',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:28:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:28:42Z,use_quota=True,user_id='c30d1f4957174a8e957cc880545af0fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda2ea7-e0c9-4044-9c85-3f77137a202f),volume_type_id=ccda2ea7-e0c9-4044-9c85-3f77137a202f)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:28:42 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-0ce1b4f1-cf6c-4007-92a2-b06dbf0619d0 tempest-VolumeTypesAccessTest-1671576380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f3b4b51-5d7e-4949-9e84-4bf62f89e317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:28:42 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-0ce1b4f1-cf6c-4007-92a2-b06dbf0619d0 tempest-VolumeTypesAccessTest-1671576380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f3b4b51-5d7e-4949-9e84-4bf62f89e317) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:28:42 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-0ce1b4f1-cf6c-4007-92a2-b06dbf0619d0 tempest-VolumeTypesAccessTest-1671576380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (595d73a6-63d8-4f7d-838c-14a1d32f38f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:28:42 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-0ce1b4f1-cf6c-4007-92a2-b06dbf0619d0 tempest-VolumeTypesAccessTest-1671576380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (595d73a6-63d8-4f7d-838c-14a1d32f38f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb1a8181-f685-4cae-9fe5-ced13776bc3f', 'volume_name': 'volume-bb1a8181-f685-4cae-9fe5-ced13776bc3f', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:28:42 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-0ce1b4f1-cf6c-4007-92a2-b06dbf0619d0 tempest-VolumeTypesAccessTest-1671576380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f486014d-95e9-4c16-87b7-099fd632fa70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:28:42 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-0ce1b4f1-cf6c-4007-92a2-b06dbf0619d0 tempest-VolumeTypesAccessTest-1671576380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f486014d-95e9-4c16-87b7-099fd632fa70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:28:42 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-0ce1b4f1-cf6c-4007-92a2-b06dbf0619d0 tempest-VolumeTypesAccessTest-1671576380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd6c883c-bfba-46ca-b6bd-6fd1fba9cd19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:28:42 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-0ce1b4f1-cf6c-4007-92a2-b06dbf0619d0 tempest-VolumeTypesAccessTest-1671576380 None] Volume bb1a8181-f685-4cae-9fe5-ced13776bc3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb1a8181-f685-4cae-9fe5-ced13776bc3f', 'volume_size': 1} Aug 26 14:28:42 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-0ce1b4f1-cf6c-4007-92a2-b06dbf0619d0 tempest-VolumeTypesAccessTest-1671576380 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:28:42 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-0ce1b4f1-cf6c-4007-92a2-b06dbf0619d0 tempest-VolumeTypesAccessTest-1671576380 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:28:42 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-0ce1b4f1-cf6c-4007-92a2-b06dbf0619d0 tempest-VolumeTypesAccessTest-1671576380 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:28:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-2126086765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb1a8181-f685-4cae-9fe5-ced13776bc3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a76e3ee071f54c69b050eedec9438607',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:28:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:28:42Z,use_quota=True,user_id='c30d1f4957174a8e957cc880545af0fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda2ea7-e0c9-4044-9c85-3f77137a202f),volume_type_id=ccda2ea7-e0c9-4044-9c85-3f77137a202f)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:28:42 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-0ce1b4f1-cf6c-4007-92a2-b06dbf0619d0 tempest-VolumeTypesAccessTest-1671576380 None] Creating volume bb1a8181-f685-4cae-9fe5-ced13776bc3f {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:28:42 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-0ce1b4f1-cf6c-4007-92a2-b06dbf0619d0 tempest-VolumeTypesAccessTest-1671576380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:28:42 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-0ce1b4f1-cf6c-4007-92a2-b06dbf0619d0 tempest-VolumeTypesAccessTest-1671576380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:28:42 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-0ce1b4f1-cf6c-4007-92a2-b06dbf0619d0 tempest-VolumeTypesAccessTest-1671576380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:28:42 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-0ce1b4f1-cf6c-4007-92a2-b06dbf0619d0 tempest-VolumeTypesAccessTest-1671576380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:28:42 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-0ce1b4f1-cf6c-4007-92a2-b06dbf0619d0 tempest-VolumeTypesAccessTest-1671576380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:28:42 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-0ce1b4f1-cf6c-4007-92a2-b06dbf0619d0 tempest-VolumeTypesAccessTest-1671576380 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:28:42 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-0ce1b4f1-cf6c-4007-92a2-b06dbf0619d0 tempest-VolumeTypesAccessTest-1671576380 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:28:42 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-0ce1b4f1-cf6c-4007-92a2-b06dbf0619d0 tempest-VolumeTypesAccessTest-1671576380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-bb1a8181-f685-4cae-9fe5-ced13776bc3f 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:28:42 devstack sudo[103574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-bb1a8181-f685-4cae-9fe5-ced13776bc3f 1073741824 Aug 26 14:28:42 devstack sudo[103574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:28:43 devstack sudo[103574]: pam_unix(sudo:session): session closed for user root Aug 26 14:28:43 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-0ce1b4f1-cf6c-4007-92a2-b06dbf0619d0 tempest-VolumeTypesAccessTest-1671576380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-bb1a8181-f685-4cae-9fe5-ced13776bc3f 1073741824" returned: 0 in 0.613s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:28:43 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-0ce1b4f1-cf6c-4007-92a2-b06dbf0619d0 tempest-VolumeTypesAccessTest-1671576380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-bb1a8181-f685-4cae-9fe5-ced13776bc3f {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:28:43 devstack sudo[103581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-bb1a8181-f685-4cae-9fe5-ced13776bc3f Aug 26 14:28:43 devstack sudo[103581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:28:43 devstack sudo[103581]: pam_unix(sudo:session): session closed for user root Aug 26 14:28:43 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-0ce1b4f1-cf6c-4007-92a2-b06dbf0619d0 tempest-VolumeTypesAccessTest-1671576380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-bb1a8181-f685-4cae-9fe5-ced13776bc3f" returned: 0 in 0.336s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:28:43 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-0ce1b4f1-cf6c-4007-92a2-b06dbf0619d0 tempest-VolumeTypesAccessTest-1671576380 None] <== create_volume: return (1008ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:28:43 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-0ce1b4f1-cf6c-4007-92a2-b06dbf0619d0 tempest-VolumeTypesAccessTest-1671576380 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.011s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:28:43 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-0ce1b4f1-cf6c-4007-92a2-b06dbf0619d0 tempest-VolumeTypesAccessTest-1671576380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd6c883c-bfba-46ca-b6bd-6fd1fba9cd19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb1a8181-f685-4cae-9fe5-ced13776bc3f', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:28:43 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-0ce1b4f1-cf6c-4007-92a2-b06dbf0619d0 tempest-VolumeTypesAccessTest-1671576380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cc0ad02-1458-47a0-b6ad-9f18f773eb23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:28:43 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-0ce1b4f1-cf6c-4007-92a2-b06dbf0619d0 tempest-VolumeTypesAccessTest-1671576380 None] Volume volume-bb1a8181-f685-4cae-9fe5-ced13776bc3f (bb1a8181-f685-4cae-9fe5-ced13776bc3f): created successfully Aug 26 14:28:43 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-0ce1b4f1-cf6c-4007-92a2-b06dbf0619d0 tempest-VolumeTypesAccessTest-1671576380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cc0ad02-1458-47a0-b6ad-9f18f773eb23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:28:43 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-0ce1b4f1-cf6c-4007-92a2-b06dbf0619d0 tempest-VolumeTypesAccessTest-1671576380 None] Flow 'volume_create_manager' (566c6207-aec9-49db-9c71-1c31559721d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:28:43 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-0ce1b4f1-cf6c-4007-92a2-b06dbf0619d0 tempest-VolumeTypesAccessTest-1671576380 None] Created volume successfully. Aug 26 14:28:44 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-d7a787ab-7521-4d47-9eba-ed0c000e6585 tempest-VolumeTypesAccessTest-1671576380 None] Acquiring lock "cinder-bb1a8181-f685-4cae-9fe5-ced13776bc3f-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:28:44 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-d7a787ab-7521-4d47-9eba-ed0c000e6585 tempest-VolumeTypesAccessTest-1671576380 None] Lock "cinder-bb1a8181-f685-4cae-9fe5-ced13776bc3f-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:28:44 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-d7a787ab-7521-4d47-9eba-ed0c000e6585 tempest-VolumeTypesAccessTest-1671576380 None] Acquiring lock "cinder-quobyte-bb1a8181-f685-4cae-9fe5-ced13776bc3f" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:28:44 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-d7a787ab-7521-4d47-9eba-ed0c000e6585 tempest-VolumeTypesAccessTest-1671576380 None] Lock "cinder-quobyte-bb1a8181-f685-4cae-9fe5-ced13776bc3f" acquired by "delete_volume" :: waited 0.023s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:28:44 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2dda227-4cec-4b1c-9404-77c74850f331]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:28:44 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-d7a787ab-7521-4d47-9eba-ed0c000e6585 tempest-VolumeTypesAccessTest-1671576380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-bb1a8181-f685-4cae-9fe5-ced13776bc3f {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:28:44 devstack sudo[103600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-bb1a8181-f685-4cae-9fe5-ced13776bc3f Aug 26 14:28:44 devstack sudo[103600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:28:45 devstack sudo[103600]: pam_unix(sudo:session): session closed for user root Aug 26 14:28:45 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-d7a787ab-7521-4d47-9eba-ed0c000e6585 tempest-VolumeTypesAccessTest-1671576380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-bb1a8181-f685-4cae-9fe5-ced13776bc3f" returned: 0 in 0.429s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:28:45 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-d7a787ab-7521-4d47-9eba-ed0c000e6585 tempest-VolumeTypesAccessTest-1671576380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-bb1a8181-f685-4cae-9fe5-ced13776bc3f {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:28:45 devstack sudo[103605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-bb1a8181-f685-4cae-9fe5-ced13776bc3f Aug 26 14:28:45 devstack sudo[103605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:28:45 devstack sudo[103605]: pam_unix(sudo:session): session closed for user root Aug 26 14:28:45 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-d7a787ab-7521-4d47-9eba-ed0c000e6585 tempest-VolumeTypesAccessTest-1671576380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-bb1a8181-f685-4cae-9fe5-ced13776bc3f" returned: 0 in 0.297s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:28:45 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-d7a787ab-7521-4d47-9eba-ed0c000e6585 tempest-VolumeTypesAccessTest-1671576380 None] Lock "cinder-quobyte-bb1a8181-f685-4cae-9fe5-ced13776bc3f" released by "delete_volume" :: held 0.780s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:28:45 devstack cinder-volume[94394]: WARNING cinder.quota [None req-d7a787ab-7521-4d47-9eba-ed0c000e6585 tempest-VolumeTypesAccessTest-1671576380 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-310463122 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-310463122, it is now deprecated. Please use the default quota class for default quota. Aug 26 14:28:45 devstack cinder-volume[94394]: WARNING cinder.quota [None req-d7a787ab-7521-4d47-9eba-ed0c000e6585 tempest-VolumeTypesAccessTest-1671576380 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-310463122 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-310463122, it is now deprecated. Please use the default quota class for default quota. Aug 26 14:28:45 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-d7a787ab-7521-4d47-9eba-ed0c000e6585 tempest-VolumeTypesAccessTest-1671576380 None] Created reservations ['f21a279c-709d-44bc-9add-1058d2972738', '39d0b4dd-cb55-495b-b01e-8d44b3c7a632', 'cdc7ee7a-4b06-438a-9186-9442567627ca', 'cc72961b-dd70-4f82-b905-d95a6c2b625a'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:28:45 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-d7a787ab-7521-4d47-9eba-ed0c000e6585 tempest-VolumeTypesAccessTest-1671576380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:28:45 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-d7a787ab-7521-4d47-9eba-ed0c000e6585 tempest-VolumeTypesAccessTest-1671576380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:28:45 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-d7a787ab-7521-4d47-9eba-ed0c000e6585 tempest-VolumeTypesAccessTest-1671576380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:28:45 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-d7a787ab-7521-4d47-9eba-ed0c000e6585 tempest-VolumeTypesAccessTest-1671576380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:28:45 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-d7a787ab-7521-4d47-9eba-ed0c000e6585 tempest-VolumeTypesAccessTest-1671576380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:28:45 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-d7a787ab-7521-4d47-9eba-ed0c000e6585 tempest-VolumeTypesAccessTest-1671576380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:28:45 devstack sudo[103608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:28:45 devstack sudo[103608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:28:46 devstack sudo[103608]: pam_unix(sudo:session): session closed for user root Aug 26 14:28:46 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-d7a787ab-7521-4d47-9eba-ed0c000e6585 tempest-VolumeTypesAccessTest-1671576380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.314s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:28:46 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-d7a787ab-7521-4d47-9eba-ed0c000e6585 tempest-VolumeTypesAccessTest-1671576380 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:28:46 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-d7a787ab-7521-4d47-9eba-ed0c000e6585 tempest-VolumeTypesAccessTest-1671576380 None] Deleted volume successfully. Aug 26 14:28:46 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-d7a787ab-7521-4d47-9eba-ed0c000e6585 tempest-VolumeTypesAccessTest-1671576380 None] Lock "cinder-bb1a8181-f685-4cae-9fe5-ced13776bc3f-delete_volume" released by "delete_volume" :: held 1.369s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:28:47 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-e14f2e1b-b25b-4d5c-96a7-d44c158b4f86 tempest-AttachVolumeTestJSON-1421707928 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:28:47 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-e14f2e1b-b25b-4d5c-96a7-d44c158b4f86 tempest-AttachVolumeTestJSON-1421707928 None] Flow 'volume_create_manager' (06845f10-9ea4-41bf-8a7a-086d37d2ce11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:28:47 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-e14f2e1b-b25b-4d5c-96a7-d44c158b4f86 tempest-AttachVolumeTestJSON-1421707928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f802e46-6c67-44c6-8cb5-6ed2e6f98e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:28:47 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-e14f2e1b-b25b-4d5c-96a7-d44c158b4f86 tempest-AttachVolumeTestJSON-1421707928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f802e46-6c67-44c6-8cb5-6ed2e6f98e71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:28:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1242272768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=382c9425-2f34-41fb-a18b-96d7af7cd6c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='948795cbf7d94ac690dd0722903834d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:28:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:28:48Z,use_quota=True,user_id='b42030cd1bff449596db251600581e7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:28:47 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-e14f2e1b-b25b-4d5c-96a7-d44c158b4f86 tempest-AttachVolumeTestJSON-1421707928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03c52650-b787-43a3-8832-2048c1ff5b75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:28:47 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-e14f2e1b-b25b-4d5c-96a7-d44c158b4f86 tempest-AttachVolumeTestJSON-1421707928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03c52650-b787-43a3-8832-2048c1ff5b75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:28:47 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-e14f2e1b-b25b-4d5c-96a7-d44c158b4f86 tempest-AttachVolumeTestJSON-1421707928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2760744-22da-4a18-b898-8b308258e013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:28:47 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-e14f2e1b-b25b-4d5c-96a7-d44c158b4f86 tempest-AttachVolumeTestJSON-1421707928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2760744-22da-4a18-b898-8b308258e013) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '382c9425-2f34-41fb-a18b-96d7af7cd6c1', 'volume_name': 'volume-382c9425-2f34-41fb-a18b-96d7af7cd6c1', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:28:47 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-e14f2e1b-b25b-4d5c-96a7-d44c158b4f86 tempest-AttachVolumeTestJSON-1421707928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a5170eb-5550-4a75-8e3f-209e6e7a3b55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:28:47 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-e14f2e1b-b25b-4d5c-96a7-d44c158b4f86 tempest-AttachVolumeTestJSON-1421707928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a5170eb-5550-4a75-8e3f-209e6e7a3b55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:28:47 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-e14f2e1b-b25b-4d5c-96a7-d44c158b4f86 tempest-AttachVolumeTestJSON-1421707928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5715750-4476-4273-b3fb-f6388869cd6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:28:47 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-e14f2e1b-b25b-4d5c-96a7-d44c158b4f86 tempest-AttachVolumeTestJSON-1421707928 None] Volume 382c9425-2f34-41fb-a18b-96d7af7cd6c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-382c9425-2f34-41fb-a18b-96d7af7cd6c1', 'volume_size': 1} Aug 26 14:28:47 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e14f2e1b-b25b-4d5c-96a7-d44c158b4f86 tempest-AttachVolumeTestJSON-1421707928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:28:47 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e14f2e1b-b25b-4d5c-96a7-d44c158b4f86 tempest-AttachVolumeTestJSON-1421707928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:28:47 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-e14f2e1b-b25b-4d5c-96a7-d44c158b4f86 tempest-AttachVolumeTestJSON-1421707928 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:28:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1242272768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=382c9425-2f34-41fb-a18b-96d7af7cd6c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='948795cbf7d94ac690dd0722903834d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:28:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:28:48Z,use_quota=True,user_id='b42030cd1bff449596db251600581e7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:28:47 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-e14f2e1b-b25b-4d5c-96a7-d44c158b4f86 tempest-AttachVolumeTestJSON-1421707928 None] Creating volume 382c9425-2f34-41fb-a18b-96d7af7cd6c1 {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:28:47 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e14f2e1b-b25b-4d5c-96a7-d44c158b4f86 tempest-AttachVolumeTestJSON-1421707928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:28:47 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e14f2e1b-b25b-4d5c-96a7-d44c158b4f86 tempest-AttachVolumeTestJSON-1421707928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:28:47 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-e14f2e1b-b25b-4d5c-96a7-d44c158b4f86 tempest-AttachVolumeTestJSON-1421707928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:28:47 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-e14f2e1b-b25b-4d5c-96a7-d44c158b4f86 tempest-AttachVolumeTestJSON-1421707928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:28:47 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e14f2e1b-b25b-4d5c-96a7-d44c158b4f86 tempest-AttachVolumeTestJSON-1421707928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:28:47 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-e14f2e1b-b25b-4d5c-96a7-d44c158b4f86 tempest-AttachVolumeTestJSON-1421707928 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:28:47 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-e14f2e1b-b25b-4d5c-96a7-d44c158b4f86 tempest-AttachVolumeTestJSON-1421707928 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:28:47 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e14f2e1b-b25b-4d5c-96a7-d44c158b4f86 tempest-AttachVolumeTestJSON-1421707928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-382c9425-2f34-41fb-a18b-96d7af7cd6c1 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:28:47 devstack sudo[103665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-382c9425-2f34-41fb-a18b-96d7af7cd6c1 1073741824 Aug 26 14:28:47 devstack sudo[103665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:28:48 devstack sudo[103665]: pam_unix(sudo:session): session closed for user root Aug 26 14:28:48 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e14f2e1b-b25b-4d5c-96a7-d44c158b4f86 tempest-AttachVolumeTestJSON-1421707928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-382c9425-2f34-41fb-a18b-96d7af7cd6c1 1073741824" returned: 0 in 0.718s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:28:48 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e14f2e1b-b25b-4d5c-96a7-d44c158b4f86 tempest-AttachVolumeTestJSON-1421707928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-382c9425-2f34-41fb-a18b-96d7af7cd6c1 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:28:48 devstack sudo[103699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-382c9425-2f34-41fb-a18b-96d7af7cd6c1 Aug 26 14:28:48 devstack sudo[103699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:28:48 devstack sudo[103699]: pam_unix(sudo:session): session closed for user root Aug 26 14:28:48 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e14f2e1b-b25b-4d5c-96a7-d44c158b4f86 tempest-AttachVolumeTestJSON-1421707928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-382c9425-2f34-41fb-a18b-96d7af7cd6c1" returned: 0 in 0.340s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:28:48 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-e14f2e1b-b25b-4d5c-96a7-d44c158b4f86 tempest-AttachVolumeTestJSON-1421707928 None] <== create_volume: return (1146ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:28:48 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e14f2e1b-b25b-4d5c-96a7-d44c158b4f86 tempest-AttachVolumeTestJSON-1421707928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.159s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:28:48 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-e14f2e1b-b25b-4d5c-96a7-d44c158b4f86 tempest-AttachVolumeTestJSON-1421707928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5715750-4476-4273-b3fb-f6388869cd6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-382c9425-2f34-41fb-a18b-96d7af7cd6c1', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:28:48 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-e14f2e1b-b25b-4d5c-96a7-d44c158b4f86 tempest-AttachVolumeTestJSON-1421707928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (145c532e-a25c-4ba9-bfc9-63d127b578fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:28:48 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-e14f2e1b-b25b-4d5c-96a7-d44c158b4f86 tempest-AttachVolumeTestJSON-1421707928 None] Volume volume-382c9425-2f34-41fb-a18b-96d7af7cd6c1 (382c9425-2f34-41fb-a18b-96d7af7cd6c1): created successfully Aug 26 14:28:48 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-e14f2e1b-b25b-4d5c-96a7-d44c158b4f86 tempest-AttachVolumeTestJSON-1421707928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (145c532e-a25c-4ba9-bfc9-63d127b578fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:28:48 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-e14f2e1b-b25b-4d5c-96a7-d44c158b4f86 tempest-AttachVolumeTestJSON-1421707928 None] Flow 'volume_create_manager' (06845f10-9ea4-41bf-8a7a-086d37d2ce11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:28:49 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-e14f2e1b-b25b-4d5c-96a7-d44c158b4f86 tempest-AttachVolumeTestJSON-1421707928 None] Created volume successfully. Aug 26 14:28:50 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-3da9e8f9-afc9-4d11-a078-f3af2ab005aa tempest-VolumesServicesTestJSON-650284582 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:28:50 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-3da9e8f9-afc9-4d11-a078-f3af2ab005aa tempest-VolumesServicesTestJSON-650284582 None] Flow 'volume_create_manager' (15a1fbb0-21b4-4a5f-8c69-96ae829c31b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:28:50 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-3da9e8f9-afc9-4d11-a078-f3af2ab005aa tempest-VolumesServicesTestJSON-650284582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07ad6bde-0be0-449d-a6df-300fd8fe9d80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:28:50 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-3da9e8f9-afc9-4d11-a078-f3af2ab005aa tempest-VolumesServicesTestJSON-650284582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07ad6bde-0be0-449d-a6df-300fd8fe9d80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:28:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1908034258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1a05155-e380-4ffb-a061-54f50051c5e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba2575990faa43a6bb352b3ba0cb2349',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:28:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:28:50Z,use_quota=True,user_id='cb74a2ef5a3b42beb845076e126171e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:28:50 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-3da9e8f9-afc9-4d11-a078-f3af2ab005aa tempest-VolumesServicesTestJSON-650284582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb4fe360-0159-4266-8ea9-eb47be9f9de2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:28:50 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-3da9e8f9-afc9-4d11-a078-f3af2ab005aa tempest-VolumesServicesTestJSON-650284582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb4fe360-0159-4266-8ea9-eb47be9f9de2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:28:50 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-3da9e8f9-afc9-4d11-a078-f3af2ab005aa tempest-VolumesServicesTestJSON-650284582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ce3236c-423a-4679-9049-164b688d41b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:28:50 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-3da9e8f9-afc9-4d11-a078-f3af2ab005aa tempest-VolumesServicesTestJSON-650284582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ce3236c-423a-4679-9049-164b688d41b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1a05155-e380-4ffb-a061-54f50051c5e6', 'volume_name': 'volume-a1a05155-e380-4ffb-a061-54f50051c5e6', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:28:50 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-3da9e8f9-afc9-4d11-a078-f3af2ab005aa tempest-VolumesServicesTestJSON-650284582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f31480f-44c6-462f-a449-bb1699e3c898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:28:50 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-3da9e8f9-afc9-4d11-a078-f3af2ab005aa tempest-VolumesServicesTestJSON-650284582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f31480f-44c6-462f-a449-bb1699e3c898) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:28:50 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-3da9e8f9-afc9-4d11-a078-f3af2ab005aa tempest-VolumesServicesTestJSON-650284582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80968bc5-106f-4d09-8b9e-6e06966d9505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:28:50 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-3da9e8f9-afc9-4d11-a078-f3af2ab005aa tempest-VolumesServicesTestJSON-650284582 None] Volume a1a05155-e380-4ffb-a061-54f50051c5e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1a05155-e380-4ffb-a061-54f50051c5e6', 'volume_size': 1} Aug 26 14:28:50 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-3da9e8f9-afc9-4d11-a078-f3af2ab005aa tempest-VolumesServicesTestJSON-650284582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:28:50 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-3da9e8f9-afc9-4d11-a078-f3af2ab005aa tempest-VolumesServicesTestJSON-650284582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:28:50 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-3da9e8f9-afc9-4d11-a078-f3af2ab005aa tempest-VolumesServicesTestJSON-650284582 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:28:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1908034258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1a05155-e380-4ffb-a061-54f50051c5e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba2575990faa43a6bb352b3ba0cb2349',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:28:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:28:50Z,use_quota=True,user_id='cb74a2ef5a3b42beb845076e126171e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:28:50 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-3da9e8f9-afc9-4d11-a078-f3af2ab005aa tempest-VolumesServicesTestJSON-650284582 None] Creating volume a1a05155-e380-4ffb-a061-54f50051c5e6 {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:28:50 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-3da9e8f9-afc9-4d11-a078-f3af2ab005aa tempest-VolumesServicesTestJSON-650284582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:28:50 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-3da9e8f9-afc9-4d11-a078-f3af2ab005aa tempest-VolumesServicesTestJSON-650284582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:28:50 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-3da9e8f9-afc9-4d11-a078-f3af2ab005aa tempest-VolumesServicesTestJSON-650284582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:28:50 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-3da9e8f9-afc9-4d11-a078-f3af2ab005aa tempest-VolumesServicesTestJSON-650284582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:28:50 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-3da9e8f9-afc9-4d11-a078-f3af2ab005aa tempest-VolumesServicesTestJSON-650284582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:28:50 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-3da9e8f9-afc9-4d11-a078-f3af2ab005aa tempest-VolumesServicesTestJSON-650284582 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:28:50 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-3da9e8f9-afc9-4d11-a078-f3af2ab005aa tempest-VolumesServicesTestJSON-650284582 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:28:50 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-3da9e8f9-afc9-4d11-a078-f3af2ab005aa tempest-VolumesServicesTestJSON-650284582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-a1a05155-e380-4ffb-a061-54f50051c5e6 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:28:50 devstack sudo[103710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-a1a05155-e380-4ffb-a061-54f50051c5e6 1073741824 Aug 26 14:28:50 devstack sudo[103710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:28:51 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [req-39469882-52d2-4972-92c3-52a0999a934e req-c6326782-ffd0-4347-b44b-030dc3ce0cf9 tempest-AttachVolumeTestJSON-1421707928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:28:51 devstack sudo[103710]: pam_unix(sudo:session): session closed for user root Aug 26 14:28:51 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-3da9e8f9-afc9-4d11-a078-f3af2ab005aa tempest-VolumesServicesTestJSON-650284582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-a1a05155-e380-4ffb-a061-54f50051c5e6 1073741824" returned: 0 in 0.793s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:28:51 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-3da9e8f9-afc9-4d11-a078-f3af2ab005aa tempest-VolumesServicesTestJSON-650284582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-a1a05155-e380-4ffb-a061-54f50051c5e6 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:28:51 devstack sudo[103724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-a1a05155-e380-4ffb-a061-54f50051c5e6 Aug 26 14:28:51 devstack sudo[103724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:28:51 devstack sudo[103724]: pam_unix(sudo:session): session closed for user root Aug 26 14:28:51 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-3da9e8f9-afc9-4d11-a078-f3af2ab005aa tempest-VolumesServicesTestJSON-650284582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-a1a05155-e380-4ffb-a061-54f50051c5e6" returned: 0 in 0.426s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:28:51 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-3da9e8f9-afc9-4d11-a078-f3af2ab005aa tempest-VolumesServicesTestJSON-650284582 None] <== create_volume: return (1281ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:28:51 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-3da9e8f9-afc9-4d11-a078-f3af2ab005aa tempest-VolumesServicesTestJSON-650284582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.286s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:28:51 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [req-39469882-52d2-4972-92c3-52a0999a934e req-c6326782-ffd0-4347-b44b-030dc3ce0cf9 tempest-AttachVolumeTestJSON-1421707928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.687s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:28:51 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [req-39469882-52d2-4972-92c3-52a0999a934e req-c6326782-ffd0-4347-b44b-030dc3ce0cf9 tempest-AttachVolumeTestJSON-1421707928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:28:51 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-3da9e8f9-afc9-4d11-a078-f3af2ab005aa tempest-VolumesServicesTestJSON-650284582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80968bc5-106f-4d09-8b9e-6e06966d9505) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1a05155-e380-4ffb-a061-54f50051c5e6', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:28:51 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-3da9e8f9-afc9-4d11-a078-f3af2ab005aa tempest-VolumesServicesTestJSON-650284582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (848bb684-51aa-49b9-b5b3-34650dfbb1cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:28:51 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-3da9e8f9-afc9-4d11-a078-f3af2ab005aa tempest-VolumesServicesTestJSON-650284582 None] Volume volume-a1a05155-e380-4ffb-a061-54f50051c5e6 (a1a05155-e380-4ffb-a061-54f50051c5e6): created successfully Aug 26 14:28:51 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-3da9e8f9-afc9-4d11-a078-f3af2ab005aa tempest-VolumesServicesTestJSON-650284582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (848bb684-51aa-49b9-b5b3-34650dfbb1cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:28:51 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-3da9e8f9-afc9-4d11-a078-f3af2ab005aa tempest-VolumesServicesTestJSON-650284582 None] Flow 'volume_create_manager' (15a1fbb0-21b4-4a5f-8c69-96ae829c31b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:28:51 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-3da9e8f9-afc9-4d11-a078-f3af2ab005aa tempest-VolumesServicesTestJSON-650284582 None] Created volume successfully. Aug 26 14:28:51 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [req-39469882-52d2-4972-92c3-52a0999a934e req-c6326782-ffd0-4347-b44b-030dc3ce0cf9 tempest-AttachVolumeTestJSON-1421707928 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b', 'name': 'volume-382c9425-2f34-41fb-a18b-96d7af7cd6c1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3b88f4dd-40a5-45b4-8c9b-b21340f6346d', 'enforce_multipath': True} {{(pid=94394) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 14:28:51 devstack cinder-volume[94394]: INFO cinder.volume.manager [req-39469882-52d2-4972-92c3-52a0999a934e req-c6326782-ffd0-4347-b44b-030dc3ce0cf9 tempest-AttachVolumeTestJSON-1421707928 None] attachment_update completed successfully. Aug 26 14:28:52 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-ebc40048-63c5-44c3-9418-2b4fe6cbee2a tempest-VolumesServicesTestJSON-650284582 None] Acquiring lock "cinder-a1a05155-e380-4ffb-a061-54f50051c5e6-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:28:52 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-ebc40048-63c5-44c3-9418-2b4fe6cbee2a tempest-VolumesServicesTestJSON-650284582 None] Lock "cinder-a1a05155-e380-4ffb-a061-54f50051c5e6-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:28:52 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-ebc40048-63c5-44c3-9418-2b4fe6cbee2a tempest-VolumesServicesTestJSON-650284582 None] Acquiring lock "cinder-quobyte-a1a05155-e380-4ffb-a061-54f50051c5e6" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:28:52 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-ebc40048-63c5-44c3-9418-2b4fe6cbee2a tempest-VolumesServicesTestJSON-650284582 None] Lock "cinder-quobyte-a1a05155-e380-4ffb-a061-54f50051c5e6" acquired by "delete_volume" :: waited 0.032s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:28:52 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[919f66b4-971b-44d4-8d15-a206b8844443]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:28:52 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-ebc40048-63c5-44c3-9418-2b4fe6cbee2a tempest-VolumesServicesTestJSON-650284582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-a1a05155-e380-4ffb-a061-54f50051c5e6 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:28:53 devstack sudo[104114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-a1a05155-e380-4ffb-a061-54f50051c5e6 Aug 26 14:28:53 devstack sudo[104114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:28:53 devstack sudo[104114]: pam_unix(sudo:session): session closed for user root Aug 26 14:28:53 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-ebc40048-63c5-44c3-9418-2b4fe6cbee2a tempest-VolumesServicesTestJSON-650284582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-a1a05155-e380-4ffb-a061-54f50051c5e6" returned: 0 in 0.667s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:28:53 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-ebc40048-63c5-44c3-9418-2b4fe6cbee2a tempest-VolumesServicesTestJSON-650284582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-a1a05155-e380-4ffb-a061-54f50051c5e6 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:28:53 devstack sudo[104121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-a1a05155-e380-4ffb-a061-54f50051c5e6 Aug 26 14:28:53 devstack sudo[104121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:28:54 devstack sudo[104121]: pam_unix(sudo:session): session closed for user root Aug 26 14:28:54 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-ebc40048-63c5-44c3-9418-2b4fe6cbee2a tempest-VolumesServicesTestJSON-650284582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-a1a05155-e380-4ffb-a061-54f50051c5e6" returned: 0 in 0.367s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:28:54 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-ebc40048-63c5-44c3-9418-2b4fe6cbee2a tempest-VolumesServicesTestJSON-650284582 None] Lock "cinder-quobyte-a1a05155-e380-4ffb-a061-54f50051c5e6" released by "delete_volume" :: held 1.131s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:28:54 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-ebc40048-63c5-44c3-9418-2b4fe6cbee2a tempest-VolumesServicesTestJSON-650284582 None] Created reservations ['2a475e1a-e03b-4179-95fb-19464eff0bc2', '62b34dfb-603a-44a3-ab85-71493f1f9823', '36a6e6d5-c910-46d4-97f3-1f1f15a30c15', '9d42132c-373d-4d1e-bc63-6e845df14b2f'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:28:54 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-ebc40048-63c5-44c3-9418-2b4fe6cbee2a tempest-VolumesServicesTestJSON-650284582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:28:54 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-ebc40048-63c5-44c3-9418-2b4fe6cbee2a tempest-VolumesServicesTestJSON-650284582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:28:54 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-ebc40048-63c5-44c3-9418-2b4fe6cbee2a tempest-VolumesServicesTestJSON-650284582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:28:54 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-ebc40048-63c5-44c3-9418-2b4fe6cbee2a tempest-VolumesServicesTestJSON-650284582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:28:54 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-ebc40048-63c5-44c3-9418-2b4fe6cbee2a tempest-VolumesServicesTestJSON-650284582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:28:54 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-ebc40048-63c5-44c3-9418-2b4fe6cbee2a tempest-VolumesServicesTestJSON-650284582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:28:54 devstack sudo[104124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:28:54 devstack sudo[104124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:28:54 devstack sudo[104124]: pam_unix(sudo:session): session closed for user root Aug 26 14:28:54 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-ebc40048-63c5-44c3-9418-2b4fe6cbee2a tempest-VolumesServicesTestJSON-650284582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.292s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:28:54 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-ebc40048-63c5-44c3-9418-2b4fe6cbee2a tempest-VolumesServicesTestJSON-650284582 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:28:54 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-ebc40048-63c5-44c3-9418-2b4fe6cbee2a tempest-VolumesServicesTestJSON-650284582 None] Deleted volume successfully. Aug 26 14:28:54 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-ebc40048-63c5-44c3-9418-2b4fe6cbee2a tempest-VolumesServicesTestJSON-650284582 None] Lock "cinder-a1a05155-e380-4ffb-a061-54f50051c5e6-delete_volume" released by "delete_volume" :: held 1.777s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:28:54 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-550fd756-d2a0-4e41-a1f1-9e5d366f6746 tempest-AttachVolumeTestJSON-1421707928 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:28:54 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-550fd756-d2a0-4e41-a1f1-9e5d366f6746 tempest-AttachVolumeTestJSON-1421707928 None] Flow 'volume_create_manager' (b8c53ec4-a8eb-424f-8853-b56b68752917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:28:54 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-550fd756-d2a0-4e41-a1f1-9e5d366f6746 tempest-AttachVolumeTestJSON-1421707928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c43c4009-a465-409a-b35b-5d050784a609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:28:54 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-550fd756-d2a0-4e41-a1f1-9e5d366f6746 tempest-AttachVolumeTestJSON-1421707928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c43c4009-a465-409a-b35b-5d050784a609) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:28:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-670743870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73084406-4812-4225-b155-ab46ce9a5d5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='948795cbf7d94ac690dd0722903834d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:28:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:28:55Z,use_quota=True,user_id='b42030cd1bff449596db251600581e7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:28:54 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-550fd756-d2a0-4e41-a1f1-9e5d366f6746 tempest-AttachVolumeTestJSON-1421707928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (139f5d76-d50d-4893-9e60-12017d93b2ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:28:54 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-550fd756-d2a0-4e41-a1f1-9e5d366f6746 tempest-AttachVolumeTestJSON-1421707928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (139f5d76-d50d-4893-9e60-12017d93b2ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:28:54 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-550fd756-d2a0-4e41-a1f1-9e5d366f6746 tempest-AttachVolumeTestJSON-1421707928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d904a33-58a1-49de-9079-fd268cb0fd18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:28:54 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-550fd756-d2a0-4e41-a1f1-9e5d366f6746 tempest-AttachVolumeTestJSON-1421707928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d904a33-58a1-49de-9079-fd268cb0fd18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73084406-4812-4225-b155-ab46ce9a5d5c', 'volume_name': 'volume-73084406-4812-4225-b155-ab46ce9a5d5c', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:28:54 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-550fd756-d2a0-4e41-a1f1-9e5d366f6746 tempest-AttachVolumeTestJSON-1421707928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df77f0a2-3aba-47f2-a792-9757b97e5119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:28:54 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-550fd756-d2a0-4e41-a1f1-9e5d366f6746 tempest-AttachVolumeTestJSON-1421707928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df77f0a2-3aba-47f2-a792-9757b97e5119) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:28:54 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-550fd756-d2a0-4e41-a1f1-9e5d366f6746 tempest-AttachVolumeTestJSON-1421707928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a83ecab0-f6d1-460b-a6bf-1e053486872c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:28:54 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-550fd756-d2a0-4e41-a1f1-9e5d366f6746 tempest-AttachVolumeTestJSON-1421707928 None] Volume 73084406-4812-4225-b155-ab46ce9a5d5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73084406-4812-4225-b155-ab46ce9a5d5c', 'volume_size': 1} Aug 26 14:28:54 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-550fd756-d2a0-4e41-a1f1-9e5d366f6746 tempest-AttachVolumeTestJSON-1421707928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:28:54 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-550fd756-d2a0-4e41-a1f1-9e5d366f6746 tempest-AttachVolumeTestJSON-1421707928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:28:54 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-550fd756-d2a0-4e41-a1f1-9e5d366f6746 tempest-AttachVolumeTestJSON-1421707928 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:28:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-670743870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73084406-4812-4225-b155-ab46ce9a5d5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='948795cbf7d94ac690dd0722903834d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:28:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:28:55Z,use_quota=True,user_id='b42030cd1bff449596db251600581e7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:28:54 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-550fd756-d2a0-4e41-a1f1-9e5d366f6746 tempest-AttachVolumeTestJSON-1421707928 None] Creating volume 73084406-4812-4225-b155-ab46ce9a5d5c {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:28:54 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-550fd756-d2a0-4e41-a1f1-9e5d366f6746 tempest-AttachVolumeTestJSON-1421707928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:28:54 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-550fd756-d2a0-4e41-a1f1-9e5d366f6746 tempest-AttachVolumeTestJSON-1421707928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:28:54 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-550fd756-d2a0-4e41-a1f1-9e5d366f6746 tempest-AttachVolumeTestJSON-1421707928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:28:54 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-550fd756-d2a0-4e41-a1f1-9e5d366f6746 tempest-AttachVolumeTestJSON-1421707928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:28:54 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-550fd756-d2a0-4e41-a1f1-9e5d366f6746 tempest-AttachVolumeTestJSON-1421707928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:28:54 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-550fd756-d2a0-4e41-a1f1-9e5d366f6746 tempest-AttachVolumeTestJSON-1421707928 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:28:54 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-550fd756-d2a0-4e41-a1f1-9e5d366f6746 tempest-AttachVolumeTestJSON-1421707928 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:28:54 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-550fd756-d2a0-4e41-a1f1-9e5d366f6746 tempest-AttachVolumeTestJSON-1421707928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-73084406-4812-4225-b155-ab46ce9a5d5c 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:28:54 devstack sudo[104127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-73084406-4812-4225-b155-ab46ce9a5d5c 1073741824 Aug 26 14:28:54 devstack sudo[104127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:28:55 devstack sudo[104127]: pam_unix(sudo:session): session closed for user root Aug 26 14:28:55 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-550fd756-d2a0-4e41-a1f1-9e5d366f6746 tempest-AttachVolumeTestJSON-1421707928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-73084406-4812-4225-b155-ab46ce9a5d5c 1073741824" returned: 0 in 0.672s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:28:55 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-550fd756-d2a0-4e41-a1f1-9e5d366f6746 tempest-AttachVolumeTestJSON-1421707928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-73084406-4812-4225-b155-ab46ce9a5d5c {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:28:55 devstack sudo[104135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-73084406-4812-4225-b155-ab46ce9a5d5c Aug 26 14:28:55 devstack sudo[104135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:28:56 devstack sudo[104135]: pam_unix(sudo:session): session closed for user root Aug 26 14:28:56 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-550fd756-d2a0-4e41-a1f1-9e5d366f6746 tempest-AttachVolumeTestJSON-1421707928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-73084406-4812-4225-b155-ab46ce9a5d5c" returned: 0 in 0.354s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:28:56 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-550fd756-d2a0-4e41-a1f1-9e5d366f6746 tempest-AttachVolumeTestJSON-1421707928 None] <== create_volume: return (1097ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:28:56 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-550fd756-d2a0-4e41-a1f1-9e5d366f6746 tempest-AttachVolumeTestJSON-1421707928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.100s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:28:56 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-550fd756-d2a0-4e41-a1f1-9e5d366f6746 tempest-AttachVolumeTestJSON-1421707928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a83ecab0-f6d1-460b-a6bf-1e053486872c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73084406-4812-4225-b155-ab46ce9a5d5c', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:28:56 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-550fd756-d2a0-4e41-a1f1-9e5d366f6746 tempest-AttachVolumeTestJSON-1421707928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (564108c3-5ce4-42a7-a320-7360a0238ff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:28:56 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-550fd756-d2a0-4e41-a1f1-9e5d366f6746 tempest-AttachVolumeTestJSON-1421707928 None] Volume volume-73084406-4812-4225-b155-ab46ce9a5d5c (73084406-4812-4225-b155-ab46ce9a5d5c): created successfully Aug 26 14:28:56 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-550fd756-d2a0-4e41-a1f1-9e5d366f6746 tempest-AttachVolumeTestJSON-1421707928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (564108c3-5ce4-42a7-a320-7360a0238ff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:28:56 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-550fd756-d2a0-4e41-a1f1-9e5d366f6746 tempest-AttachVolumeTestJSON-1421707928 None] Flow 'volume_create_manager' (b8c53ec4-a8eb-424f-8853-b56b68752917) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:28:56 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-550fd756-d2a0-4e41-a1f1-9e5d366f6746 tempest-AttachVolumeTestJSON-1421707928 None] Created volume successfully. Aug 26 14:28:58 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [req-6fe07801-cd21-4c0e-aae0-82d142fba7ad req-6a610d82-dfc6-411e-a943-92576f9580b0 tempest-AttachVolumeTestJSON-1421707928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:28:58 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [req-6fe07801-cd21-4c0e-aae0-82d142fba7ad req-6a610d82-dfc6-411e-a943-92576f9580b0 tempest-AttachVolumeTestJSON-1421707928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:28:58 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [req-6fe07801-cd21-4c0e-aae0-82d142fba7ad req-6a610d82-dfc6-411e-a943-92576f9580b0 tempest-AttachVolumeTestJSON-1421707928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:28:58 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [req-6fe07801-cd21-4c0e-aae0-82d142fba7ad req-6a610d82-dfc6-411e-a943-92576f9580b0 tempest-AttachVolumeTestJSON-1421707928 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b', 'name': 'volume-73084406-4812-4225-b155-ab46ce9a5d5c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b7264d56-3824-4afd-a60a-e8837e2dfdbc', 'enforce_multipath': True} {{(pid=94394) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 14:28:58 devstack cinder-volume[94394]: INFO cinder.volume.manager [req-6fe07801-cd21-4c0e-aae0-82d142fba7ad req-6a610d82-dfc6-411e-a943-92576f9580b0 tempest-AttachVolumeTestJSON-1421707928 None] attachment_update completed successfully. Aug 26 14:29:02 devstack cinder-volume[94394]: INFO cinder.volume.manager [req-f19a1922-e01d-42d3-b412-2644147d96f7 req-dbdd712c-c021-4ed3-8880-db94ad777c73 tempest-AttachVolumeTestJSON-1421707928 None] Terminate volume connection completed successfully. Aug 26 14:29:02 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [req-f19a1922-e01d-42d3-b412-2644147d96f7 req-dbdd712c-c021-4ed3-8880-db94ad777c73 tempest-AttachVolumeTestJSON-1421707928 None] Deleting attachment 3b88f4dd-40a5-45b4-8c9b-b21340f6346d. {{(pid=94394) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 14:29:02 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a79ee86-a422-4a5a-88b2-4af3da1ea50f tempest-VolumeSnapshotQuotasNegativeTestJSON-1306150496 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:29:02 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-5a79ee86-a422-4a5a-88b2-4af3da1ea50f tempest-VolumeSnapshotQuotasNegativeTestJSON-1306150496 None] Flow 'volume_create_manager' (66834a75-16d2-45bd-8c51-ea494143895b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:29:02 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-5a79ee86-a422-4a5a-88b2-4af3da1ea50f tempest-VolumeSnapshotQuotasNegativeTestJSON-1306150496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e9cc988-27bf-41f8-9565-1475839801ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:29:02 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-5a79ee86-a422-4a5a-88b2-4af3da1ea50f tempest-VolumeSnapshotQuotasNegativeTestJSON-1306150496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e9cc988-27bf-41f8-9565-1475839801ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:29:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-614309674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e9db2d1-ecd4-43bc-a79b-90ae74827547,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='230fb93c2ad6486e8ffc63e766426416',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:29:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:29:03Z,use_quota=True,user_id='4c86760008f8402798ea98a59f600962',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:29:02 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-5a79ee86-a422-4a5a-88b2-4af3da1ea50f tempest-VolumeSnapshotQuotasNegativeTestJSON-1306150496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (398397e7-5795-4e72-b837-02880923c1b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:29:02 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-5a79ee86-a422-4a5a-88b2-4af3da1ea50f tempest-VolumeSnapshotQuotasNegativeTestJSON-1306150496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (398397e7-5795-4e72-b837-02880923c1b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:29:02 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-5a79ee86-a422-4a5a-88b2-4af3da1ea50f tempest-VolumeSnapshotQuotasNegativeTestJSON-1306150496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0be1dd19-4e36-491b-8a41-28b8ce932307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:29:02 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-5a79ee86-a422-4a5a-88b2-4af3da1ea50f tempest-VolumeSnapshotQuotasNegativeTestJSON-1306150496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0be1dd19-4e36-491b-8a41-28b8ce932307) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e9db2d1-ecd4-43bc-a79b-90ae74827547', 'volume_name': 'volume-9e9db2d1-ecd4-43bc-a79b-90ae74827547', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:29:02 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-5a79ee86-a422-4a5a-88b2-4af3da1ea50f tempest-VolumeSnapshotQuotasNegativeTestJSON-1306150496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ac09ed3-0cb6-4e98-8946-977884b8bb6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:29:02 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-5a79ee86-a422-4a5a-88b2-4af3da1ea50f tempest-VolumeSnapshotQuotasNegativeTestJSON-1306150496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ac09ed3-0cb6-4e98-8946-977884b8bb6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:29:02 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-5a79ee86-a422-4a5a-88b2-4af3da1ea50f tempest-VolumeSnapshotQuotasNegativeTestJSON-1306150496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4be7639b-9091-48ab-aaf9-e7e3dac9b375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:29:02 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-5a79ee86-a422-4a5a-88b2-4af3da1ea50f tempest-VolumeSnapshotQuotasNegativeTestJSON-1306150496 None] Volume 9e9db2d1-ecd4-43bc-a79b-90ae74827547: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e9db2d1-ecd4-43bc-a79b-90ae74827547', 'volume_size': 1} Aug 26 14:29:02 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-5a79ee86-a422-4a5a-88b2-4af3da1ea50f tempest-VolumeSnapshotQuotasNegativeTestJSON-1306150496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:29:02 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-5a79ee86-a422-4a5a-88b2-4af3da1ea50f tempest-VolumeSnapshotQuotasNegativeTestJSON-1306150496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:29:02 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-5a79ee86-a422-4a5a-88b2-4af3da1ea50f tempest-VolumeSnapshotQuotasNegativeTestJSON-1306150496 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:29:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-614309674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e9db2d1-ecd4-43bc-a79b-90ae74827547,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='230fb93c2ad6486e8ffc63e766426416',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:29:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:29:03Z,use_quota=True,user_id='4c86760008f8402798ea98a59f600962',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:29:02 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-5a79ee86-a422-4a5a-88b2-4af3da1ea50f tempest-VolumeSnapshotQuotasNegativeTestJSON-1306150496 None] Creating volume 9e9db2d1-ecd4-43bc-a79b-90ae74827547 {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:29:02 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-5a79ee86-a422-4a5a-88b2-4af3da1ea50f tempest-VolumeSnapshotQuotasNegativeTestJSON-1306150496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:29:02 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-5a79ee86-a422-4a5a-88b2-4af3da1ea50f tempest-VolumeSnapshotQuotasNegativeTestJSON-1306150496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:29:02 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-5a79ee86-a422-4a5a-88b2-4af3da1ea50f tempest-VolumeSnapshotQuotasNegativeTestJSON-1306150496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:29:03 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-5a79ee86-a422-4a5a-88b2-4af3da1ea50f tempest-VolumeSnapshotQuotasNegativeTestJSON-1306150496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:29:03 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-5a79ee86-a422-4a5a-88b2-4af3da1ea50f tempest-VolumeSnapshotQuotasNegativeTestJSON-1306150496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:29:03 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-5a79ee86-a422-4a5a-88b2-4af3da1ea50f tempest-VolumeSnapshotQuotasNegativeTestJSON-1306150496 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:29:03 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-5a79ee86-a422-4a5a-88b2-4af3da1ea50f tempest-VolumeSnapshotQuotasNegativeTestJSON-1306150496 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:29:03 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-5a79ee86-a422-4a5a-88b2-4af3da1ea50f tempest-VolumeSnapshotQuotasNegativeTestJSON-1306150496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9e9db2d1-ecd4-43bc-a79b-90ae74827547 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:29:03 devstack sudo[104178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9e9db2d1-ecd4-43bc-a79b-90ae74827547 1073741824 Aug 26 14:29:03 devstack sudo[104178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:29:03 devstack sudo[104178]: pam_unix(sudo:session): session closed for user root Aug 26 14:29:03 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-5a79ee86-a422-4a5a-88b2-4af3da1ea50f tempest-VolumeSnapshotQuotasNegativeTestJSON-1306150496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9e9db2d1-ecd4-43bc-a79b-90ae74827547 1073741824" returned: 0 in 0.463s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:29:03 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-5a79ee86-a422-4a5a-88b2-4af3da1ea50f tempest-VolumeSnapshotQuotasNegativeTestJSON-1306150496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9e9db2d1-ecd4-43bc-a79b-90ae74827547 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:29:03 devstack sudo[104188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9e9db2d1-ecd4-43bc-a79b-90ae74827547 Aug 26 14:29:03 devstack sudo[104188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:29:03 devstack cinder-volume[94394]: INFO cinder.volume.manager [req-5d6236e2-8c61-46d3-9b99-dd52d21c3175 req-c6a9364b-cd2f-471f-946b-c6a0117f6a81 tempest-AttachVolumeTestJSON-1421707928 None] Terminate volume connection completed successfully. Aug 26 14:29:03 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [req-5d6236e2-8c61-46d3-9b99-dd52d21c3175 req-c6a9364b-cd2f-471f-946b-c6a0117f6a81 tempest-AttachVolumeTestJSON-1421707928 None] Deleting attachment b7264d56-3824-4afd-a60a-e8837e2dfdbc. {{(pid=94394) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 14:29:03 devstack sudo[104188]: pam_unix(sudo:session): session closed for user root Aug 26 14:29:03 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-5a79ee86-a422-4a5a-88b2-4af3da1ea50f tempest-VolumeSnapshotQuotasNegativeTestJSON-1306150496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9e9db2d1-ecd4-43bc-a79b-90ae74827547" returned: 0 in 0.317s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:29:03 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-5a79ee86-a422-4a5a-88b2-4af3da1ea50f tempest-VolumeSnapshotQuotasNegativeTestJSON-1306150496 None] <== create_volume: return (838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:29:03 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-5a79ee86-a422-4a5a-88b2-4af3da1ea50f tempest-VolumeSnapshotQuotasNegativeTestJSON-1306150496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.840s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:29:03 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-5a79ee86-a422-4a5a-88b2-4af3da1ea50f tempest-VolumeSnapshotQuotasNegativeTestJSON-1306150496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4be7639b-9091-48ab-aaf9-e7e3dac9b375) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e9db2d1-ecd4-43bc-a79b-90ae74827547', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:29:03 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-5a79ee86-a422-4a5a-88b2-4af3da1ea50f tempest-VolumeSnapshotQuotasNegativeTestJSON-1306150496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40811ae9-06ed-49ce-9927-f17eff69cb60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:29:03 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-5a79ee86-a422-4a5a-88b2-4af3da1ea50f tempest-VolumeSnapshotQuotasNegativeTestJSON-1306150496 None] Volume volume-9e9db2d1-ecd4-43bc-a79b-90ae74827547 (9e9db2d1-ecd4-43bc-a79b-90ae74827547): created successfully Aug 26 14:29:03 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-5a79ee86-a422-4a5a-88b2-4af3da1ea50f tempest-VolumeSnapshotQuotasNegativeTestJSON-1306150496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40811ae9-06ed-49ce-9927-f17eff69cb60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:29:03 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-5a79ee86-a422-4a5a-88b2-4af3da1ea50f tempest-VolumeSnapshotQuotasNegativeTestJSON-1306150496 None] Flow 'volume_create_manager' (66834a75-16d2-45bd-8c51-ea494143895b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:29:03 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-5a79ee86-a422-4a5a-88b2-4af3da1ea50f tempest-VolumeSnapshotQuotasNegativeTestJSON-1306150496 None] Created volume successfully. Aug 26 14:29:05 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-ddad6dd0-2df9-4ee3-8f9b-d26d9abf88a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1306150496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:29:05 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-ddad6dd0-2df9-4ee3-8f9b-d26d9abf88a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1306150496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:29:05 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-ddad6dd0-2df9-4ee3-8f9b-d26d9abf88a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1306150496 None] Creating offline snapshot 984861dd-3a74-4845-8d9f-38a041f84813 of volume 9e9db2d1-ecd4-43bc-a79b-90ae74827547 {{(pid=94394) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 14:29:05 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[91ee1675-65e2-4f6c-9877-b85cf85568d7]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:29:05 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-ddad6dd0-2df9-4ee3-8f9b-d26d9abf88a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1306150496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9e9db2d1-ecd4-43bc-a79b-90ae74827547 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:29:05 devstack sudo[104230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9e9db2d1-ecd4-43bc-a79b-90ae74827547 Aug 26 14:29:05 devstack sudo[104230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:29:05 devstack sudo[104230]: pam_unix(sudo:session): session closed for user root Aug 26 14:29:05 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-ddad6dd0-2df9-4ee3-8f9b-d26d9abf88a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1306150496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9e9db2d1-ecd4-43bc-a79b-90ae74827547" returned: 0 in 0.525s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:29:05 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-ddad6dd0-2df9-4ee3-8f9b-d26d9abf88a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1306150496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9e9db2d1-ecd4-43bc-a79b-90ae74827547,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9e9db2d1-ecd4-43bc-a79b-90ae74827547.984861dd-3a74-4845-8d9f-38a041f84813 1G {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:29:05 devstack sudo[104244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9e9db2d1-ecd4-43bc-a79b-90ae74827547,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9e9db2d1-ecd4-43bc-a79b-90ae74827547.984861dd-3a74-4845-8d9f-38a041f84813 1G Aug 26 14:29:05 devstack sudo[104244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:29:06 devstack sudo[104244]: pam_unix(sudo:session): session closed for user root Aug 26 14:29:06 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-ddad6dd0-2df9-4ee3-8f9b-d26d9abf88a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1306150496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9e9db2d1-ecd4-43bc-a79b-90ae74827547,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9e9db2d1-ecd4-43bc-a79b-90ae74827547.984861dd-3a74-4845-8d9f-38a041f84813 1G" returned: 0 in 0.529s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:29:06 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-ddad6dd0-2df9-4ee3-8f9b-d26d9abf88a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1306150496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e9db2d1-ecd4-43bc-a79b-90ae74827547 -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9e9db2d1-ecd4-43bc-a79b-90ae74827547.984861dd-3a74-4845-8d9f-38a041f84813 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:29:06 devstack sudo[104251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e9db2d1-ecd4-43bc-a79b-90ae74827547 -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9e9db2d1-ecd4-43bc-a79b-90ae74827547.984861dd-3a74-4845-8d9f-38a041f84813 Aug 26 14:29:06 devstack sudo[104251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:29:06 devstack sudo[104251]: pam_unix(sudo:session): session closed for user root Aug 26 14:29:06 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-ddad6dd0-2df9-4ee3-8f9b-d26d9abf88a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1306150496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e9db2d1-ecd4-43bc-a79b-90ae74827547 -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9e9db2d1-ecd4-43bc-a79b-90ae74827547.984861dd-3a74-4845-8d9f-38a041f84813" returned: 0 in 0.315s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:29:06 devstack cinder-volume[94394]: WARNING cinder.volume.drivers.remotefs [None req-ddad6dd0-2df9-4ee3-8f9b-d26d9abf88a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1306150496 None] /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9e9db2d1-ecd4-43bc-a79b-90ae74827547.984861dd-3a74-4845-8d9f-38a041f84813 is being set with open permissions: ugo+rw Aug 26 14:29:06 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-ddad6dd0-2df9-4ee3-8f9b-d26d9abf88a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1306150496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9e9db2d1-ecd4-43bc-a79b-90ae74827547.984861dd-3a74-4845-8d9f-38a041f84813 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:29:06 devstack sudo[104257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9e9db2d1-ecd4-43bc-a79b-90ae74827547.984861dd-3a74-4845-8d9f-38a041f84813 Aug 26 14:29:06 devstack sudo[104257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:29:07 devstack sudo[104257]: pam_unix(sudo:session): session closed for user root Aug 26 14:29:07 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-ddad6dd0-2df9-4ee3-8f9b-d26d9abf88a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1306150496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9e9db2d1-ecd4-43bc-a79b-90ae74827547.984861dd-3a74-4845-8d9f-38a041f84813" returned: 0 in 0.276s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:29:07 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-ddad6dd0-2df9-4ee3-8f9b-d26d9abf88a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1306150496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9e9db2d1-ecd4-43bc-a79b-90ae74827547.info {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:29:07 devstack sudo[104262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9e9db2d1-ecd4-43bc-a79b-90ae74827547.info Aug 26 14:29:07 devstack sudo[104262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:29:07 devstack sudo[104262]: pam_unix(sudo:session): session closed for user root Aug 26 14:29:07 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-ddad6dd0-2df9-4ee3-8f9b-d26d9abf88a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1306150496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9e9db2d1-ecd4-43bc-a79b-90ae74827547.info" returned: 0 in 0.292s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:29:07 devstack cinder-volume[94394]: WARNING cinder.volume.drivers.remotefs [None req-ddad6dd0-2df9-4ee3-8f9b-d26d9abf88a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1306150496 None] /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9e9db2d1-ecd4-43bc-a79b-90ae74827547.info is being set with open permissions: ugo+rw Aug 26 14:29:07 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-ddad6dd0-2df9-4ee3-8f9b-d26d9abf88a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1306150496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9e9db2d1-ecd4-43bc-a79b-90ae74827547.info {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:29:07 devstack sudo[104265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9e9db2d1-ecd4-43bc-a79b-90ae74827547.info Aug 26 14:29:07 devstack sudo[104265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:29:07 devstack sudo[104265]: pam_unix(sudo:session): session closed for user root Aug 26 14:29:07 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-ddad6dd0-2df9-4ee3-8f9b-d26d9abf88a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1306150496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9e9db2d1-ecd4-43bc-a79b-90ae74827547.info" returned: 0 in 0.296s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:29:07 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-ddad6dd0-2df9-4ee3-8f9b-d26d9abf88a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1306150496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.395s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:29:07 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-ddad6dd0-2df9-4ee3-8f9b-d26d9abf88a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1306150496 None] Create snapshot completed successfully Aug 26 14:29:09 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-531d2624-7235-407d-b962-757ffbff2745 tempest-VolumeSnapshotQuotasNegativeTestJSON-1306150496 None] Acquiring lock "cinder-984861dd-3a74-4845-8d9f-38a041f84813-delete_snapshot" by "delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:29:09 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-531d2624-7235-407d-b962-757ffbff2745 tempest-VolumeSnapshotQuotasNegativeTestJSON-1306150496 None] Lock "cinder-984861dd-3a74-4845-8d9f-38a041f84813-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:29:09 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-531d2624-7235-407d-b962-757ffbff2745 tempest-VolumeSnapshotQuotasNegativeTestJSON-1306150496 None] Acquiring lock "cinder-quobyte-9e9db2d1-ecd4-43bc-a79b-90ae74827547" by "delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:29:09 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-531d2624-7235-407d-b962-757ffbff2745 tempest-VolumeSnapshotQuotasNegativeTestJSON-1306150496 None] Lock "cinder-quobyte-9e9db2d1-ecd4-43bc-a79b-90ae74827547" acquired by "delete_snapshot" :: waited 0.030s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:29:09 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-531d2624-7235-407d-b962-757ffbff2745 tempest-VolumeSnapshotQuotasNegativeTestJSON-1306150496 None] Acquiring lock "cinder-quobyte-984861dd-3a74-4845-8d9f-38a041f84813" by "_delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:29:09 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-531d2624-7235-407d-b962-757ffbff2745 tempest-VolumeSnapshotQuotasNegativeTestJSON-1306150496 None] Lock "cinder-quobyte-984861dd-3a74-4845-8d9f-38a041f84813" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:29:09 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-531d2624-7235-407d-b962-757ffbff2745 tempest-VolumeSnapshotQuotasNegativeTestJSON-1306150496 None] Deleting offline snapshot 984861dd-3a74-4845-8d9f-38a041f84813 of volume 9e9db2d1-ecd4-43bc-a79b-90ae74827547 {{(pid=94394) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 14:29:09 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-531d2624-7235-407d-b962-757ffbff2745 tempest-VolumeSnapshotQuotasNegativeTestJSON-1306150496 None] snapshot_file for this snap is: volume-9e9db2d1-ecd4-43bc-a79b-90ae74827547.984861dd-3a74-4845-8d9f-38a041f84813 {{(pid=94394) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 14:29:09 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea95492a-592e-4703-87a6-40b5bfc0da0c]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:29:09 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-531d2624-7235-407d-b962-757ffbff2745 tempest-VolumeSnapshotQuotasNegativeTestJSON-1306150496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9e9db2d1-ecd4-43bc-a79b-90ae74827547.984861dd-3a74-4845-8d9f-38a041f84813 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:29:09 devstack sudo[104269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9e9db2d1-ecd4-43bc-a79b-90ae74827547.984861dd-3a74-4845-8d9f-38a041f84813 Aug 26 14:29:09 devstack sudo[104269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:29:09 devstack sudo[104269]: pam_unix(sudo:session): session closed for user root Aug 26 14:29:09 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-531d2624-7235-407d-b962-757ffbff2745 tempest-VolumeSnapshotQuotasNegativeTestJSON-1306150496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9e9db2d1-ecd4-43bc-a79b-90ae74827547.984861dd-3a74-4845-8d9f-38a041f84813" returned: 0 in 0.435s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:29:09 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-531d2624-7235-407d-b962-757ffbff2745 tempest-VolumeSnapshotQuotasNegativeTestJSON-1306150496 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e9db2d1-ecd4-43bc-a79b-90ae74827547(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94394) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 14:29:09 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[db32125b-1f0d-4fde-a964-567580aec7ea]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:29:09 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-531d2624-7235-407d-b962-757ffbff2745 tempest-VolumeSnapshotQuotasNegativeTestJSON-1306150496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9e9db2d1-ecd4-43bc-a79b-90ae74827547 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:29:09 devstack sudo[104275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9e9db2d1-ecd4-43bc-a79b-90ae74827547 Aug 26 14:29:09 devstack sudo[104275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:29:10 devstack sudo[104275]: pam_unix(sudo:session): session closed for user root Aug 26 14:29:10 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-531d2624-7235-407d-b962-757ffbff2745 tempest-VolumeSnapshotQuotasNegativeTestJSON-1306150496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9e9db2d1-ecd4-43bc-a79b-90ae74827547" returned: 0 in 0.450s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:29:10 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-531d2624-7235-407d-b962-757ffbff2745 tempest-VolumeSnapshotQuotasNegativeTestJSON-1306150496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9e9db2d1-ecd4-43bc-a79b-90ae74827547.984861dd-3a74-4845-8d9f-38a041f84813 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:29:10 devstack sudo[104281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9e9db2d1-ecd4-43bc-a79b-90ae74827547.984861dd-3a74-4845-8d9f-38a041f84813 Aug 26 14:29:10 devstack sudo[104281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:29:10 devstack sudo[104281]: pam_unix(sudo:session): session closed for user root Aug 26 14:29:10 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-531d2624-7235-407d-b962-757ffbff2745 tempest-VolumeSnapshotQuotasNegativeTestJSON-1306150496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9e9db2d1-ecd4-43bc-a79b-90ae74827547.984861dd-3a74-4845-8d9f-38a041f84813" returned: 0 in 0.515s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:29:10 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-531d2624-7235-407d-b962-757ffbff2745 tempest-VolumeSnapshotQuotasNegativeTestJSON-1306150496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9e9db2d1-ecd4-43bc-a79b-90ae74827547.984861dd-3a74-4845-8d9f-38a041f84813 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:29:10 devstack sudo[104286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9e9db2d1-ecd4-43bc-a79b-90ae74827547.984861dd-3a74-4845-8d9f-38a041f84813 Aug 26 14:29:10 devstack sudo[104286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:29:10 devstack sudo[104286]: pam_unix(sudo:session): session closed for user root Aug 26 14:29:10 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-531d2624-7235-407d-b962-757ffbff2745 tempest-VolumeSnapshotQuotasNegativeTestJSON-1306150496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9e9db2d1-ecd4-43bc-a79b-90ae74827547.984861dd-3a74-4845-8d9f-38a041f84813" returned: 0 in 0.267s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:29:11 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-531d2624-7235-407d-b962-757ffbff2745 tempest-VolumeSnapshotQuotasNegativeTestJSON-1306150496 None] Lock "cinder-quobyte-984861dd-3a74-4845-8d9f-38a041f84813" released by "_delete_snapshot" :: held 1.839s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:29:11 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-531d2624-7235-407d-b962-757ffbff2745 tempest-VolumeSnapshotQuotasNegativeTestJSON-1306150496 None] Lock "cinder-quobyte-9e9db2d1-ecd4-43bc-a79b-90ae74827547" released by "delete_snapshot" :: held 1.879s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:29:11 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-531d2624-7235-407d-b962-757ffbff2745 tempest-VolumeSnapshotQuotasNegativeTestJSON-1306150496 None] Created reservations ['90d4b2f0-ef4b-4457-8a2f-57a43cc76da8', '2154c83f-4068-4736-9449-d06b5b635b83', 'b42edc32-2176-4b92-8f9a-cfe450aff85e', '0d56d258-2126-4dd2-a861-59323325afce'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:29:11 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-531d2624-7235-407d-b962-757ffbff2745 tempest-VolumeSnapshotQuotasNegativeTestJSON-1306150496 None] Delete snapshot completed successfully. Aug 26 14:29:11 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-531d2624-7235-407d-b962-757ffbff2745 tempest-VolumeSnapshotQuotasNegativeTestJSON-1306150496 None] Lock "cinder-984861dd-3a74-4845-8d9f-38a041f84813-delete_snapshot" released by "delete_snapshot" :: held 2.137s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:29:11 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-adf63cc7-dd3b-47a4-a199-f3ef9f625ecb tempest-AttachVolumeTestJSON-1421707928 None] Acquiring lock "cinder-73084406-4812-4225-b155-ab46ce9a5d5c-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:29:11 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-adf63cc7-dd3b-47a4-a199-f3ef9f625ecb tempest-AttachVolumeTestJSON-1421707928 None] Lock "cinder-73084406-4812-4225-b155-ab46ce9a5d5c-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:29:11 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-d579fd62-6902-4701-a79c-694631d55ded tempest-VolumeSnapshotQuotasNegativeTestJSON-1306150496 None] Acquiring lock "cinder-9e9db2d1-ecd4-43bc-a79b-90ae74827547-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:29:11 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-d579fd62-6902-4701-a79c-694631d55ded tempest-VolumeSnapshotQuotasNegativeTestJSON-1306150496 None] Lock "cinder-9e9db2d1-ecd4-43bc-a79b-90ae74827547-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:29:11 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-adf63cc7-dd3b-47a4-a199-f3ef9f625ecb tempest-AttachVolumeTestJSON-1421707928 None] Acquiring lock "cinder-quobyte-73084406-4812-4225-b155-ab46ce9a5d5c" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:29:11 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-adf63cc7-dd3b-47a4-a199-f3ef9f625ecb tempest-AttachVolumeTestJSON-1421707928 None] Lock "cinder-quobyte-73084406-4812-4225-b155-ab46ce9a5d5c" acquired by "delete_volume" :: waited 0.025s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:29:11 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-d579fd62-6902-4701-a79c-694631d55ded tempest-VolumeSnapshotQuotasNegativeTestJSON-1306150496 None] Acquiring lock "cinder-quobyte-9e9db2d1-ecd4-43bc-a79b-90ae74827547" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:29:11 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[7753f6a5-3b58-4243-9fd9-ca1dcb81f533]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:29:11 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-adf63cc7-dd3b-47a4-a199-f3ef9f625ecb tempest-AttachVolumeTestJSON-1421707928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-73084406-4812-4225-b155-ab46ce9a5d5c {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:29:11 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-d579fd62-6902-4701-a79c-694631d55ded tempest-VolumeSnapshotQuotasNegativeTestJSON-1306150496 None] Lock "cinder-quobyte-9e9db2d1-ecd4-43bc-a79b-90ae74827547" acquired by "delete_volume" :: waited 0.030s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:29:11 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[64c0f2a4-f3b5-4339-a581-3f022847f1c7]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:29:11 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-d579fd62-6902-4701-a79c-694631d55ded tempest-VolumeSnapshotQuotasNegativeTestJSON-1306150496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9e9db2d1-ecd4-43bc-a79b-90ae74827547 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:29:11 devstack sudo[104289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-73084406-4812-4225-b155-ab46ce9a5d5c Aug 26 14:29:11 devstack sudo[104289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:29:11 devstack sudo[104290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9e9db2d1-ecd4-43bc-a79b-90ae74827547 Aug 26 14:29:11 devstack sudo[104290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:29:12 devstack sudo[104289]: pam_unix(sudo:session): session closed for user root Aug 26 14:29:12 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-adf63cc7-dd3b-47a4-a199-f3ef9f625ecb tempest-AttachVolumeTestJSON-1421707928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-73084406-4812-4225-b155-ab46ce9a5d5c" returned: 0 in 0.392s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:29:12 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-adf63cc7-dd3b-47a4-a199-f3ef9f625ecb tempest-AttachVolumeTestJSON-1421707928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-73084406-4812-4225-b155-ab46ce9a5d5c {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:29:12 devstack sudo[104296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-73084406-4812-4225-b155-ab46ce9a5d5c Aug 26 14:29:12 devstack sudo[104296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:29:12 devstack sudo[104290]: pam_unix(sudo:session): session closed for user root Aug 26 14:29:12 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-d579fd62-6902-4701-a79c-694631d55ded tempest-VolumeSnapshotQuotasNegativeTestJSON-1306150496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9e9db2d1-ecd4-43bc-a79b-90ae74827547" returned: 0 in 0.410s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:29:12 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-d579fd62-6902-4701-a79c-694631d55ded tempest-VolumeSnapshotQuotasNegativeTestJSON-1306150496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9e9db2d1-ecd4-43bc-a79b-90ae74827547 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:29:12 devstack sudo[104301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9e9db2d1-ecd4-43bc-a79b-90ae74827547 Aug 26 14:29:12 devstack sudo[104301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:29:12 devstack sudo[104296]: pam_unix(sudo:session): session closed for user root Aug 26 14:29:12 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-adf63cc7-dd3b-47a4-a199-f3ef9f625ecb tempest-AttachVolumeTestJSON-1421707928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-73084406-4812-4225-b155-ab46ce9a5d5c" returned: 0 in 0.271s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:29:12 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-adf63cc7-dd3b-47a4-a199-f3ef9f625ecb tempest-AttachVolumeTestJSON-1421707928 None] Lock "cinder-quobyte-73084406-4812-4225-b155-ab46ce9a5d5c" released by "delete_volume" :: held 0.708s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:29:12 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-adf63cc7-dd3b-47a4-a199-f3ef9f625ecb tempest-AttachVolumeTestJSON-1421707928 None] Created reservations ['9548a0ca-2d24-4005-9e19-d907ec48d5c6', 'd17d6ed5-e643-49c8-9c09-59c3bbb9f18e', '7f1590e1-1733-4a0b-ad14-47fef276110d', '2a2c8ab1-ed39-48da-8375-adc52ca43ac1'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:29:12 devstack sudo[104301]: pam_unix(sudo:session): session closed for user root Aug 26 14:29:12 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-d579fd62-6902-4701-a79c-694631d55ded tempest-VolumeSnapshotQuotasNegativeTestJSON-1306150496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9e9db2d1-ecd4-43bc-a79b-90ae74827547" returned: 0 in 0.270s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:29:12 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-d579fd62-6902-4701-a79c-694631d55ded tempest-VolumeSnapshotQuotasNegativeTestJSON-1306150496 None] Lock "cinder-quobyte-9e9db2d1-ecd4-43bc-a79b-90ae74827547" released by "delete_volume" :: held 0.758s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:29:12 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-adf63cc7-dd3b-47a4-a199-f3ef9f625ecb tempest-AttachVolumeTestJSON-1421707928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:29:12 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-adf63cc7-dd3b-47a4-a199-f3ef9f625ecb tempest-AttachVolumeTestJSON-1421707928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:29:12 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-adf63cc7-dd3b-47a4-a199-f3ef9f625ecb tempest-AttachVolumeTestJSON-1421707928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:29:12 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-adf63cc7-dd3b-47a4-a199-f3ef9f625ecb tempest-AttachVolumeTestJSON-1421707928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:29:12 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-adf63cc7-dd3b-47a4-a199-f3ef9f625ecb tempest-AttachVolumeTestJSON-1421707928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:29:12 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-adf63cc7-dd3b-47a4-a199-f3ef9f625ecb tempest-AttachVolumeTestJSON-1421707928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:29:12 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-d579fd62-6902-4701-a79c-694631d55ded tempest-VolumeSnapshotQuotasNegativeTestJSON-1306150496 None] Created reservations ['b4b81e28-0e0d-4544-87e4-45d5b0103d0a', '8adb24a3-c7e5-4e5c-aa46-ceaa3833e5d3', 'f0bb3c28-6164-47d8-a207-8c97d92f0c57', 'e7029710-ccaa-4967-840c-6fa4a6a4a426'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:29:12 devstack sudo[104307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:29:12 devstack sudo[104307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:29:12 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-d579fd62-6902-4701-a79c-694631d55ded tempest-VolumeSnapshotQuotasNegativeTestJSON-1306150496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:29:12 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-d579fd62-6902-4701-a79c-694631d55ded tempest-VolumeSnapshotQuotasNegativeTestJSON-1306150496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:29:12 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-d579fd62-6902-4701-a79c-694631d55ded tempest-VolumeSnapshotQuotasNegativeTestJSON-1306150496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:29:12 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-d579fd62-6902-4701-a79c-694631d55ded tempest-VolumeSnapshotQuotasNegativeTestJSON-1306150496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:29:12 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-d579fd62-6902-4701-a79c-694631d55ded tempest-VolumeSnapshotQuotasNegativeTestJSON-1306150496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:29:12 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-d579fd62-6902-4701-a79c-694631d55ded tempest-VolumeSnapshotQuotasNegativeTestJSON-1306150496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:29:12 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-8db4bc73-7112-48c7-9791-f66d75cb4f63 tempest-AttachVolumeTestJSON-1421707928 None] Acquiring lock "cinder-382c9425-2f34-41fb-a18b-96d7af7cd6c1-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:29:12 devstack sudo[104309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:29:12 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-8db4bc73-7112-48c7-9791-f66d75cb4f63 tempest-AttachVolumeTestJSON-1421707928 None] Lock "cinder-382c9425-2f34-41fb-a18b-96d7af7cd6c1-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:29:12 devstack sudo[104309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:29:12 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-8db4bc73-7112-48c7-9791-f66d75cb4f63 tempest-AttachVolumeTestJSON-1421707928 None] Acquiring lock "cinder-quobyte-382c9425-2f34-41fb-a18b-96d7af7cd6c1" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:29:12 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-8db4bc73-7112-48c7-9791-f66d75cb4f63 tempest-AttachVolumeTestJSON-1421707928 None] Lock "cinder-quobyte-382c9425-2f34-41fb-a18b-96d7af7cd6c1" acquired by "delete_volume" :: waited 0.022s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:29:12 devstack sudo[104307]: pam_unix(sudo:session): session closed for user root Aug 26 14:29:12 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-adf63cc7-dd3b-47a4-a199-f3ef9f625ecb tempest-AttachVolumeTestJSON-1421707928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.355s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:29:12 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-adf63cc7-dd3b-47a4-a199-f3ef9f625ecb tempest-AttachVolumeTestJSON-1421707928 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:29:12 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-adf63cc7-dd3b-47a4-a199-f3ef9f625ecb tempest-AttachVolumeTestJSON-1421707928 None] Deleted volume successfully. Aug 26 14:29:12 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[65c42649-1893-4800-8b94-14b21863f721]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:29:12 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-8db4bc73-7112-48c7-9791-f66d75cb4f63 tempest-AttachVolumeTestJSON-1421707928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-382c9425-2f34-41fb-a18b-96d7af7cd6c1 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:29:12 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-adf63cc7-dd3b-47a4-a199-f3ef9f625ecb tempest-AttachVolumeTestJSON-1421707928 None] Lock "cinder-73084406-4812-4225-b155-ab46ce9a5d5c-delete_volume" released by "delete_volume" :: held 1.459s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:29:13 devstack sudo[104312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-382c9425-2f34-41fb-a18b-96d7af7cd6c1 Aug 26 14:29:13 devstack sudo[104312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:29:13 devstack sudo[104309]: pam_unix(sudo:session): session closed for user root Aug 26 14:29:13 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-d579fd62-6902-4701-a79c-694631d55ded tempest-VolumeSnapshotQuotasNegativeTestJSON-1306150496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.557s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:29:13 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-d579fd62-6902-4701-a79c-694631d55ded tempest-VolumeSnapshotQuotasNegativeTestJSON-1306150496 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:29:13 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-d579fd62-6902-4701-a79c-694631d55ded tempest-VolumeSnapshotQuotasNegativeTestJSON-1306150496 None] Deleted volume successfully. Aug 26 14:29:13 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-d579fd62-6902-4701-a79c-694631d55ded tempest-VolumeSnapshotQuotasNegativeTestJSON-1306150496 None] Lock "cinder-9e9db2d1-ecd4-43bc-a79b-90ae74827547-delete_volume" released by "delete_volume" :: held 1.722s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:29:13 devstack sudo[104312]: pam_unix(sudo:session): session closed for user root Aug 26 14:29:13 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-8db4bc73-7112-48c7-9791-f66d75cb4f63 tempest-AttachVolumeTestJSON-1421707928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-382c9425-2f34-41fb-a18b-96d7af7cd6c1" returned: 0 in 0.611s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:29:13 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-8db4bc73-7112-48c7-9791-f66d75cb4f63 tempest-AttachVolumeTestJSON-1421707928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-382c9425-2f34-41fb-a18b-96d7af7cd6c1 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:29:13 devstack sudo[104318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-382c9425-2f34-41fb-a18b-96d7af7cd6c1 Aug 26 14:29:13 devstack sudo[104318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:29:13 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6f14761-294f-4e32-b53f-462d4c0f5398 tempest-AttachVolumeNegativeTest-342477261 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:29:13 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-b6f14761-294f-4e32-b53f-462d4c0f5398 tempest-AttachVolumeNegativeTest-342477261 None] Flow 'volume_create_manager' (77f6cf2d-829d-47ee-9591-124d340d6683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:29:13 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-b6f14761-294f-4e32-b53f-462d4c0f5398 tempest-AttachVolumeNegativeTest-342477261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (896814e7-dbf6-445b-b12a-5b25c4eb3867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:29:13 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-b6f14761-294f-4e32-b53f-462d4c0f5398 tempest-AttachVolumeNegativeTest-342477261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (896814e7-dbf6-445b-b12a-5b25c4eb3867) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:29:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1369705888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b9ae0c3-0a47-484b-9f00-2aa5a75482fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2ee4807719a490e87da9514d245fd2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:29:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:29:14Z,use_quota=True,user_id='3453249502664779b9b949032cd68e96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:29:13 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-b6f14761-294f-4e32-b53f-462d4c0f5398 tempest-AttachVolumeNegativeTest-342477261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d95b37c5-69c6-447e-b6dc-d9e4788d3e21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:29:13 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-b6f14761-294f-4e32-b53f-462d4c0f5398 tempest-AttachVolumeNegativeTest-342477261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d95b37c5-69c6-447e-b6dc-d9e4788d3e21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:29:13 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-b6f14761-294f-4e32-b53f-462d4c0f5398 tempest-AttachVolumeNegativeTest-342477261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (080ddfc9-fd84-4c6a-839b-9fd595b5f0de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:29:13 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-b6f14761-294f-4e32-b53f-462d4c0f5398 tempest-AttachVolumeNegativeTest-342477261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (080ddfc9-fd84-4c6a-839b-9fd595b5f0de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b9ae0c3-0a47-484b-9f00-2aa5a75482fe', 'volume_name': 'volume-4b9ae0c3-0a47-484b-9f00-2aa5a75482fe', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:29:13 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-b6f14761-294f-4e32-b53f-462d4c0f5398 tempest-AttachVolumeNegativeTest-342477261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cafedf84-ced8-4c26-a89a-0e89c037ed77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:29:13 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-b6f14761-294f-4e32-b53f-462d4c0f5398 tempest-AttachVolumeNegativeTest-342477261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cafedf84-ced8-4c26-a89a-0e89c037ed77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:29:13 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-b6f14761-294f-4e32-b53f-462d4c0f5398 tempest-AttachVolumeNegativeTest-342477261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd42f509-7b4d-48b5-9f04-9d8c51563fcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:29:13 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-b6f14761-294f-4e32-b53f-462d4c0f5398 tempest-AttachVolumeNegativeTest-342477261 None] Volume 4b9ae0c3-0a47-484b-9f00-2aa5a75482fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b9ae0c3-0a47-484b-9f00-2aa5a75482fe', 'volume_size': 1} Aug 26 14:29:13 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-b6f14761-294f-4e32-b53f-462d4c0f5398 tempest-AttachVolumeNegativeTest-342477261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:29:13 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-b6f14761-294f-4e32-b53f-462d4c0f5398 tempest-AttachVolumeNegativeTest-342477261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:29:13 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-b6f14761-294f-4e32-b53f-462d4c0f5398 tempest-AttachVolumeNegativeTest-342477261 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:29:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1369705888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b9ae0c3-0a47-484b-9f00-2aa5a75482fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2ee4807719a490e87da9514d245fd2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:29:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:29:14Z,use_quota=True,user_id='3453249502664779b9b949032cd68e96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:29:13 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-b6f14761-294f-4e32-b53f-462d4c0f5398 tempest-AttachVolumeNegativeTest-342477261 None] Creating volume 4b9ae0c3-0a47-484b-9f00-2aa5a75482fe {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:29:13 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-b6f14761-294f-4e32-b53f-462d4c0f5398 tempest-AttachVolumeNegativeTest-342477261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:29:13 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-b6f14761-294f-4e32-b53f-462d4c0f5398 tempest-AttachVolumeNegativeTest-342477261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:29:13 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-b6f14761-294f-4e32-b53f-462d4c0f5398 tempest-AttachVolumeNegativeTest-342477261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:29:13 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-b6f14761-294f-4e32-b53f-462d4c0f5398 tempest-AttachVolumeNegativeTest-342477261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:29:13 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-b6f14761-294f-4e32-b53f-462d4c0f5398 tempest-AttachVolumeNegativeTest-342477261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:29:13 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-b6f14761-294f-4e32-b53f-462d4c0f5398 tempest-AttachVolumeNegativeTest-342477261 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:29:13 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-b6f14761-294f-4e32-b53f-462d4c0f5398 tempest-AttachVolumeNegativeTest-342477261 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:29:13 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-b6f14761-294f-4e32-b53f-462d4c0f5398 tempest-AttachVolumeNegativeTest-342477261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4b9ae0c3-0a47-484b-9f00-2aa5a75482fe 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:29:13 devstack sudo[104320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4b9ae0c3-0a47-484b-9f00-2aa5a75482fe 1073741824 Aug 26 14:29:13 devstack sudo[104320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:29:13 devstack sudo[104318]: pam_unix(sudo:session): session closed for user root Aug 26 14:29:13 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-8db4bc73-7112-48c7-9791-f66d75cb4f63 tempest-AttachVolumeTestJSON-1421707928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-382c9425-2f34-41fb-a18b-96d7af7cd6c1" returned: 0 in 0.337s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:29:13 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-8db4bc73-7112-48c7-9791-f66d75cb4f63 tempest-AttachVolumeTestJSON-1421707928 None] Lock "cinder-quobyte-382c9425-2f34-41fb-a18b-96d7af7cd6c1" released by "delete_volume" :: held 1.011s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:29:13 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-8db4bc73-7112-48c7-9791-f66d75cb4f63 tempest-AttachVolumeTestJSON-1421707928 None] Created reservations ['df90f5a2-fb60-4d04-aef4-8b4c07a58f5b', '6e691075-ec5c-47f0-b7d6-0adb2fbb4de2', '5cddd076-89c9-4601-a930-b4add23711fc', 'db9b39f6-8dc8-4e23-a969-1aac6d575d8c'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:29:13 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-8db4bc73-7112-48c7-9791-f66d75cb4f63 tempest-AttachVolumeTestJSON-1421707928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:29:13 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-8db4bc73-7112-48c7-9791-f66d75cb4f63 tempest-AttachVolumeTestJSON-1421707928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:29:13 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-8db4bc73-7112-48c7-9791-f66d75cb4f63 tempest-AttachVolumeTestJSON-1421707928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:29:13 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-8db4bc73-7112-48c7-9791-f66d75cb4f63 tempest-AttachVolumeTestJSON-1421707928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:29:13 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-8db4bc73-7112-48c7-9791-f66d75cb4f63 tempest-AttachVolumeTestJSON-1421707928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:29:13 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-8db4bc73-7112-48c7-9791-f66d75cb4f63 tempest-AttachVolumeTestJSON-1421707928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:29:14 devstack sudo[104325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:29:14 devstack sudo[104325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:29:14 devstack sudo[104325]: pam_unix(sudo:session): session closed for user root Aug 26 14:29:14 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-8db4bc73-7112-48c7-9791-f66d75cb4f63 tempest-AttachVolumeTestJSON-1421707928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.275s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:29:14 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-8db4bc73-7112-48c7-9791-f66d75cb4f63 tempest-AttachVolumeTestJSON-1421707928 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:29:14 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-8db4bc73-7112-48c7-9791-f66d75cb4f63 tempest-AttachVolumeTestJSON-1421707928 None] Deleted volume successfully. Aug 26 14:29:14 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-8db4bc73-7112-48c7-9791-f66d75cb4f63 tempest-AttachVolumeTestJSON-1421707928 None] Lock "cinder-382c9425-2f34-41fb-a18b-96d7af7cd6c1-delete_volume" released by "delete_volume" :: held 1.547s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:29:14 devstack sudo[104320]: pam_unix(sudo:session): session closed for user root Aug 26 14:29:14 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-b6f14761-294f-4e32-b53f-462d4c0f5398 tempest-AttachVolumeNegativeTest-342477261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4b9ae0c3-0a47-484b-9f00-2aa5a75482fe 1073741824" returned: 0 in 0.638s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:29:14 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-93b01b8f-83cf-45ff-ba51-ecc2366d791f tempest-AttachVolumeTestJSON-1421707928 None] Acquiring lock "cinder-c1a50d5b-8b47-41c5-b6ac-decaa9684a65-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:29:14 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-b6f14761-294f-4e32-b53f-462d4c0f5398 tempest-AttachVolumeNegativeTest-342477261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4b9ae0c3-0a47-484b-9f00-2aa5a75482fe {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:29:14 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-93b01b8f-83cf-45ff-ba51-ecc2366d791f tempest-AttachVolumeTestJSON-1421707928 None] Lock "cinder-c1a50d5b-8b47-41c5-b6ac-decaa9684a65-delete_volume" acquired by "delete_volume" :: waited 0.086s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:29:14 devstack sudo[104330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4b9ae0c3-0a47-484b-9f00-2aa5a75482fe Aug 26 14:29:14 devstack sudo[104330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:29:14 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-93b01b8f-83cf-45ff-ba51-ecc2366d791f tempest-AttachVolumeTestJSON-1421707928 None] Acquiring lock "cinder-quobyte-c1a50d5b-8b47-41c5-b6ac-decaa9684a65" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:29:14 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-93b01b8f-83cf-45ff-ba51-ecc2366d791f tempest-AttachVolumeTestJSON-1421707928 None] Lock "cinder-quobyte-c1a50d5b-8b47-41c5-b6ac-decaa9684a65" acquired by "delete_volume" :: waited 0.026s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:29:14 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d655bfb-3a33-4026-8f31-231923515093]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:29:14 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-93b01b8f-83cf-45ff-ba51-ecc2366d791f tempest-AttachVolumeTestJSON-1421707928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c1a50d5b-8b47-41c5-b6ac-decaa9684a65 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:29:14 devstack sudo[104330]: pam_unix(sudo:session): session closed for user root Aug 26 14:29:14 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-b6f14761-294f-4e32-b53f-462d4c0f5398 tempest-AttachVolumeNegativeTest-342477261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4b9ae0c3-0a47-484b-9f00-2aa5a75482fe" returned: 0 in 0.428s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:29:14 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-b6f14761-294f-4e32-b53f-462d4c0f5398 tempest-AttachVolumeNegativeTest-342477261 None] <== create_volume: return (1186ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:29:14 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-b6f14761-294f-4e32-b53f-462d4c0f5398 tempest-AttachVolumeNegativeTest-342477261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.188s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:29:14 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-b6f14761-294f-4e32-b53f-462d4c0f5398 tempest-AttachVolumeNegativeTest-342477261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd42f509-7b4d-48b5-9f04-9d8c51563fcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b9ae0c3-0a47-484b-9f00-2aa5a75482fe', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:29:14 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-b6f14761-294f-4e32-b53f-462d4c0f5398 tempest-AttachVolumeNegativeTest-342477261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54abcc4f-6a57-45c8-b5fa-417e95f26112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:29:14 devstack sudo[104332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c1a50d5b-8b47-41c5-b6ac-decaa9684a65 Aug 26 14:29:14 devstack sudo[104332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:29:14 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-b6f14761-294f-4e32-b53f-462d4c0f5398 tempest-AttachVolumeNegativeTest-342477261 None] Volume volume-4b9ae0c3-0a47-484b-9f00-2aa5a75482fe (4b9ae0c3-0a47-484b-9f00-2aa5a75482fe): created successfully Aug 26 14:29:14 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-b6f14761-294f-4e32-b53f-462d4c0f5398 tempest-AttachVolumeNegativeTest-342477261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54abcc4f-6a57-45c8-b5fa-417e95f26112) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:29:14 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-b6f14761-294f-4e32-b53f-462d4c0f5398 tempest-AttachVolumeNegativeTest-342477261 None] Flow 'volume_create_manager' (77f6cf2d-829d-47ee-9591-124d340d6683) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:29:15 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-b6f14761-294f-4e32-b53f-462d4c0f5398 tempest-AttachVolumeNegativeTest-342477261 None] Created volume successfully. Aug 26 14:29:15 devstack sudo[104332]: pam_unix(sudo:session): session closed for user root Aug 26 14:29:15 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-93b01b8f-83cf-45ff-ba51-ecc2366d791f tempest-AttachVolumeTestJSON-1421707928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c1a50d5b-8b47-41c5-b6ac-decaa9684a65" returned: 0 in 0.438s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:29:15 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-93b01b8f-83cf-45ff-ba51-ecc2366d791f tempest-AttachVolumeTestJSON-1421707928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c1a50d5b-8b47-41c5-b6ac-decaa9684a65 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:29:15 devstack sudo[104339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c1a50d5b-8b47-41c5-b6ac-decaa9684a65 Aug 26 14:29:15 devstack sudo[104339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:29:15 devstack sudo[104339]: pam_unix(sudo:session): session closed for user root Aug 26 14:29:15 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-93b01b8f-83cf-45ff-ba51-ecc2366d791f tempest-AttachVolumeTestJSON-1421707928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c1a50d5b-8b47-41c5-b6ac-decaa9684a65" returned: 0 in 0.272s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:29:15 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-93b01b8f-83cf-45ff-ba51-ecc2366d791f tempest-AttachVolumeTestJSON-1421707928 None] Lock "cinder-quobyte-c1a50d5b-8b47-41c5-b6ac-decaa9684a65" released by "delete_volume" :: held 0.780s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:29:15 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-93b01b8f-83cf-45ff-ba51-ecc2366d791f tempest-AttachVolumeTestJSON-1421707928 None] Created reservations ['808018c9-2127-4f3d-8a34-1e6be25219cb', 'c80c1972-65f0-412a-90c4-d9f3042666f0', 'f43412e7-5bdf-4090-9e03-179061d86135', 'c7a78006-95aa-47fb-a352-15a9a9e72aa8'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:29:15 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-93b01b8f-83cf-45ff-ba51-ecc2366d791f tempest-AttachVolumeTestJSON-1421707928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:29:15 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-93b01b8f-83cf-45ff-ba51-ecc2366d791f tempest-AttachVolumeTestJSON-1421707928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:29:15 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-93b01b8f-83cf-45ff-ba51-ecc2366d791f tempest-AttachVolumeTestJSON-1421707928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:29:15 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-93b01b8f-83cf-45ff-ba51-ecc2366d791f tempest-AttachVolumeTestJSON-1421707928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:29:15 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-93b01b8f-83cf-45ff-ba51-ecc2366d791f tempest-AttachVolumeTestJSON-1421707928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:29:15 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-93b01b8f-83cf-45ff-ba51-ecc2366d791f tempest-AttachVolumeTestJSON-1421707928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:29:15 devstack sudo[104342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:29:15 devstack sudo[104342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:29:16 devstack sudo[104342]: pam_unix(sudo:session): session closed for user root Aug 26 14:29:16 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-93b01b8f-83cf-45ff-ba51-ecc2366d791f tempest-AttachVolumeTestJSON-1421707928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.385s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:29:16 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-93b01b8f-83cf-45ff-ba51-ecc2366d791f tempest-AttachVolumeTestJSON-1421707928 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:29:16 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-93b01b8f-83cf-45ff-ba51-ecc2366d791f tempest-AttachVolumeTestJSON-1421707928 None] Deleted volume successfully. Aug 26 14:29:16 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-93b01b8f-83cf-45ff-ba51-ecc2366d791f tempest-AttachVolumeTestJSON-1421707928 None] Lock "cinder-c1a50d5b-8b47-41c5-b6ac-decaa9684a65-delete_volume" released by "delete_volume" :: held 1.639s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:29:17 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [req-ce772990-10bd-4521-af83-a278ad792553 req-3fdce547-c89e-4285-a29c-323ea679b18f tempest-AttachVolumeNegativeTest-342477261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:29:17 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [req-ce772990-10bd-4521-af83-a278ad792553 req-3fdce547-c89e-4285-a29c-323ea679b18f tempest-AttachVolumeNegativeTest-342477261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:29:17 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [req-ce772990-10bd-4521-af83-a278ad792553 req-3fdce547-c89e-4285-a29c-323ea679b18f tempest-AttachVolumeNegativeTest-342477261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:29:17 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [req-ce772990-10bd-4521-af83-a278ad792553 req-3fdce547-c89e-4285-a29c-323ea679b18f tempest-AttachVolumeNegativeTest-342477261 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b', 'name': 'volume-4b9ae0c3-0a47-484b-9f00-2aa5a75482fe', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b8944d17-0818-43fc-8d72-bb41e1164c14', 'enforce_multipath': True} {{(pid=94394) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 14:29:17 devstack cinder-volume[94394]: INFO cinder.volume.manager [req-ce772990-10bd-4521-af83-a278ad792553 req-3fdce547-c89e-4285-a29c-323ea679b18f tempest-AttachVolumeNegativeTest-342477261 None] attachment_update completed successfully. Aug 26 14:29:19 devstack cinder-volume[94394]: INFO cinder.volume.manager [req-34408e82-9d9f-42c3-87da-84919f7ff3a5 req-e4830aa1-329f-4f2d-90e8-78bc0223fee3 tempest-AttachVolumeNegativeTest-342477261 None] Terminate volume connection completed successfully. Aug 26 14:29:19 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [req-34408e82-9d9f-42c3-87da-84919f7ff3a5 req-e4830aa1-329f-4f2d-90e8-78bc0223fee3 tempest-AttachVolumeNegativeTest-342477261 None] Deleting attachment b8944d17-0818-43fc-8d72-bb41e1164c14. {{(pid=94394) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 14:29:21 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-c86ac194-b807-4aac-8bcf-93054ee7babf tempest-VolumesDeleteCascade-1307048346 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:29:22 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-c86ac194-b807-4aac-8bcf-93054ee7babf tempest-VolumesDeleteCascade-1307048346 None] Flow 'volume_create_manager' (bb268f4c-b516-43b5-98c0-8fae8703281e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:29:22 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-c86ac194-b807-4aac-8bcf-93054ee7babf tempest-VolumesDeleteCascade-1307048346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f915e30-fe99-4e6e-9fc9-105668a15b4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:29:22 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-c86ac194-b807-4aac-8bcf-93054ee7babf tempest-VolumesDeleteCascade-1307048346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f915e30-fe99-4e6e-9fc9-105668a15b4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:29:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1184567484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c587c54-c98d-4c19-884e-907d6aaeda77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0965d53b96f4cc98fd03e200dd2dd6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:29:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:29:22Z,use_quota=True,user_id='44e3bc86eb074f5789b3d1f4c2c7d33c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:29:22 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-c86ac194-b807-4aac-8bcf-93054ee7babf tempest-VolumesDeleteCascade-1307048346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9da450af-786a-40ec-973e-7719425dbd8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:29:22 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-c86ac194-b807-4aac-8bcf-93054ee7babf tempest-VolumesDeleteCascade-1307048346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9da450af-786a-40ec-973e-7719425dbd8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:29:22 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-c86ac194-b807-4aac-8bcf-93054ee7babf tempest-VolumesDeleteCascade-1307048346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c50cbdb6-fb39-4ec0-9cad-2e5645c6dc8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:29:22 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-c86ac194-b807-4aac-8bcf-93054ee7babf tempest-VolumesDeleteCascade-1307048346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c50cbdb6-fb39-4ec0-9cad-2e5645c6dc8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c587c54-c98d-4c19-884e-907d6aaeda77', 'volume_name': 'volume-3c587c54-c98d-4c19-884e-907d6aaeda77', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:29:22 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-c86ac194-b807-4aac-8bcf-93054ee7babf tempest-VolumesDeleteCascade-1307048346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecf90d61-6c8a-4f69-8969-4f7ec1f38dda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:29:22 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-c86ac194-b807-4aac-8bcf-93054ee7babf tempest-VolumesDeleteCascade-1307048346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecf90d61-6c8a-4f69-8969-4f7ec1f38dda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:29:22 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-c86ac194-b807-4aac-8bcf-93054ee7babf tempest-VolumesDeleteCascade-1307048346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fba05a5a-1226-4f38-b53d-e10d8646dbbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:29:22 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-c86ac194-b807-4aac-8bcf-93054ee7babf tempest-VolumesDeleteCascade-1307048346 None] Volume 3c587c54-c98d-4c19-884e-907d6aaeda77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c587c54-c98d-4c19-884e-907d6aaeda77', 'volume_size': 1} Aug 26 14:29:22 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-c86ac194-b807-4aac-8bcf-93054ee7babf tempest-VolumesDeleteCascade-1307048346 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:29:22 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-c86ac194-b807-4aac-8bcf-93054ee7babf tempest-VolumesDeleteCascade-1307048346 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:29:22 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-c86ac194-b807-4aac-8bcf-93054ee7babf tempest-VolumesDeleteCascade-1307048346 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:29:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1184567484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c587c54-c98d-4c19-884e-907d6aaeda77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0965d53b96f4cc98fd03e200dd2dd6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:29:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:29:22Z,use_quota=True,user_id='44e3bc86eb074f5789b3d1f4c2c7d33c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:29:22 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-c86ac194-b807-4aac-8bcf-93054ee7babf tempest-VolumesDeleteCascade-1307048346 None] Creating volume 3c587c54-c98d-4c19-884e-907d6aaeda77 {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:29:22 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-c86ac194-b807-4aac-8bcf-93054ee7babf tempest-VolumesDeleteCascade-1307048346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:29:22 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-c86ac194-b807-4aac-8bcf-93054ee7babf tempest-VolumesDeleteCascade-1307048346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:29:22 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-c86ac194-b807-4aac-8bcf-93054ee7babf tempest-VolumesDeleteCascade-1307048346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:29:22 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-c86ac194-b807-4aac-8bcf-93054ee7babf tempest-VolumesDeleteCascade-1307048346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:29:22 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-c86ac194-b807-4aac-8bcf-93054ee7babf tempest-VolumesDeleteCascade-1307048346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:29:22 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-c86ac194-b807-4aac-8bcf-93054ee7babf tempest-VolumesDeleteCascade-1307048346 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:29:22 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-c86ac194-b807-4aac-8bcf-93054ee7babf tempest-VolumesDeleteCascade-1307048346 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:29:22 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-c86ac194-b807-4aac-8bcf-93054ee7babf tempest-VolumesDeleteCascade-1307048346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3c587c54-c98d-4c19-884e-907d6aaeda77 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:29:22 devstack sudo[104800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3c587c54-c98d-4c19-884e-907d6aaeda77 1073741824 Aug 26 14:29:22 devstack sudo[104800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:29:22 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-c86ac194-b807-4aac-8bcf-93054ee7babf tempest-VolumesDeleteCascade-1307048346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3c587c54-c98d-4c19-884e-907d6aaeda77 1073741824" returned: 0 in 0.671s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:29:22 devstack sudo[104800]: pam_unix(sudo:session): session closed for user root Aug 26 14:29:22 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-c86ac194-b807-4aac-8bcf-93054ee7babf tempest-VolumesDeleteCascade-1307048346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3c587c54-c98d-4c19-884e-907d6aaeda77 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:29:22 devstack sudo[104812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3c587c54-c98d-4c19-884e-907d6aaeda77 Aug 26 14:29:22 devstack sudo[104812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:29:23 devstack sudo[104812]: pam_unix(sudo:session): session closed for user root Aug 26 14:29:23 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-c86ac194-b807-4aac-8bcf-93054ee7babf tempest-VolumesDeleteCascade-1307048346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3c587c54-c98d-4c19-884e-907d6aaeda77" returned: 0 in 0.484s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:29:23 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-c86ac194-b807-4aac-8bcf-93054ee7babf tempest-VolumesDeleteCascade-1307048346 None] <== create_volume: return (1229ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:29:23 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-c86ac194-b807-4aac-8bcf-93054ee7babf tempest-VolumesDeleteCascade-1307048346 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.233s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:29:23 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-c86ac194-b807-4aac-8bcf-93054ee7babf tempest-VolumesDeleteCascade-1307048346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fba05a5a-1226-4f38-b53d-e10d8646dbbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c587c54-c98d-4c19-884e-907d6aaeda77', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:29:23 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-c86ac194-b807-4aac-8bcf-93054ee7babf tempest-VolumesDeleteCascade-1307048346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d3e0a77-6acd-4c0e-be49-75c300eea290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:29:23 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-c86ac194-b807-4aac-8bcf-93054ee7babf tempest-VolumesDeleteCascade-1307048346 None] Volume volume-3c587c54-c98d-4c19-884e-907d6aaeda77 (3c587c54-c98d-4c19-884e-907d6aaeda77): created successfully Aug 26 14:29:23 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-c86ac194-b807-4aac-8bcf-93054ee7babf tempest-VolumesDeleteCascade-1307048346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d3e0a77-6acd-4c0e-be49-75c300eea290) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:29:23 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-c86ac194-b807-4aac-8bcf-93054ee7babf tempest-VolumesDeleteCascade-1307048346 None] Flow 'volume_create_manager' (bb268f4c-b516-43b5-98c0-8fae8703281e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:29:23 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-c86ac194-b807-4aac-8bcf-93054ee7babf tempest-VolumesDeleteCascade-1307048346 None] Created volume successfully. Aug 26 14:29:24 devstack cinder-volume[94394]: DEBUG dbcounter [-] [94394] Writing DB stats cinder:SELECT=115,cinder:UPDATE=123,cinder:DELETE=5,cinder:INSERT=23 {{(pid=94394) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 14:29:24 devstack cinder-volume[94394]: DEBUG dbcounter [-] [94394] Writing DB stats cinder:SELECT=105,cinder:UPDATE=118,cinder:INSERT=29,cinder:DELETE=12 {{(pid=94394) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 14:29:24 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-dd642140-72aa-4e67-8c9c-77963cdb2aeb tempest-VolumesDeleteCascade-1307048346 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:29:24 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-dd642140-72aa-4e67-8c9c-77963cdb2aeb tempest-VolumesDeleteCascade-1307048346 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:29:24 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-dd642140-72aa-4e67-8c9c-77963cdb2aeb tempest-VolumesDeleteCascade-1307048346 None] Creating offline snapshot 9313f6aa-62c7-497b-a758-7124be9f09d5 of volume 3c587c54-c98d-4c19-884e-907d6aaeda77 {{(pid=94394) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 14:29:24 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0524bff-7790-4cf3-97f9-6dd93af7ce29]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:29:24 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-dd642140-72aa-4e67-8c9c-77963cdb2aeb tempest-VolumesDeleteCascade-1307048346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3c587c54-c98d-4c19-884e-907d6aaeda77 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:29:24 devstack sudo[104828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3c587c54-c98d-4c19-884e-907d6aaeda77 Aug 26 14:29:24 devstack sudo[104828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:29:24 devstack sudo[104828]: pam_unix(sudo:session): session closed for user root Aug 26 14:29:24 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-dd642140-72aa-4e67-8c9c-77963cdb2aeb tempest-VolumesDeleteCascade-1307048346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3c587c54-c98d-4c19-884e-907d6aaeda77" returned: 0 in 0.408s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:29:24 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-dd642140-72aa-4e67-8c9c-77963cdb2aeb tempest-VolumesDeleteCascade-1307048346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3c587c54-c98d-4c19-884e-907d6aaeda77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3c587c54-c98d-4c19-884e-907d6aaeda77.9313f6aa-62c7-497b-a758-7124be9f09d5 1G {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:29:24 devstack sudo[104833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3c587c54-c98d-4c19-884e-907d6aaeda77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3c587c54-c98d-4c19-884e-907d6aaeda77.9313f6aa-62c7-497b-a758-7124be9f09d5 1G Aug 26 14:29:24 devstack sudo[104833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:29:25 devstack sudo[104833]: pam_unix(sudo:session): session closed for user root Aug 26 14:29:25 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-dd642140-72aa-4e67-8c9c-77963cdb2aeb tempest-VolumesDeleteCascade-1307048346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3c587c54-c98d-4c19-884e-907d6aaeda77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3c587c54-c98d-4c19-884e-907d6aaeda77.9313f6aa-62c7-497b-a758-7124be9f09d5 1G" returned: 0 in 0.470s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:29:25 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-dd642140-72aa-4e67-8c9c-77963cdb2aeb tempest-VolumesDeleteCascade-1307048346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c587c54-c98d-4c19-884e-907d6aaeda77 -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3c587c54-c98d-4c19-884e-907d6aaeda77.9313f6aa-62c7-497b-a758-7124be9f09d5 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:29:25 devstack sudo[104841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c587c54-c98d-4c19-884e-907d6aaeda77 -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3c587c54-c98d-4c19-884e-907d6aaeda77.9313f6aa-62c7-497b-a758-7124be9f09d5 Aug 26 14:29:25 devstack sudo[104841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:29:25 devstack sudo[104841]: pam_unix(sudo:session): session closed for user root Aug 26 14:29:25 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-dd642140-72aa-4e67-8c9c-77963cdb2aeb tempest-VolumesDeleteCascade-1307048346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c587c54-c98d-4c19-884e-907d6aaeda77 -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3c587c54-c98d-4c19-884e-907d6aaeda77.9313f6aa-62c7-497b-a758-7124be9f09d5" returned: 0 in 0.339s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:29:25 devstack cinder-volume[94394]: WARNING cinder.volume.drivers.remotefs [None req-dd642140-72aa-4e67-8c9c-77963cdb2aeb tempest-VolumesDeleteCascade-1307048346 None] /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3c587c54-c98d-4c19-884e-907d6aaeda77.9313f6aa-62c7-497b-a758-7124be9f09d5 is being set with open permissions: ugo+rw Aug 26 14:29:25 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-dd642140-72aa-4e67-8c9c-77963cdb2aeb tempest-VolumesDeleteCascade-1307048346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3c587c54-c98d-4c19-884e-907d6aaeda77.9313f6aa-62c7-497b-a758-7124be9f09d5 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:29:25 devstack sudo[104857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3c587c54-c98d-4c19-884e-907d6aaeda77.9313f6aa-62c7-497b-a758-7124be9f09d5 Aug 26 14:29:25 devstack sudo[104857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:29:25 devstack sudo[104857]: pam_unix(sudo:session): session closed for user root Aug 26 14:29:25 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-dd642140-72aa-4e67-8c9c-77963cdb2aeb tempest-VolumesDeleteCascade-1307048346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3c587c54-c98d-4c19-884e-907d6aaeda77.9313f6aa-62c7-497b-a758-7124be9f09d5" returned: 0 in 0.290s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:29:25 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-dd642140-72aa-4e67-8c9c-77963cdb2aeb tempest-VolumesDeleteCascade-1307048346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3c587c54-c98d-4c19-884e-907d6aaeda77.info {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:29:25 devstack sudo[104884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3c587c54-c98d-4c19-884e-907d6aaeda77.info Aug 26 14:29:25 devstack sudo[104884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:29:26 devstack sudo[104884]: pam_unix(sudo:session): session closed for user root Aug 26 14:29:26 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-dd642140-72aa-4e67-8c9c-77963cdb2aeb tempest-VolumesDeleteCascade-1307048346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3c587c54-c98d-4c19-884e-907d6aaeda77.info" returned: 0 in 0.398s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:29:26 devstack cinder-volume[94394]: WARNING cinder.volume.drivers.remotefs [None req-dd642140-72aa-4e67-8c9c-77963cdb2aeb tempest-VolumesDeleteCascade-1307048346 None] /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3c587c54-c98d-4c19-884e-907d6aaeda77.info is being set with open permissions: ugo+rw Aug 26 14:29:26 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-dd642140-72aa-4e67-8c9c-77963cdb2aeb tempest-VolumesDeleteCascade-1307048346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3c587c54-c98d-4c19-884e-907d6aaeda77.info {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:29:26 devstack sudo[104889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3c587c54-c98d-4c19-884e-907d6aaeda77.info Aug 26 14:29:26 devstack sudo[104889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:29:26 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-4341f52b-824b-4b53-8b7c-f8c246790414 tempest-AttachVolumeNegativeTest-342477261 None] Acquiring lock "cinder-4b9ae0c3-0a47-484b-9f00-2aa5a75482fe-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:29:26 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-4341f52b-824b-4b53-8b7c-f8c246790414 tempest-AttachVolumeNegativeTest-342477261 None] Lock "cinder-4b9ae0c3-0a47-484b-9f00-2aa5a75482fe-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:29:26 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-4341f52b-824b-4b53-8b7c-f8c246790414 tempest-AttachVolumeNegativeTest-342477261 None] Acquiring lock "cinder-quobyte-4b9ae0c3-0a47-484b-9f00-2aa5a75482fe" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:29:26 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-4341f52b-824b-4b53-8b7c-f8c246790414 tempest-AttachVolumeNegativeTest-342477261 None] Lock "cinder-quobyte-4b9ae0c3-0a47-484b-9f00-2aa5a75482fe" acquired by "delete_volume" :: waited 0.033s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:29:26 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5411920-bdb7-4c75-8d31-2bcfb2810c72]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:29:26 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4341f52b-824b-4b53-8b7c-f8c246790414 tempest-AttachVolumeNegativeTest-342477261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4b9ae0c3-0a47-484b-9f00-2aa5a75482fe {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:29:26 devstack sudo[104889]: pam_unix(sudo:session): session closed for user root Aug 26 14:29:26 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-dd642140-72aa-4e67-8c9c-77963cdb2aeb tempest-VolumesDeleteCascade-1307048346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3c587c54-c98d-4c19-884e-907d6aaeda77.info" returned: 0 in 0.334s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:29:26 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-dd642140-72aa-4e67-8c9c-77963cdb2aeb tempest-VolumesDeleteCascade-1307048346 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.355s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:29:26 devstack sudo[104892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4b9ae0c3-0a47-484b-9f00-2aa5a75482fe Aug 26 14:29:26 devstack sudo[104892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:29:26 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-dd642140-72aa-4e67-8c9c-77963cdb2aeb tempest-VolumesDeleteCascade-1307048346 None] Create snapshot completed successfully Aug 26 14:29:27 devstack sudo[104892]: pam_unix(sudo:session): session closed for user root Aug 26 14:29:27 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4341f52b-824b-4b53-8b7c-f8c246790414 tempest-AttachVolumeNegativeTest-342477261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4b9ae0c3-0a47-484b-9f00-2aa5a75482fe" returned: 0 in 0.662s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:29:27 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4341f52b-824b-4b53-8b7c-f8c246790414 tempest-AttachVolumeNegativeTest-342477261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4b9ae0c3-0a47-484b-9f00-2aa5a75482fe {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:29:27 devstack sudo[104928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4b9ae0c3-0a47-484b-9f00-2aa5a75482fe Aug 26 14:29:27 devstack sudo[104928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:29:27 devstack sudo[104928]: pam_unix(sudo:session): session closed for user root Aug 26 14:29:27 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4341f52b-824b-4b53-8b7c-f8c246790414 tempest-AttachVolumeNegativeTest-342477261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4b9ae0c3-0a47-484b-9f00-2aa5a75482fe" returned: 0 in 0.524s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:29:27 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-4341f52b-824b-4b53-8b7c-f8c246790414 tempest-AttachVolumeNegativeTest-342477261 None] Lock "cinder-quobyte-4b9ae0c3-0a47-484b-9f00-2aa5a75482fe" released by "delete_volume" :: held 1.303s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:29:27 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-54963f9b-e82f-4336-bfd6-c635c372ab17 tempest-VolumesDeleteCascade-1307048346 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:29:27 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-54963f9b-e82f-4336-bfd6-c635c372ab17 tempest-VolumesDeleteCascade-1307048346 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:29:27 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-54963f9b-e82f-4336-bfd6-c635c372ab17 tempest-VolumesDeleteCascade-1307048346 None] Creating offline snapshot 425325e3-470b-4f40-bc39-6d92b65b9445 of volume 3c587c54-c98d-4c19-884e-907d6aaeda77 {{(pid=94394) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 14:29:28 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3ce67be-213f-4ca3-bcf5-1ea843f1592a]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:29:28 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-54963f9b-e82f-4336-bfd6-c635c372ab17 tempest-VolumesDeleteCascade-1307048346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3c587c54-c98d-4c19-884e-907d6aaeda77.9313f6aa-62c7-497b-a758-7124be9f09d5 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:29:28 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-4341f52b-824b-4b53-8b7c-f8c246790414 tempest-AttachVolumeNegativeTest-342477261 None] Created reservations ['9a3e4d6a-ef12-4d5c-b469-336099f011b2', '1217db12-c041-46a0-abce-1dc3b6946359', 'a5c73afc-ea8c-44c9-af06-c0c125f8e1ec', 'a1e0f3e8-cb56-4fad-9fcb-5a8ee4be4976'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:29:28 devstack sudo[104960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3c587c54-c98d-4c19-884e-907d6aaeda77.9313f6aa-62c7-497b-a758-7124be9f09d5 Aug 26 14:29:28 devstack sudo[104960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:29:28 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-4341f52b-824b-4b53-8b7c-f8c246790414 tempest-AttachVolumeNegativeTest-342477261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:29:28 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-4341f52b-824b-4b53-8b7c-f8c246790414 tempest-AttachVolumeNegativeTest-342477261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:29:28 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-4341f52b-824b-4b53-8b7c-f8c246790414 tempest-AttachVolumeNegativeTest-342477261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:29:28 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-4341f52b-824b-4b53-8b7c-f8c246790414 tempest-AttachVolumeNegativeTest-342477261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:29:28 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-4341f52b-824b-4b53-8b7c-f8c246790414 tempest-AttachVolumeNegativeTest-342477261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:29:28 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4341f52b-824b-4b53-8b7c-f8c246790414 tempest-AttachVolumeNegativeTest-342477261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:29:28 devstack sudo[104971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:29:28 devstack sudo[104971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:29:28 devstack sudo[104960]: pam_unix(sudo:session): session closed for user root Aug 26 14:29:28 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-54963f9b-e82f-4336-bfd6-c635c372ab17 tempest-VolumesDeleteCascade-1307048346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3c587c54-c98d-4c19-884e-907d6aaeda77.9313f6aa-62c7-497b-a758-7124be9f09d5" returned: 0 in 0.689s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:29:28 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-54963f9b-e82f-4336-bfd6-c635c372ab17 tempest-VolumesDeleteCascade-1307048346 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3c587c54-c98d-4c19-884e-907d6aaeda77(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94394) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 14:29:28 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-54963f9b-e82f-4336-bfd6-c635c372ab17 tempest-VolumesDeleteCascade-1307048346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3c587c54-c98d-4c19-884e-907d6aaeda77.9313f6aa-62c7-497b-a758-7124be9f09d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3c587c54-c98d-4c19-884e-907d6aaeda77.425325e3-470b-4f40-bc39-6d92b65b9445 1G {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:29:28 devstack sudo[104997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3c587c54-c98d-4c19-884e-907d6aaeda77.9313f6aa-62c7-497b-a758-7124be9f09d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3c587c54-c98d-4c19-884e-907d6aaeda77.425325e3-470b-4f40-bc39-6d92b65b9445 1G Aug 26 14:29:28 devstack sudo[104997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:29:28 devstack sudo[104971]: pam_unix(sudo:session): session closed for user root Aug 26 14:29:28 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4341f52b-824b-4b53-8b7c-f8c246790414 tempest-AttachVolumeNegativeTest-342477261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.607s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:29:28 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-4341f52b-824b-4b53-8b7c-f8c246790414 tempest-AttachVolumeNegativeTest-342477261 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:29:28 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-4341f52b-824b-4b53-8b7c-f8c246790414 tempest-AttachVolumeNegativeTest-342477261 None] Deleted volume successfully. Aug 26 14:29:29 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-4341f52b-824b-4b53-8b7c-f8c246790414 tempest-AttachVolumeNegativeTest-342477261 None] Lock "cinder-4b9ae0c3-0a47-484b-9f00-2aa5a75482fe-delete_volume" released by "delete_volume" :: held 2.565s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:29:29 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-ea229d2c-4a59-487c-bea4-7f8b3e2cfced tempest-AttachVolumeNegativeTest-342477261 None] Acquiring lock "cinder-c4369af1-8cf2-4de7-8b06-17ee4d045395-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:29:29 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-ea229d2c-4a59-487c-bea4-7f8b3e2cfced tempest-AttachVolumeNegativeTest-342477261 None] Lock "cinder-c4369af1-8cf2-4de7-8b06-17ee4d045395-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:29:29 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-ea229d2c-4a59-487c-bea4-7f8b3e2cfced tempest-AttachVolumeNegativeTest-342477261 None] Acquiring lock "cinder-quobyte-c4369af1-8cf2-4de7-8b06-17ee4d045395" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:29:29 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-ea229d2c-4a59-487c-bea4-7f8b3e2cfced tempest-AttachVolumeNegativeTest-342477261 None] Lock "cinder-quobyte-c4369af1-8cf2-4de7-8b06-17ee4d045395" acquired by "delete_volume" :: waited 0.026s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:29:29 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[9681bf16-612a-462f-b1f8-5421819ada46]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:29:29 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-ea229d2c-4a59-487c-bea4-7f8b3e2cfced tempest-AttachVolumeNegativeTest-342477261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c4369af1-8cf2-4de7-8b06-17ee4d045395 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:29:29 devstack sudo[105004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c4369af1-8cf2-4de7-8b06-17ee4d045395 Aug 26 14:29:29 devstack sudo[105004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:29:29 devstack sudo[104997]: pam_unix(sudo:session): session closed for user root Aug 26 14:29:29 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-54963f9b-e82f-4336-bfd6-c635c372ab17 tempest-VolumesDeleteCascade-1307048346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3c587c54-c98d-4c19-884e-907d6aaeda77.9313f6aa-62c7-497b-a758-7124be9f09d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3c587c54-c98d-4c19-884e-907d6aaeda77.425325e3-470b-4f40-bc39-6d92b65b9445 1G" returned: 0 in 0.689s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:29:29 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-54963f9b-e82f-4336-bfd6-c635c372ab17 tempest-VolumesDeleteCascade-1307048346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c587c54-c98d-4c19-884e-907d6aaeda77.9313f6aa-62c7-497b-a758-7124be9f09d5 -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3c587c54-c98d-4c19-884e-907d6aaeda77.425325e3-470b-4f40-bc39-6d92b65b9445 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:29:29 devstack sudo[105007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c587c54-c98d-4c19-884e-907d6aaeda77.9313f6aa-62c7-497b-a758-7124be9f09d5 -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3c587c54-c98d-4c19-884e-907d6aaeda77.425325e3-470b-4f40-bc39-6d92b65b9445 Aug 26 14:29:29 devstack sudo[105007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:29:29 devstack sudo[105004]: pam_unix(sudo:session): session closed for user root Aug 26 14:29:29 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-ea229d2c-4a59-487c-bea4-7f8b3e2cfced tempest-AttachVolumeNegativeTest-342477261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c4369af1-8cf2-4de7-8b06-17ee4d045395" returned: 0 in 0.452s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:29:29 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-ea229d2c-4a59-487c-bea4-7f8b3e2cfced tempest-AttachVolumeNegativeTest-342477261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c4369af1-8cf2-4de7-8b06-17ee4d045395 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:29:29 devstack sudo[105012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c4369af1-8cf2-4de7-8b06-17ee4d045395 Aug 26 14:29:29 devstack sudo[105012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:29:30 devstack sudo[105007]: pam_unix(sudo:session): session closed for user root Aug 26 14:29:30 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-54963f9b-e82f-4336-bfd6-c635c372ab17 tempest-VolumesDeleteCascade-1307048346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c587c54-c98d-4c19-884e-907d6aaeda77.9313f6aa-62c7-497b-a758-7124be9f09d5 -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3c587c54-c98d-4c19-884e-907d6aaeda77.425325e3-470b-4f40-bc39-6d92b65b9445" returned: 0 in 0.646s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:29:30 devstack cinder-volume[94394]: WARNING cinder.volume.drivers.remotefs [None req-54963f9b-e82f-4336-bfd6-c635c372ab17 tempest-VolumesDeleteCascade-1307048346 None] /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3c587c54-c98d-4c19-884e-907d6aaeda77.425325e3-470b-4f40-bc39-6d92b65b9445 is being set with open permissions: ugo+rw Aug 26 14:29:30 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-54963f9b-e82f-4336-bfd6-c635c372ab17 tempest-VolumesDeleteCascade-1307048346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3c587c54-c98d-4c19-884e-907d6aaeda77.425325e3-470b-4f40-bc39-6d92b65b9445 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:29:30 devstack sudo[105012]: pam_unix(sudo:session): session closed for user root Aug 26 14:29:30 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-ea229d2c-4a59-487c-bea4-7f8b3e2cfced tempest-AttachVolumeNegativeTest-342477261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c4369af1-8cf2-4de7-8b06-17ee4d045395" returned: 0 in 0.516s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:29:30 devstack sudo[105021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3c587c54-c98d-4c19-884e-907d6aaeda77.425325e3-470b-4f40-bc39-6d92b65b9445 Aug 26 14:29:30 devstack sudo[105021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:29:30 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-ea229d2c-4a59-487c-bea4-7f8b3e2cfced tempest-AttachVolumeNegativeTest-342477261 None] Lock "cinder-quobyte-c4369af1-8cf2-4de7-8b06-17ee4d045395" released by "delete_volume" :: held 1.037s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:29:30 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-ea229d2c-4a59-487c-bea4-7f8b3e2cfced tempest-AttachVolumeNegativeTest-342477261 None] Created reservations ['8047f342-8103-4879-a0a1-9644e1152da8', '1abbdcb7-d6ad-4693-83cf-32600b468973', '663f8a8a-8b6f-49c2-9257-38a4ac0960e8', '4395e469-597b-4478-ac86-bbd129ceb8d5'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:29:30 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-ea229d2c-4a59-487c-bea4-7f8b3e2cfced tempest-AttachVolumeNegativeTest-342477261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:29:30 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-ea229d2c-4a59-487c-bea4-7f8b3e2cfced tempest-AttachVolumeNegativeTest-342477261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:29:30 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-ea229d2c-4a59-487c-bea4-7f8b3e2cfced tempest-AttachVolumeNegativeTest-342477261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:29:30 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-ea229d2c-4a59-487c-bea4-7f8b3e2cfced tempest-AttachVolumeNegativeTest-342477261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:29:30 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-ea229d2c-4a59-487c-bea4-7f8b3e2cfced tempest-AttachVolumeNegativeTest-342477261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:29:30 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-ea229d2c-4a59-487c-bea4-7f8b3e2cfced tempest-AttachVolumeNegativeTest-342477261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:29:30 devstack sudo[105023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:29:30 devstack sudo[105023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:29:30 devstack sudo[105021]: pam_unix(sudo:session): session closed for user root Aug 26 14:29:30 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-54963f9b-e82f-4336-bfd6-c635c372ab17 tempest-VolumesDeleteCascade-1307048346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3c587c54-c98d-4c19-884e-907d6aaeda77.425325e3-470b-4f40-bc39-6d92b65b9445" returned: 0 in 0.523s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:29:30 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-54963f9b-e82f-4336-bfd6-c635c372ab17 tempest-VolumesDeleteCascade-1307048346 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.775s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:29:30 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-54963f9b-e82f-4336-bfd6-c635c372ab17 tempest-VolumesDeleteCascade-1307048346 None] Create snapshot completed successfully Aug 26 14:29:30 devstack sudo[105023]: pam_unix(sudo:session): session closed for user root Aug 26 14:29:30 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-ea229d2c-4a59-487c-bea4-7f8b3e2cfced tempest-AttachVolumeNegativeTest-342477261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.395s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:29:30 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-ea229d2c-4a59-487c-bea4-7f8b3e2cfced tempest-AttachVolumeNegativeTest-342477261 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:29:30 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-ea229d2c-4a59-487c-bea4-7f8b3e2cfced tempest-AttachVolumeNegativeTest-342477261 None] Deleted volume successfully. Aug 26 14:29:30 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-ea229d2c-4a59-487c-bea4-7f8b3e2cfced tempest-AttachVolumeNegativeTest-342477261 None] Lock "cinder-c4369af1-8cf2-4de7-8b06-17ee4d045395-delete_volume" released by "delete_volume" :: held 1.890s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:29:31 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-e62d7bef-07e4-46d5-a2e5-471de0344c79 tempest-VolumesDeleteCascade-1307048346 None] Acquiring lock "cinder-3c587c54-c98d-4c19-884e-907d6aaeda77-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:29:31 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-e62d7bef-07e4-46d5-a2e5-471de0344c79 tempest-VolumesDeleteCascade-1307048346 None] Lock "cinder-3c587c54-c98d-4c19-884e-907d6aaeda77-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:29:31 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-e62d7bef-07e4-46d5-a2e5-471de0344c79 tempest-VolumesDeleteCascade-1307048346 None] Performing cascade delete. {{(pid=94394) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Aug 26 14:29:31 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-e62d7bef-07e4-46d5-a2e5-471de0344c79 tempest-VolumesDeleteCascade-1307048346 None] Acquiring lock "cinder-425325e3-470b-4f40-bc39-6d92b65b9445-delete_snapshot" by "delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:29:31 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-e62d7bef-07e4-46d5-a2e5-471de0344c79 tempest-VolumesDeleteCascade-1307048346 None] Lock "cinder-425325e3-470b-4f40-bc39-6d92b65b9445-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:29:31 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-e62d7bef-07e4-46d5-a2e5-471de0344c79 tempest-VolumesDeleteCascade-1307048346 None] Acquiring lock "cinder-quobyte-3c587c54-c98d-4c19-884e-907d6aaeda77" by "delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:29:31 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-e62d7bef-07e4-46d5-a2e5-471de0344c79 tempest-VolumesDeleteCascade-1307048346 None] Lock "cinder-quobyte-3c587c54-c98d-4c19-884e-907d6aaeda77" acquired by "delete_snapshot" :: waited 0.028s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:29:31 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-e62d7bef-07e4-46d5-a2e5-471de0344c79 tempest-VolumesDeleteCascade-1307048346 None] Acquiring lock "cinder-quobyte-425325e3-470b-4f40-bc39-6d92b65b9445" by "_delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:29:31 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-e62d7bef-07e4-46d5-a2e5-471de0344c79 tempest-VolumesDeleteCascade-1307048346 None] Lock "cinder-quobyte-425325e3-470b-4f40-bc39-6d92b65b9445" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:29:31 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-e62d7bef-07e4-46d5-a2e5-471de0344c79 tempest-VolumesDeleteCascade-1307048346 None] Deleting offline snapshot 425325e3-470b-4f40-bc39-6d92b65b9445 of volume 3c587c54-c98d-4c19-884e-907d6aaeda77 {{(pid=94394) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 14:29:31 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-e62d7bef-07e4-46d5-a2e5-471de0344c79 tempest-VolumesDeleteCascade-1307048346 None] snapshot_file for this snap is: volume-3c587c54-c98d-4c19-884e-907d6aaeda77.425325e3-470b-4f40-bc39-6d92b65b9445 {{(pid=94394) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 14:29:31 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[88026e87-0c9c-45ab-8343-7433c5758c87]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:29:31 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e62d7bef-07e4-46d5-a2e5-471de0344c79 tempest-VolumesDeleteCascade-1307048346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3c587c54-c98d-4c19-884e-907d6aaeda77.425325e3-470b-4f40-bc39-6d92b65b9445 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:29:31 devstack sudo[105027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3c587c54-c98d-4c19-884e-907d6aaeda77.425325e3-470b-4f40-bc39-6d92b65b9445 Aug 26 14:29:31 devstack sudo[105027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:29:31 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-03c63838-dea0-4950-bb1f-518e3d721806 tempest-AttachVolumeNegativeTest-342477261 None] Acquiring lock "cinder-74f30e56-9a4b-44b3-8a83-c0c3889e4a19-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:29:31 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-03c63838-dea0-4950-bb1f-518e3d721806 tempest-AttachVolumeNegativeTest-342477261 None] Lock "cinder-74f30e56-9a4b-44b3-8a83-c0c3889e4a19-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:29:31 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-03c63838-dea0-4950-bb1f-518e3d721806 tempest-AttachVolumeNegativeTest-342477261 None] Acquiring lock "cinder-quobyte-74f30e56-9a4b-44b3-8a83-c0c3889e4a19" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:29:31 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-03c63838-dea0-4950-bb1f-518e3d721806 tempest-AttachVolumeNegativeTest-342477261 None] Lock "cinder-quobyte-74f30e56-9a4b-44b3-8a83-c0c3889e4a19" acquired by "delete_volume" :: waited 0.038s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:29:31 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[95d1cee1-0205-4435-ab92-5e5b21304813]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:29:31 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-03c63838-dea0-4950-bb1f-518e3d721806 tempest-AttachVolumeNegativeTest-342477261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-74f30e56-9a4b-44b3-8a83-c0c3889e4a19 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:29:32 devstack sudo[105027]: pam_unix(sudo:session): session closed for user root Aug 26 14:29:32 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e62d7bef-07e4-46d5-a2e5-471de0344c79 tempest-VolumesDeleteCascade-1307048346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3c587c54-c98d-4c19-884e-907d6aaeda77.425325e3-470b-4f40-bc39-6d92b65b9445" returned: 0 in 0.596s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:29:32 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-e62d7bef-07e4-46d5-a2e5-471de0344c79 tempest-VolumesDeleteCascade-1307048346 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3c587c54-c98d-4c19-884e-907d6aaeda77(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94394) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 14:29:32 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d850a68-6617-498a-8635-31e4633e6f70]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:29:32 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e62d7bef-07e4-46d5-a2e5-471de0344c79 tempest-VolumesDeleteCascade-1307048346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3c587c54-c98d-4c19-884e-907d6aaeda77.9313f6aa-62c7-497b-a758-7124be9f09d5 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:29:32 devstack sudo[105033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-74f30e56-9a4b-44b3-8a83-c0c3889e4a19 Aug 26 14:29:32 devstack sudo[105033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:29:32 devstack sudo[105034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3c587c54-c98d-4c19-884e-907d6aaeda77.9313f6aa-62c7-497b-a758-7124be9f09d5 Aug 26 14:29:32 devstack sudo[105034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:29:32 devstack sudo[105033]: pam_unix(sudo:session): session closed for user root Aug 26 14:29:32 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-03c63838-dea0-4950-bb1f-518e3d721806 tempest-AttachVolumeNegativeTest-342477261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-74f30e56-9a4b-44b3-8a83-c0c3889e4a19" returned: 0 in 0.637s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:29:32 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-03c63838-dea0-4950-bb1f-518e3d721806 tempest-AttachVolumeNegativeTest-342477261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-74f30e56-9a4b-44b3-8a83-c0c3889e4a19 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:29:32 devstack sudo[105044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-74f30e56-9a4b-44b3-8a83-c0c3889e4a19 Aug 26 14:29:32 devstack sudo[105044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:29:32 devstack sudo[105034]: pam_unix(sudo:session): session closed for user root Aug 26 14:29:32 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e62d7bef-07e4-46d5-a2e5-471de0344c79 tempest-VolumesDeleteCascade-1307048346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3c587c54-c98d-4c19-884e-907d6aaeda77.9313f6aa-62c7-497b-a758-7124be9f09d5" returned: 0 in 0.642s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:29:32 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-e62d7bef-07e4-46d5-a2e5-471de0344c79 tempest-VolumesDeleteCascade-1307048346 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3c587c54-c98d-4c19-884e-907d6aaeda77(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94394) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 14:29:32 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e62d7bef-07e4-46d5-a2e5-471de0344c79 tempest-VolumesDeleteCascade-1307048346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3c587c54-c98d-4c19-884e-907d6aaeda77.425325e3-470b-4f40-bc39-6d92b65b9445 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:29:32 devstack sudo[105046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3c587c54-c98d-4c19-884e-907d6aaeda77.425325e3-470b-4f40-bc39-6d92b65b9445 Aug 26 14:29:32 devstack sudo[105046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:29:33 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-573333ff-c1de-4530-834f-5f9acf2f952f tempest-VolumesActionsTest-362336132 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:29:33 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-573333ff-c1de-4530-834f-5f9acf2f952f tempest-VolumesActionsTest-362336132 None] Flow 'volume_create_manager' (5f872360-a423-4e14-911b-0a211e406331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:29:33 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-573333ff-c1de-4530-834f-5f9acf2f952f tempest-VolumesActionsTest-362336132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9427e185-f76c-4e72-9b70-39dfe365fbf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:29:33 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-573333ff-c1de-4530-834f-5f9acf2f952f tempest-VolumesActionsTest-362336132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9427e185-f76c-4e72-9b70-39dfe365fbf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:29:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-121530356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f43f348-8bb7-4b19-b175-d92e8fba245a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a85c881a611446280ade138453b54cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:29:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:29:33Z,use_quota=True,user_id='967c19248c35450f92db5434920581b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:29:33 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-573333ff-c1de-4530-834f-5f9acf2f952f tempest-VolumesActionsTest-362336132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a1a25e0-e6ef-479f-ba98-541daed11eaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:29:33 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-573333ff-c1de-4530-834f-5f9acf2f952f tempest-VolumesActionsTest-362336132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a1a25e0-e6ef-479f-ba98-541daed11eaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:29:33 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-573333ff-c1de-4530-834f-5f9acf2f952f tempest-VolumesActionsTest-362336132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44bbd9d2-c796-4e28-84bf-ca2c4e0551e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:29:33 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-573333ff-c1de-4530-834f-5f9acf2f952f tempest-VolumesActionsTest-362336132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44bbd9d2-c796-4e28-84bf-ca2c4e0551e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f43f348-8bb7-4b19-b175-d92e8fba245a', 'volume_name': 'volume-5f43f348-8bb7-4b19-b175-d92e8fba245a', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:29:33 devstack sudo[105044]: pam_unix(sudo:session): session closed for user root Aug 26 14:29:33 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-573333ff-c1de-4530-834f-5f9acf2f952f tempest-VolumesActionsTest-362336132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38be1a5b-adad-402b-9d8c-83b546352d41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:29:33 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-573333ff-c1de-4530-834f-5f9acf2f952f tempest-VolumesActionsTest-362336132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38be1a5b-adad-402b-9d8c-83b546352d41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:29:33 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-573333ff-c1de-4530-834f-5f9acf2f952f tempest-VolumesActionsTest-362336132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2079b917-6e05-4fc1-a03f-a769041caca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:29:33 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-573333ff-c1de-4530-834f-5f9acf2f952f tempest-VolumesActionsTest-362336132 None] Volume 5f43f348-8bb7-4b19-b175-d92e8fba245a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f43f348-8bb7-4b19-b175-d92e8fba245a', 'volume_size': 1} Aug 26 14:29:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-573333ff-c1de-4530-834f-5f9acf2f952f tempest-VolumesActionsTest-362336132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:29:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-573333ff-c1de-4530-834f-5f9acf2f952f tempest-VolumesActionsTest-362336132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:29:33 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-573333ff-c1de-4530-834f-5f9acf2f952f tempest-VolumesActionsTest-362336132 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:29:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-121530356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f43f348-8bb7-4b19-b175-d92e8fba245a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a85c881a611446280ade138453b54cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:29:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:29:33Z,use_quota=True,user_id='967c19248c35450f92db5434920581b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:29:33 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-573333ff-c1de-4530-834f-5f9acf2f952f tempest-VolumesActionsTest-362336132 None] Creating volume 5f43f348-8bb7-4b19-b175-d92e8fba245a {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:29:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-573333ff-c1de-4530-834f-5f9acf2f952f tempest-VolumesActionsTest-362336132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:29:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-573333ff-c1de-4530-834f-5f9acf2f952f tempest-VolumesActionsTest-362336132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:29:33 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-573333ff-c1de-4530-834f-5f9acf2f952f tempest-VolumesActionsTest-362336132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:29:33 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-573333ff-c1de-4530-834f-5f9acf2f952f tempest-VolumesActionsTest-362336132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:29:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-573333ff-c1de-4530-834f-5f9acf2f952f tempest-VolumesActionsTest-362336132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:29:33 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-573333ff-c1de-4530-834f-5f9acf2f952f tempest-VolumesActionsTest-362336132 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:29:33 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-573333ff-c1de-4530-834f-5f9acf2f952f tempest-VolumesActionsTest-362336132 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:29:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-573333ff-c1de-4530-834f-5f9acf2f952f tempest-VolumesActionsTest-362336132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5f43f348-8bb7-4b19-b175-d92e8fba245a 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:29:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-03c63838-dea0-4950-bb1f-518e3d721806 tempest-AttachVolumeNegativeTest-342477261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-74f30e56-9a4b-44b3-8a83-c0c3889e4a19" returned: 0 in 0.608s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:29:33 devstack sudo[105053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5f43f348-8bb7-4b19-b175-d92e8fba245a 1073741824 Aug 26 14:29:33 devstack sudo[105053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:29:33 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-03c63838-dea0-4950-bb1f-518e3d721806 tempest-AttachVolumeNegativeTest-342477261 None] Lock "cinder-quobyte-74f30e56-9a4b-44b3-8a83-c0c3889e4a19" released by "delete_volume" :: held 1.323s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:29:33 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-03c63838-dea0-4950-bb1f-518e3d721806 tempest-AttachVolumeNegativeTest-342477261 None] Created reservations ['ed7e4767-2f74-4973-b101-6f9b584f6de9', '3b918688-d60f-44ea-8165-ad989782f6f8', '8aeeffec-b6a4-4687-a1af-a4535d41949b', 'af0b090b-fd03-4278-b748-51bcb3e20690'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:29:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-03c63838-dea0-4950-bb1f-518e3d721806 tempest-AttachVolumeNegativeTest-342477261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:29:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-03c63838-dea0-4950-bb1f-518e3d721806 tempest-AttachVolumeNegativeTest-342477261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:29:33 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-03c63838-dea0-4950-bb1f-518e3d721806 tempest-AttachVolumeNegativeTest-342477261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:29:33 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-03c63838-dea0-4950-bb1f-518e3d721806 tempest-AttachVolumeNegativeTest-342477261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:29:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-03c63838-dea0-4950-bb1f-518e3d721806 tempest-AttachVolumeNegativeTest-342477261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:29:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-03c63838-dea0-4950-bb1f-518e3d721806 tempest-AttachVolumeNegativeTest-342477261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:29:33 devstack sudo[105046]: pam_unix(sudo:session): session closed for user root Aug 26 14:29:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e62d7bef-07e4-46d5-a2e5-471de0344c79 tempest-VolumesDeleteCascade-1307048346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3c587c54-c98d-4c19-884e-907d6aaeda77.425325e3-470b-4f40-bc39-6d92b65b9445" returned: 0 in 0.698s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:29:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e62d7bef-07e4-46d5-a2e5-471de0344c79 tempest-VolumesDeleteCascade-1307048346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3c587c54-c98d-4c19-884e-907d6aaeda77.425325e3-470b-4f40-bc39-6d92b65b9445 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:29:33 devstack sudo[105056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3c587c54-c98d-4c19-884e-907d6aaeda77.425325e3-470b-4f40-bc39-6d92b65b9445 Aug 26 14:29:33 devstack sudo[105056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:29:33 devstack sudo[105055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:29:33 devstack sudo[105055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:29:33 devstack cinder-volume[94394]: DEBUG oslo_service.periodic_task [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94394) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 14:29:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:29:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:29:33 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:29:33 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:29:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:29:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:29:33 devstack sudo[105061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:29:33 devstack sudo[105061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:29:33 devstack sudo[105056]: pam_unix(sudo:session): session closed for user root Aug 26 14:29:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e62d7bef-07e4-46d5-a2e5-471de0344c79 tempest-VolumesDeleteCascade-1307048346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3c587c54-c98d-4c19-884e-907d6aaeda77.425325e3-470b-4f40-bc39-6d92b65b9445" returned: 0 in 0.394s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:29:33 devstack sudo[105055]: pam_unix(sudo:session): session closed for user root Aug 26 14:29:33 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-e62d7bef-07e4-46d5-a2e5-471de0344c79 tempest-VolumesDeleteCascade-1307048346 None] Lock "cinder-quobyte-425325e3-470b-4f40-bc39-6d92b65b9445" released by "_delete_snapshot" :: held 2.532s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:29:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-03c63838-dea0-4950-bb1f-518e3d721806 tempest-AttachVolumeNegativeTest-342477261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.487s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:29:33 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-03c63838-dea0-4950-bb1f-518e3d721806 tempest-AttachVolumeNegativeTest-342477261 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:29:33 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-e62d7bef-07e4-46d5-a2e5-471de0344c79 tempest-VolumesDeleteCascade-1307048346 None] Lock "cinder-quobyte-3c587c54-c98d-4c19-884e-907d6aaeda77" released by "delete_snapshot" :: held 2.574s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:29:33 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-03c63838-dea0-4950-bb1f-518e3d721806 tempest-AttachVolumeNegativeTest-342477261 None] Deleted volume successfully. Aug 26 14:29:34 devstack sudo[105053]: pam_unix(sudo:session): session closed for user root Aug 26 14:29:34 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-573333ff-c1de-4530-834f-5f9acf2f952f tempest-VolumesActionsTest-362336132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5f43f348-8bb7-4b19-b175-d92e8fba245a 1073741824" returned: 0 in 0.820s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:29:34 devstack sudo[105061]: pam_unix(sudo:session): session closed for user root Aug 26 14:29:34 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d9d1c3a-dc75-48e4-9447-a645b8ba07b2 tempest-VolumesTestJSON-788898559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:29:34 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-8d9d1c3a-dc75-48e4-9447-a645b8ba07b2 tempest-VolumesTestJSON-788898559 None] Flow 'volume_create_manager' (c598b339-bfcd-4a35-9c92-1b5119b59d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:29:34 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-8d9d1c3a-dc75-48e4-9447-a645b8ba07b2 tempest-VolumesTestJSON-788898559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cccb085-5e38-49ee-a8ce-8a8a38436e2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:29:34 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.565s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:29:34 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:29:34 devstack cinder-volume[94394]: DEBUG oslo_service.periodic_task [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Running periodic task VolumeManager._thread_info {{(pid=94394) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 14:29:34 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] thread count: 28 {{(pid=94394) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 14:29:34 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] thread info: [<_MainThread(MainThread, started 126600738033792)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94394) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 14:29:34 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-8d9d1c3a-dc75-48e4-9447-a645b8ba07b2 tempest-VolumesTestJSON-788898559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cccb085-5e38-49ee-a8ce-8a8a38436e2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:29:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-681721911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9cbc22c-8c32-4c91-ac0a-9b8ac0010f0c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9b2d3b1bf913443fa136d1b33f8b3ea8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:29:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:29:34Z,use_quota=True,user_id='1575871eb51546f79cfae7ea87e2c635',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:29:34 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-8d9d1c3a-dc75-48e4-9447-a645b8ba07b2 tempest-VolumesTestJSON-788898559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (797470ab-9056-4ea5-ba48-62cb7a77682c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:29:34 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-8d9d1c3a-dc75-48e4-9447-a645b8ba07b2 tempest-VolumesTestJSON-788898559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (797470ab-9056-4ea5-ba48-62cb7a77682c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:29:34 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-8d9d1c3a-dc75-48e4-9447-a645b8ba07b2 tempest-VolumesTestJSON-788898559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fb50dc6-53ad-49ca-a57e-cb18ecda96a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:29:34 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-8d9d1c3a-dc75-48e4-9447-a645b8ba07b2 tempest-VolumesTestJSON-788898559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fb50dc6-53ad-49ca-a57e-cb18ecda96a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9cbc22c-8c32-4c91-ac0a-9b8ac0010f0c', 'volume_name': 'volume-a9cbc22c-8c32-4c91-ac0a-9b8ac0010f0c', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:29:34 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-8d9d1c3a-dc75-48e4-9447-a645b8ba07b2 tempest-VolumesTestJSON-788898559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (241ae459-d8f2-4980-af82-f090695572f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:29:34 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-8d9d1c3a-dc75-48e4-9447-a645b8ba07b2 tempest-VolumesTestJSON-788898559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (241ae459-d8f2-4980-af82-f090695572f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:29:34 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-8d9d1c3a-dc75-48e4-9447-a645b8ba07b2 tempest-VolumesTestJSON-788898559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08bd3a39-776a-447a-a2b5-75bd9288b4fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:29:34 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-8d9d1c3a-dc75-48e4-9447-a645b8ba07b2 tempest-VolumesTestJSON-788898559 None] Volume a9cbc22c-8c32-4c91-ac0a-9b8ac0010f0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9cbc22c-8c32-4c91-ac0a-9b8ac0010f0c', 'volume_size': 1} Aug 26 14:29:34 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-8d9d1c3a-dc75-48e4-9447-a645b8ba07b2 tempest-VolumesTestJSON-788898559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:29:34 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-03c63838-dea0-4950-bb1f-518e3d721806 tempest-AttachVolumeNegativeTest-342477261 None] Lock "cinder-74f30e56-9a4b-44b3-8a83-c0c3889e4a19-delete_volume" released by "delete_volume" :: held 2.425s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:29:34 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-573333ff-c1de-4530-834f-5f9acf2f952f tempest-VolumesActionsTest-362336132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5f43f348-8bb7-4b19-b175-d92e8fba245a {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:29:34 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-e62d7bef-07e4-46d5-a2e5-471de0344c79 tempest-VolumesDeleteCascade-1307048346 None] Created reservations ['9a2b35a5-7615-4996-ac1f-060c03e76252', 'f44f2153-c347-42e7-b29c-d2d59bd538cf', 'bbd6e1f7-c8cc-4ba9-b7c0-7e04db999ce4', '099bf40f-61d8-4eec-8cc6-6139f5a0529e'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:29:34 devstack sudo[105069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5f43f348-8bb7-4b19-b175-d92e8fba245a Aug 26 14:29:34 devstack sudo[105069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:29:34 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-e62d7bef-07e4-46d5-a2e5-471de0344c79 tempest-VolumesDeleteCascade-1307048346 None] Delete snapshot completed successfully. Aug 26 14:29:34 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-e62d7bef-07e4-46d5-a2e5-471de0344c79 tempest-VolumesDeleteCascade-1307048346 None] Lock "cinder-425325e3-470b-4f40-bc39-6d92b65b9445-delete_snapshot" released by "delete_snapshot" :: held 3.084s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:29:34 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-e62d7bef-07e4-46d5-a2e5-471de0344c79 tempest-VolumesDeleteCascade-1307048346 None] Acquiring lock "cinder-9313f6aa-62c7-497b-a758-7124be9f09d5-delete_snapshot" by "delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:29:34 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-e62d7bef-07e4-46d5-a2e5-471de0344c79 tempest-VolumesDeleteCascade-1307048346 None] Lock "cinder-9313f6aa-62c7-497b-a758-7124be9f09d5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:29:34 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-e62d7bef-07e4-46d5-a2e5-471de0344c79 tempest-VolumesDeleteCascade-1307048346 None] Acquiring lock "cinder-quobyte-3c587c54-c98d-4c19-884e-907d6aaeda77" by "delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:29:34 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-e62d7bef-07e4-46d5-a2e5-471de0344c79 tempest-VolumesDeleteCascade-1307048346 None] Lock "cinder-quobyte-3c587c54-c98d-4c19-884e-907d6aaeda77" acquired by "delete_snapshot" :: waited 0.018s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:29:34 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-e62d7bef-07e4-46d5-a2e5-471de0344c79 tempest-VolumesDeleteCascade-1307048346 None] Acquiring lock "cinder-quobyte-9313f6aa-62c7-497b-a758-7124be9f09d5" by "_delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:29:34 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-e62d7bef-07e4-46d5-a2e5-471de0344c79 tempest-VolumesDeleteCascade-1307048346 None] Lock "cinder-quobyte-9313f6aa-62c7-497b-a758-7124be9f09d5" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:29:34 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-e62d7bef-07e4-46d5-a2e5-471de0344c79 tempest-VolumesDeleteCascade-1307048346 None] Deleting offline snapshot 9313f6aa-62c7-497b-a758-7124be9f09d5 of volume 3c587c54-c98d-4c19-884e-907d6aaeda77 {{(pid=94394) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 14:29:34 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-e62d7bef-07e4-46d5-a2e5-471de0344c79 tempest-VolumesDeleteCascade-1307048346 None] snapshot_file for this snap is: volume-3c587c54-c98d-4c19-884e-907d6aaeda77.9313f6aa-62c7-497b-a758-7124be9f09d5 {{(pid=94394) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 14:29:34 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[917ae743-2e25-4ae3-b6e4-b9e9b57ba96f]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:29:34 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e62d7bef-07e4-46d5-a2e5-471de0344c79 tempest-VolumesDeleteCascade-1307048346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3c587c54-c98d-4c19-884e-907d6aaeda77.9313f6aa-62c7-497b-a758-7124be9f09d5 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:29:34 devstack sudo[105071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3c587c54-c98d-4c19-884e-907d6aaeda77.9313f6aa-62c7-497b-a758-7124be9f09d5 Aug 26 14:29:34 devstack sudo[105071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:29:34 devstack sudo[105069]: pam_unix(sudo:session): session closed for user root Aug 26 14:29:34 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-573333ff-c1de-4530-834f-5f9acf2f952f tempest-VolumesActionsTest-362336132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5f43f348-8bb7-4b19-b175-d92e8fba245a" returned: 0 in 0.379s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:29:34 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-573333ff-c1de-4530-834f-5f9acf2f952f tempest-VolumesActionsTest-362336132 None] <== create_volume: return (1444ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:29:34 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-573333ff-c1de-4530-834f-5f9acf2f952f tempest-VolumesActionsTest-362336132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.448s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:29:34 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-8d9d1c3a-dc75-48e4-9447-a645b8ba07b2 tempest-VolumesTestJSON-788898559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.437s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:29:34 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-8d9d1c3a-dc75-48e4-9447-a645b8ba07b2 tempest-VolumesTestJSON-788898559 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:29:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-681721911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9cbc22c-8c32-4c91-ac0a-9b8ac0010f0c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9b2d3b1bf913443fa136d1b33f8b3ea8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:29:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:29:34Z,use_quota=True,user_id='1575871eb51546f79cfae7ea87e2c635',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:29:34 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-8d9d1c3a-dc75-48e4-9447-a645b8ba07b2 tempest-VolumesTestJSON-788898559 None] Creating volume a9cbc22c-8c32-4c91-ac0a-9b8ac0010f0c {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:29:34 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-8d9d1c3a-dc75-48e4-9447-a645b8ba07b2 tempest-VolumesTestJSON-788898559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:29:34 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-8d9d1c3a-dc75-48e4-9447-a645b8ba07b2 tempest-VolumesTestJSON-788898559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:29:34 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-8d9d1c3a-dc75-48e4-9447-a645b8ba07b2 tempest-VolumesTestJSON-788898559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:29:34 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-8d9d1c3a-dc75-48e4-9447-a645b8ba07b2 tempest-VolumesTestJSON-788898559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:29:34 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-8d9d1c3a-dc75-48e4-9447-a645b8ba07b2 tempest-VolumesTestJSON-788898559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:29:34 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-8d9d1c3a-dc75-48e4-9447-a645b8ba07b2 tempest-VolumesTestJSON-788898559 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:29:34 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-8d9d1c3a-dc75-48e4-9447-a645b8ba07b2 tempest-VolumesTestJSON-788898559 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:29:34 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-8d9d1c3a-dc75-48e4-9447-a645b8ba07b2 tempest-VolumesTestJSON-788898559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-a9cbc22c-8c32-4c91-ac0a-9b8ac0010f0c 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:29:34 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-573333ff-c1de-4530-834f-5f9acf2f952f tempest-VolumesActionsTest-362336132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2079b917-6e05-4fc1-a03f-a769041caca5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f43f348-8bb7-4b19-b175-d92e8fba245a', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:29:34 devstack sudo[105074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-a9cbc22c-8c32-4c91-ac0a-9b8ac0010f0c 1073741824 Aug 26 14:29:34 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-573333ff-c1de-4530-834f-5f9acf2f952f tempest-VolumesActionsTest-362336132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (430c84fe-3a77-4f7a-9d96-6d2430dd5f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:29:34 devstack sudo[105074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:29:34 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-573333ff-c1de-4530-834f-5f9acf2f952f tempest-VolumesActionsTest-362336132 None] Volume volume-5f43f348-8bb7-4b19-b175-d92e8fba245a (5f43f348-8bb7-4b19-b175-d92e8fba245a): created successfully Aug 26 14:29:34 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-573333ff-c1de-4530-834f-5f9acf2f952f tempest-VolumesActionsTest-362336132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (430c84fe-3a77-4f7a-9d96-6d2430dd5f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:29:34 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-573333ff-c1de-4530-834f-5f9acf2f952f tempest-VolumesActionsTest-362336132 None] Flow 'volume_create_manager' (5f872360-a423-4e14-911b-0a211e406331) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:29:34 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-573333ff-c1de-4530-834f-5f9acf2f952f tempest-VolumesActionsTest-362336132 None] Created volume successfully. Aug 26 14:29:34 devstack sudo[105071]: pam_unix(sudo:session): session closed for user root Aug 26 14:29:34 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e62d7bef-07e4-46d5-a2e5-471de0344c79 tempest-VolumesDeleteCascade-1307048346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3c587c54-c98d-4c19-884e-907d6aaeda77.9313f6aa-62c7-497b-a758-7124be9f09d5" returned: 0 in 0.494s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:29:34 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-e62d7bef-07e4-46d5-a2e5-471de0344c79 tempest-VolumesDeleteCascade-1307048346 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3c587c54-c98d-4c19-884e-907d6aaeda77(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94394) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 14:29:35 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[8214946b-a397-4b37-8f5f-9cfacb1c3992]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:29:35 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e62d7bef-07e4-46d5-a2e5-471de0344c79 tempest-VolumesDeleteCascade-1307048346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3c587c54-c98d-4c19-884e-907d6aaeda77 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:29:35 devstack sudo[105080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3c587c54-c98d-4c19-884e-907d6aaeda77 Aug 26 14:29:35 devstack sudo[105080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:29:35 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-ea3fb5a3-11fe-4890-a448-809283316846 tempest-VolumesActionsTest-362336132 None] Acquiring lock "cinder-5f43f348-8bb7-4b19-b175-d92e8fba245a" by "attach_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:29:35 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-ea3fb5a3-11fe-4890-a448-809283316846 tempest-VolumesActionsTest-362336132 None] Lock "cinder-5f43f348-8bb7-4b19-b175-d92e8fba245a" acquired by "attach_volume" :: waited 0.023s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:29:35 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-ea3fb5a3-11fe-4890-a448-809283316846 tempest-VolumesActionsTest-362336132 None] Attaching volume 5f43f348-8bb7-4b19-b175-d92e8fba245a to instance c48e882d-4254-46fd-a787-afaa184c1a6f at mountpoint /dev/vdb on host None. Aug 26 14:29:35 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-ea3fb5a3-11fe-4890-a448-809283316846 tempest-VolumesActionsTest-362336132 None] Attach volume completed successfully. Aug 26 14:29:35 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-ea3fb5a3-11fe-4890-a448-809283316846 tempest-VolumesActionsTest-362336132 None] Lock "cinder-5f43f348-8bb7-4b19-b175-d92e8fba245a" released by "attach_volume" :: held 0.143s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:29:35 devstack sudo[105074]: pam_unix(sudo:session): session closed for user root Aug 26 14:29:35 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-8d9d1c3a-dc75-48e4-9447-a645b8ba07b2 tempest-VolumesTestJSON-788898559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-a9cbc22c-8c32-4c91-ac0a-9b8ac0010f0c 1073741824" returned: 0 in 0.830s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:29:35 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-8d9d1c3a-dc75-48e4-9447-a645b8ba07b2 tempest-VolumesTestJSON-788898559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-a9cbc22c-8c32-4c91-ac0a-9b8ac0010f0c {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:29:35 devstack sudo[105088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-a9cbc22c-8c32-4c91-ac0a-9b8ac0010f0c Aug 26 14:29:35 devstack sudo[105088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:29:35 devstack sudo[105080]: pam_unix(sudo:session): session closed for user root Aug 26 14:29:35 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e62d7bef-07e4-46d5-a2e5-471de0344c79 tempest-VolumesDeleteCascade-1307048346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3c587c54-c98d-4c19-884e-907d6aaeda77" returned: 0 in 0.657s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:29:35 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e62d7bef-07e4-46d5-a2e5-471de0344c79 tempest-VolumesDeleteCascade-1307048346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3c587c54-c98d-4c19-884e-907d6aaeda77.9313f6aa-62c7-497b-a758-7124be9f09d5 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:29:35 devstack sudo[105090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3c587c54-c98d-4c19-884e-907d6aaeda77.9313f6aa-62c7-497b-a758-7124be9f09d5 Aug 26 14:29:35 devstack sudo[105090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:29:36 devstack sudo[105088]: pam_unix(sudo:session): session closed for user root Aug 26 14:29:36 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-8d9d1c3a-dc75-48e4-9447-a645b8ba07b2 tempest-VolumesTestJSON-788898559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-a9cbc22c-8c32-4c91-ac0a-9b8ac0010f0c" returned: 0 in 0.516s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:29:36 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-8d9d1c3a-dc75-48e4-9447-a645b8ba07b2 tempest-VolumesTestJSON-788898559 None] <== create_volume: return (1431ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:29:36 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-8d9d1c3a-dc75-48e4-9447-a645b8ba07b2 tempest-VolumesTestJSON-788898559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.436s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:29:36 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-8d9d1c3a-dc75-48e4-9447-a645b8ba07b2 tempest-VolumesTestJSON-788898559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08bd3a39-776a-447a-a2b5-75bd9288b4fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9cbc22c-8c32-4c91-ac0a-9b8ac0010f0c', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:29:36 devstack sudo[105090]: pam_unix(sudo:session): session closed for user root Aug 26 14:29:36 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-8d9d1c3a-dc75-48e4-9447-a645b8ba07b2 tempest-VolumesTestJSON-788898559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e46c42c7-2399-4e3c-baff-8045c07d8dcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:29:36 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e62d7bef-07e4-46d5-a2e5-471de0344c79 tempest-VolumesDeleteCascade-1307048346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3c587c54-c98d-4c19-884e-907d6aaeda77.9313f6aa-62c7-497b-a758-7124be9f09d5" returned: 0 in 0.479s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:29:36 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e62d7bef-07e4-46d5-a2e5-471de0344c79 tempest-VolumesDeleteCascade-1307048346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3c587c54-c98d-4c19-884e-907d6aaeda77.9313f6aa-62c7-497b-a758-7124be9f09d5 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:29:36 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-8d9d1c3a-dc75-48e4-9447-a645b8ba07b2 tempest-VolumesTestJSON-788898559 None] Volume volume-a9cbc22c-8c32-4c91-ac0a-9b8ac0010f0c (a9cbc22c-8c32-4c91-ac0a-9b8ac0010f0c): created successfully Aug 26 14:29:36 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-8d9d1c3a-dc75-48e4-9447-a645b8ba07b2 tempest-VolumesTestJSON-788898559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e46c42c7-2399-4e3c-baff-8045c07d8dcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:29:36 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-8d9d1c3a-dc75-48e4-9447-a645b8ba07b2 tempest-VolumesTestJSON-788898559 None] Flow 'volume_create_manager' (c598b339-bfcd-4a35-9c92-1b5119b59d16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:29:36 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-8d9d1c3a-dc75-48e4-9447-a645b8ba07b2 tempest-VolumesTestJSON-788898559 None] Created volume successfully. Aug 26 14:29:36 devstack sudo[105097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3c587c54-c98d-4c19-884e-907d6aaeda77.9313f6aa-62c7-497b-a758-7124be9f09d5 Aug 26 14:29:36 devstack sudo[105097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:29:36 devstack sudo[105097]: pam_unix(sudo:session): session closed for user root Aug 26 14:29:36 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e62d7bef-07e4-46d5-a2e5-471de0344c79 tempest-VolumesDeleteCascade-1307048346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3c587c54-c98d-4c19-884e-907d6aaeda77.9313f6aa-62c7-497b-a758-7124be9f09d5" returned: 0 in 0.631s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:29:36 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-e62d7bef-07e4-46d5-a2e5-471de0344c79 tempest-VolumesDeleteCascade-1307048346 None] Lock "cinder-quobyte-9313f6aa-62c7-497b-a758-7124be9f09d5" released by "_delete_snapshot" :: held 2.384s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:29:36 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-e62d7bef-07e4-46d5-a2e5-471de0344c79 tempest-VolumesDeleteCascade-1307048346 None] Lock "cinder-quobyte-3c587c54-c98d-4c19-884e-907d6aaeda77" released by "delete_snapshot" :: held 2.423s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:29:37 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-e62d7bef-07e4-46d5-a2e5-471de0344c79 tempest-VolumesDeleteCascade-1307048346 None] Created reservations ['24749121-571f-45d8-bfcb-9c31e2437eb6', 'b184dcd9-69d3-4871-8b55-26dcb8e31360', '7880e530-3f4e-4394-87a7-5fb9700d7a2f', '6ea471ed-2e7f-4e9d-b356-b232ceac6a35'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:29:37 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-e62d7bef-07e4-46d5-a2e5-471de0344c79 tempest-VolumesDeleteCascade-1307048346 None] Delete snapshot completed successfully. Aug 26 14:29:37 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-e62d7bef-07e4-46d5-a2e5-471de0344c79 tempest-VolumesDeleteCascade-1307048346 None] Lock "cinder-9313f6aa-62c7-497b-a758-7124be9f09d5-delete_snapshot" released by "delete_snapshot" :: held 2.698s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:29:37 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-e62d7bef-07e4-46d5-a2e5-471de0344c79 tempest-VolumesDeleteCascade-1307048346 None] Snapshots deleted, issuing volume delete {{(pid=94394) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Aug 26 14:29:37 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-e62d7bef-07e4-46d5-a2e5-471de0344c79 tempest-VolumesDeleteCascade-1307048346 None] Acquiring lock "cinder-quobyte-3c587c54-c98d-4c19-884e-907d6aaeda77" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:29:37 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-e62d7bef-07e4-46d5-a2e5-471de0344c79 tempest-VolumesDeleteCascade-1307048346 None] Lock "cinder-quobyte-3c587c54-c98d-4c19-884e-907d6aaeda77" acquired by "delete_volume" :: waited 0.034s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:29:37 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[0239c0ac-8b88-42b8-afee-97f1898a1e24]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:29:37 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e62d7bef-07e4-46d5-a2e5-471de0344c79 tempest-VolumesDeleteCascade-1307048346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3c587c54-c98d-4c19-884e-907d6aaeda77 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:29:37 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-4889d567-c9f9-41c3-b610-2b51cb7e4681 tempest-VolumesActionsTest-508015839 None] Terminate volume connection completed successfully. Aug 26 14:29:37 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-4889d567-c9f9-41c3-b610-2b51cb7e4681 tempest-VolumesActionsTest-508015839 None] Acquiring lock "cinder-5f43f348-8bb7-4b19-b175-d92e8fba245a-detach_volume" by "detach_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:29:37 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-4889d567-c9f9-41c3-b610-2b51cb7e4681 tempest-VolumesActionsTest-508015839 None] Lock "cinder-5f43f348-8bb7-4b19-b175-d92e8fba245a-detach_volume" acquired by "detach_volume" :: waited 0.062s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:29:37 devstack sudo[105110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3c587c54-c98d-4c19-884e-907d6aaeda77 Aug 26 14:29:37 devstack sudo[105110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:29:37 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-4889d567-c9f9-41c3-b610-2b51cb7e4681 tempest-VolumesActionsTest-508015839 None] Detaching volume 5f43f348-8bb7-4b19-b175-d92e8fba245a from instance c48e882d-4254-46fd-a787-afaa184c1a6f. Aug 26 14:29:37 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-4889d567-c9f9-41c3-b610-2b51cb7e4681 tempest-VolumesActionsTest-508015839 None] Detach volume completed successfully. Aug 26 14:29:37 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-4889d567-c9f9-41c3-b610-2b51cb7e4681 tempest-VolumesActionsTest-508015839 None] Lock "cinder-5f43f348-8bb7-4b19-b175-d92e8fba245a-detach_volume" released by "detach_volume" :: held 0.123s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:29:37 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-cef0b11f-c9aa-4511-98dd-de86b914d632 tempest-VolumesActionsTest-362336132 None] Acquiring lock "cinder-5f43f348-8bb7-4b19-b175-d92e8fba245a-detach_volume" by "detach_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:29:38 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-cef0b11f-c9aa-4511-98dd-de86b914d632 tempest-VolumesActionsTest-362336132 None] Lock "cinder-5f43f348-8bb7-4b19-b175-d92e8fba245a-detach_volume" acquired by "detach_volume" :: waited 0.029s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:29:38 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-cef0b11f-c9aa-4511-98dd-de86b914d632 tempest-VolumesActionsTest-362336132 None] Volume detach called, but volume not attached. Aug 26 14:29:38 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-cef0b11f-c9aa-4511-98dd-de86b914d632 tempest-VolumesActionsTest-362336132 None] Lock "cinder-5f43f348-8bb7-4b19-b175-d92e8fba245a-detach_volume" released by "detach_volume" :: held 0.031s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:29:38 devstack sudo[105110]: pam_unix(sudo:session): session closed for user root Aug 26 14:29:38 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e62d7bef-07e4-46d5-a2e5-471de0344c79 tempest-VolumesDeleteCascade-1307048346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3c587c54-c98d-4c19-884e-907d6aaeda77" returned: 0 in 0.863s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:29:38 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e62d7bef-07e4-46d5-a2e5-471de0344c79 tempest-VolumesDeleteCascade-1307048346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3c587c54-c98d-4c19-884e-907d6aaeda77 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:29:38 devstack sudo[105115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3c587c54-c98d-4c19-884e-907d6aaeda77 Aug 26 14:29:38 devstack sudo[105115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:29:38 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-9bc6ef94-a1c8-4454-aae5-1ff4bb8cd9fa tempest-VolumesTestJSON-788898559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:29:38 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-9bc6ef94-a1c8-4454-aae5-1ff4bb8cd9fa tempest-VolumesTestJSON-788898559 None] Flow 'volume_create_manager' (7a6a204f-7cfa-4946-a2af-b61b4a2d5c2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:29:38 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-9bc6ef94-a1c8-4454-aae5-1ff4bb8cd9fa tempest-VolumesTestJSON-788898559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49aed939-22fa-43ad-97ba-7a460014c116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:29:38 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-66d4092b-fd43-481e-ab66-9b042ec14e97 tempest-VolumesActionsTest-362336132 None] Acquiring lock "cinder-5f43f348-8bb7-4b19-b175-d92e8fba245a-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:29:38 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-9bc6ef94-a1c8-4454-aae5-1ff4bb8cd9fa tempest-VolumesTestJSON-788898559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49aed939-22fa-43ad-97ba-7a460014c116) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:29:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-285062103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edecf8a0-c0ca-4adc-9ee3-e1fc78c10f4b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9b2d3b1bf913443fa136d1b33f8b3ea8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:29:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:29:38Z,use_quota=True,user_id='1575871eb51546f79cfae7ea87e2c635',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:29:38 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-9bc6ef94-a1c8-4454-aae5-1ff4bb8cd9fa tempest-VolumesTestJSON-788898559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fda59639-e8f0-4d56-bac0-0f42ebaee9e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:29:38 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-9bc6ef94-a1c8-4454-aae5-1ff4bb8cd9fa tempest-VolumesTestJSON-788898559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fda59639-e8f0-4d56-bac0-0f42ebaee9e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:29:38 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-9bc6ef94-a1c8-4454-aae5-1ff4bb8cd9fa tempest-VolumesTestJSON-788898559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78a1bc7e-fe11-47ee-8da5-cda4aa072668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:29:38 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-9bc6ef94-a1c8-4454-aae5-1ff4bb8cd9fa tempest-VolumesTestJSON-788898559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78a1bc7e-fe11-47ee-8da5-cda4aa072668) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'edecf8a0-c0ca-4adc-9ee3-e1fc78c10f4b', 'volume_name': 'volume-edecf8a0-c0ca-4adc-9ee3-e1fc78c10f4b', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:29:38 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-9bc6ef94-a1c8-4454-aae5-1ff4bb8cd9fa tempest-VolumesTestJSON-788898559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edebec68-6980-427f-b86f-9f44322eeaf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:29:38 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-9bc6ef94-a1c8-4454-aae5-1ff4bb8cd9fa tempest-VolumesTestJSON-788898559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edebec68-6980-427f-b86f-9f44322eeaf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:29:38 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-9bc6ef94-a1c8-4454-aae5-1ff4bb8cd9fa tempest-VolumesTestJSON-788898559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddfabd83-d5ad-4548-a987-f6cd0cdee09f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:29:38 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-9bc6ef94-a1c8-4454-aae5-1ff4bb8cd9fa tempest-VolumesTestJSON-788898559 None] Volume edecf8a0-c0ca-4adc-9ee3-e1fc78c10f4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-edecf8a0-c0ca-4adc-9ee3-e1fc78c10f4b', 'volume_size': 1} Aug 26 14:29:38 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-9bc6ef94-a1c8-4454-aae5-1ff4bb8cd9fa tempest-VolumesTestJSON-788898559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:29:38 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-9bc6ef94-a1c8-4454-aae5-1ff4bb8cd9fa tempest-VolumesTestJSON-788898559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:29:38 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-9bc6ef94-a1c8-4454-aae5-1ff4bb8cd9fa tempest-VolumesTestJSON-788898559 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:29:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-285062103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edecf8a0-c0ca-4adc-9ee3-e1fc78c10f4b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9b2d3b1bf913443fa136d1b33f8b3ea8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:29:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:29:38Z,use_quota=True,user_id='1575871eb51546f79cfae7ea87e2c635',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:29:38 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-9bc6ef94-a1c8-4454-aae5-1ff4bb8cd9fa tempest-VolumesTestJSON-788898559 None] Creating volume edecf8a0-c0ca-4adc-9ee3-e1fc78c10f4b {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:29:38 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-9bc6ef94-a1c8-4454-aae5-1ff4bb8cd9fa tempest-VolumesTestJSON-788898559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:29:38 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-9bc6ef94-a1c8-4454-aae5-1ff4bb8cd9fa tempest-VolumesTestJSON-788898559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:29:38 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-9bc6ef94-a1c8-4454-aae5-1ff4bb8cd9fa tempest-VolumesTestJSON-788898559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:29:38 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-9bc6ef94-a1c8-4454-aae5-1ff4bb8cd9fa tempest-VolumesTestJSON-788898559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:29:38 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-9bc6ef94-a1c8-4454-aae5-1ff4bb8cd9fa tempest-VolumesTestJSON-788898559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:29:38 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-9bc6ef94-a1c8-4454-aae5-1ff4bb8cd9fa tempest-VolumesTestJSON-788898559 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:29:38 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-9bc6ef94-a1c8-4454-aae5-1ff4bb8cd9fa tempest-VolumesTestJSON-788898559 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:29:38 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-9bc6ef94-a1c8-4454-aae5-1ff4bb8cd9fa tempest-VolumesTestJSON-788898559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-edecf8a0-c0ca-4adc-9ee3-e1fc78c10f4b 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:29:38 devstack sudo[105115]: pam_unix(sudo:session): session closed for user root Aug 26 14:29:38 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e62d7bef-07e4-46d5-a2e5-471de0344c79 tempest-VolumesDeleteCascade-1307048346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3c587c54-c98d-4c19-884e-907d6aaeda77" returned: 0 in 0.402s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:29:38 devstack sudo[105118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-edecf8a0-c0ca-4adc-9ee3-e1fc78c10f4b 1073741824 Aug 26 14:29:38 devstack sudo[105118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:29:38 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-66d4092b-fd43-481e-ab66-9b042ec14e97 tempest-VolumesActionsTest-362336132 None] Lock "cinder-5f43f348-8bb7-4b19-b175-d92e8fba245a-delete_volume" acquired by "delete_volume" :: waited 0.133s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:29:38 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-e62d7bef-07e4-46d5-a2e5-471de0344c79 tempest-VolumesDeleteCascade-1307048346 None] Lock "cinder-quobyte-3c587c54-c98d-4c19-884e-907d6aaeda77" released by "delete_volume" :: held 1.360s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:29:38 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-66d4092b-fd43-481e-ab66-9b042ec14e97 tempest-VolumesActionsTest-362336132 None] Acquiring lock "cinder-quobyte-5f43f348-8bb7-4b19-b175-d92e8fba245a" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:29:38 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-66d4092b-fd43-481e-ab66-9b042ec14e97 tempest-VolumesActionsTest-362336132 None] Lock "cinder-quobyte-5f43f348-8bb7-4b19-b175-d92e8fba245a" acquired by "delete_volume" :: waited 0.029s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:29:38 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-e62d7bef-07e4-46d5-a2e5-471de0344c79 tempest-VolumesDeleteCascade-1307048346 None] Created reservations ['db048aae-0b44-40c9-92e3-203f64130ff3', '8137bfa6-e74c-476f-895c-6825afbe47fd', 'b2a08348-7624-44c0-b950-060294be2e08', 'c1a5af89-24d4-454f-82bc-7467083d4149'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:29:38 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c897791-8c08-48a7-b5fe-08c12d0acb3e]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:29:38 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-66d4092b-fd43-481e-ab66-9b042ec14e97 tempest-VolumesActionsTest-362336132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5f43f348-8bb7-4b19-b175-d92e8fba245a {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:29:38 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e62d7bef-07e4-46d5-a2e5-471de0344c79 tempest-VolumesDeleteCascade-1307048346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:29:38 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e62d7bef-07e4-46d5-a2e5-471de0344c79 tempest-VolumesDeleteCascade-1307048346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:29:38 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-e62d7bef-07e4-46d5-a2e5-471de0344c79 tempest-VolumesDeleteCascade-1307048346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:29:38 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-e62d7bef-07e4-46d5-a2e5-471de0344c79 tempest-VolumesDeleteCascade-1307048346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:29:38 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e62d7bef-07e4-46d5-a2e5-471de0344c79 tempest-VolumesDeleteCascade-1307048346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:29:38 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e62d7bef-07e4-46d5-a2e5-471de0344c79 tempest-VolumesDeleteCascade-1307048346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:29:38 devstack sudo[105122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:29:38 devstack sudo[105122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:29:38 devstack sudo[105120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5f43f348-8bb7-4b19-b175-d92e8fba245a Aug 26 14:29:38 devstack sudo[105120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:29:39 devstack sudo[105118]: pam_unix(sudo:session): session closed for user root Aug 26 14:29:39 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-9bc6ef94-a1c8-4454-aae5-1ff4bb8cd9fa tempest-VolumesTestJSON-788898559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-edecf8a0-c0ca-4adc-9ee3-e1fc78c10f4b 1073741824" returned: 0 in 0.558s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:29:39 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-9bc6ef94-a1c8-4454-aae5-1ff4bb8cd9fa tempest-VolumesTestJSON-788898559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-edecf8a0-c0ca-4adc-9ee3-e1fc78c10f4b {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:29:39 devstack sudo[105122]: pam_unix(sudo:session): session closed for user root Aug 26 14:29:39 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e62d7bef-07e4-46d5-a2e5-471de0344c79 tempest-VolumesDeleteCascade-1307048346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.381s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:29:39 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-e62d7bef-07e4-46d5-a2e5-471de0344c79 tempest-VolumesDeleteCascade-1307048346 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:29:39 devstack sudo[105120]: pam_unix(sudo:session): session closed for user root Aug 26 14:29:39 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-e62d7bef-07e4-46d5-a2e5-471de0344c79 tempest-VolumesDeleteCascade-1307048346 None] Deleted volume successfully. Aug 26 14:29:39 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-66d4092b-fd43-481e-ab66-9b042ec14e97 tempest-VolumesActionsTest-362336132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5f43f348-8bb7-4b19-b175-d92e8fba245a" returned: 0 in 0.498s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:29:39 devstack sudo[105131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-edecf8a0-c0ca-4adc-9ee3-e1fc78c10f4b Aug 26 14:29:39 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-66d4092b-fd43-481e-ab66-9b042ec14e97 tempest-VolumesActionsTest-362336132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5f43f348-8bb7-4b19-b175-d92e8fba245a {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:29:39 devstack sudo[105131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:29:39 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-e62d7bef-07e4-46d5-a2e5-471de0344c79 tempest-VolumesDeleteCascade-1307048346 None] Lock "cinder-3c587c54-c98d-4c19-884e-907d6aaeda77-delete_volume" released by "delete_volume" :: held 8.009s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:29:39 devstack sudo[105133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5f43f348-8bb7-4b19-b175-d92e8fba245a Aug 26 14:29:39 devstack sudo[105133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:29:39 devstack sudo[105131]: pam_unix(sudo:session): session closed for user root Aug 26 14:29:39 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-9bc6ef94-a1c8-4454-aae5-1ff4bb8cd9fa tempest-VolumesTestJSON-788898559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-edecf8a0-c0ca-4adc-9ee3-e1fc78c10f4b" returned: 0 in 0.657s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:29:39 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-9bc6ef94-a1c8-4454-aae5-1ff4bb8cd9fa tempest-VolumesTestJSON-788898559 None] <== create_volume: return (1288ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:29:39 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-9bc6ef94-a1c8-4454-aae5-1ff4bb8cd9fa tempest-VolumesTestJSON-788898559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.294s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:29:39 devstack sudo[105133]: pam_unix(sudo:session): session closed for user root Aug 26 14:29:39 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-9bc6ef94-a1c8-4454-aae5-1ff4bb8cd9fa tempest-VolumesTestJSON-788898559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddfabd83-d5ad-4548-a987-f6cd0cdee09f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-edecf8a0-c0ca-4adc-9ee3-e1fc78c10f4b', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:29:39 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-9bc6ef94-a1c8-4454-aae5-1ff4bb8cd9fa tempest-VolumesTestJSON-788898559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (576773eb-6936-4e65-ad94-560e8afba078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:29:39 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-66d4092b-fd43-481e-ab66-9b042ec14e97 tempest-VolumesActionsTest-362336132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5f43f348-8bb7-4b19-b175-d92e8fba245a" returned: 0 in 0.648s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:29:39 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-66d4092b-fd43-481e-ab66-9b042ec14e97 tempest-VolumesActionsTest-362336132 None] Lock "cinder-quobyte-5f43f348-8bb7-4b19-b175-d92e8fba245a" released by "delete_volume" :: held 1.230s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:29:39 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-9bc6ef94-a1c8-4454-aae5-1ff4bb8cd9fa tempest-VolumesTestJSON-788898559 None] Volume volume-edecf8a0-c0ca-4adc-9ee3-e1fc78c10f4b (edecf8a0-c0ca-4adc-9ee3-e1fc78c10f4b): created successfully Aug 26 14:29:39 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-9bc6ef94-a1c8-4454-aae5-1ff4bb8cd9fa tempest-VolumesTestJSON-788898559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (576773eb-6936-4e65-ad94-560e8afba078) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:29:39 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-9bc6ef94-a1c8-4454-aae5-1ff4bb8cd9fa tempest-VolumesTestJSON-788898559 None] Flow 'volume_create_manager' (7a6a204f-7cfa-4946-a2af-b61b4a2d5c2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:29:39 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-9bc6ef94-a1c8-4454-aae5-1ff4bb8cd9fa tempest-VolumesTestJSON-788898559 None] Created volume successfully. Aug 26 14:29:39 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-66d4092b-fd43-481e-ab66-9b042ec14e97 tempest-VolumesActionsTest-362336132 None] Created reservations ['107109ad-702b-45c3-9299-57a12d225937', '46600d77-691b-4f46-a334-34e827f7bd98', '0709f970-16a2-4756-8c38-5fe83e57bc34', '779658b8-d8d1-4504-ba35-45cfec5c211f'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:29:40 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-66d4092b-fd43-481e-ab66-9b042ec14e97 tempest-VolumesActionsTest-362336132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:29:40 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-66d4092b-fd43-481e-ab66-9b042ec14e97 tempest-VolumesActionsTest-362336132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:29:40 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-66d4092b-fd43-481e-ab66-9b042ec14e97 tempest-VolumesActionsTest-362336132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:29:40 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-66d4092b-fd43-481e-ab66-9b042ec14e97 tempest-VolumesActionsTest-362336132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:29:40 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-66d4092b-fd43-481e-ab66-9b042ec14e97 tempest-VolumesActionsTest-362336132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:29:40 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-66d4092b-fd43-481e-ab66-9b042ec14e97 tempest-VolumesActionsTest-362336132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:29:40 devstack sudo[105138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:29:40 devstack sudo[105138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:29:40 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-417a4d54-0d94-49ac-8655-6a91cfe3f923 tempest-VolumesDeleteCascade-1307048346 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:29:40 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-417a4d54-0d94-49ac-8655-6a91cfe3f923 tempest-VolumesDeleteCascade-1307048346 None] Flow 'volume_create_manager' (7da04847-dc15-4e16-b374-c452fbb3befe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:29:40 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-417a4d54-0d94-49ac-8655-6a91cfe3f923 tempest-VolumesDeleteCascade-1307048346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f1a0079-cc55-4c11-b182-abfc8005e89a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:29:40 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-417a4d54-0d94-49ac-8655-6a91cfe3f923 tempest-VolumesDeleteCascade-1307048346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f1a0079-cc55-4c11-b182-abfc8005e89a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:29:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1576220791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09df078d-3b8e-4c8b-b9a4-d7be24705bcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0965d53b96f4cc98fd03e200dd2dd6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:29:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:29:40Z,use_quota=True,user_id='44e3bc86eb074f5789b3d1f4c2c7d33c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:29:40 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-417a4d54-0d94-49ac-8655-6a91cfe3f923 tempest-VolumesDeleteCascade-1307048346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88dfc6ff-6ee2-4387-af09-d8f99eb9f628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:29:40 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-417a4d54-0d94-49ac-8655-6a91cfe3f923 tempest-VolumesDeleteCascade-1307048346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88dfc6ff-6ee2-4387-af09-d8f99eb9f628) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:29:40 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-417a4d54-0d94-49ac-8655-6a91cfe3f923 tempest-VolumesDeleteCascade-1307048346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7356fb3-637b-4d06-bbc8-33fc367b80e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:29:40 devstack sudo[105138]: pam_unix(sudo:session): session closed for user root Aug 26 14:29:40 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-417a4d54-0d94-49ac-8655-6a91cfe3f923 tempest-VolumesDeleteCascade-1307048346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7356fb3-637b-4d06-bbc8-33fc367b80e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09df078d-3b8e-4c8b-b9a4-d7be24705bcb', 'volume_name': 'volume-09df078d-3b8e-4c8b-b9a4-d7be24705bcb', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:29:40 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-417a4d54-0d94-49ac-8655-6a91cfe3f923 tempest-VolumesDeleteCascade-1307048346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33ccdc8f-3568-4e72-a570-442610eefd0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:29:40 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-417a4d54-0d94-49ac-8655-6a91cfe3f923 tempest-VolumesDeleteCascade-1307048346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33ccdc8f-3568-4e72-a570-442610eefd0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:29:40 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-417a4d54-0d94-49ac-8655-6a91cfe3f923 tempest-VolumesDeleteCascade-1307048346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eadc893f-9b38-43d4-a095-7da069e4e16e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:29:40 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-417a4d54-0d94-49ac-8655-6a91cfe3f923 tempest-VolumesDeleteCascade-1307048346 None] Volume 09df078d-3b8e-4c8b-b9a4-d7be24705bcb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09df078d-3b8e-4c8b-b9a4-d7be24705bcb', 'volume_size': 1} Aug 26 14:29:40 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-417a4d54-0d94-49ac-8655-6a91cfe3f923 tempest-VolumesDeleteCascade-1307048346 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:29:40 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-417a4d54-0d94-49ac-8655-6a91cfe3f923 tempest-VolumesDeleteCascade-1307048346 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:29:40 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-417a4d54-0d94-49ac-8655-6a91cfe3f923 tempest-VolumesDeleteCascade-1307048346 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:29:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1576220791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09df078d-3b8e-4c8b-b9a4-d7be24705bcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0965d53b96f4cc98fd03e200dd2dd6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:29:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:29:40Z,use_quota=True,user_id='44e3bc86eb074f5789b3d1f4c2c7d33c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:29:40 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-417a4d54-0d94-49ac-8655-6a91cfe3f923 tempest-VolumesDeleteCascade-1307048346 None] Creating volume 09df078d-3b8e-4c8b-b9a4-d7be24705bcb {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:29:40 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-417a4d54-0d94-49ac-8655-6a91cfe3f923 tempest-VolumesDeleteCascade-1307048346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:29:40 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-417a4d54-0d94-49ac-8655-6a91cfe3f923 tempest-VolumesDeleteCascade-1307048346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:29:40 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-417a4d54-0d94-49ac-8655-6a91cfe3f923 tempest-VolumesDeleteCascade-1307048346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:29:40 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-417a4d54-0d94-49ac-8655-6a91cfe3f923 tempest-VolumesDeleteCascade-1307048346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:29:40 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-417a4d54-0d94-49ac-8655-6a91cfe3f923 tempest-VolumesDeleteCascade-1307048346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:29:40 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-417a4d54-0d94-49ac-8655-6a91cfe3f923 tempest-VolumesDeleteCascade-1307048346 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:29:40 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-417a4d54-0d94-49ac-8655-6a91cfe3f923 tempest-VolumesDeleteCascade-1307048346 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:29:40 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-417a4d54-0d94-49ac-8655-6a91cfe3f923 tempest-VolumesDeleteCascade-1307048346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-09df078d-3b8e-4c8b-b9a4-d7be24705bcb 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:29:40 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-66d4092b-fd43-481e-ab66-9b042ec14e97 tempest-VolumesActionsTest-362336132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.465s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:29:40 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-66d4092b-fd43-481e-ab66-9b042ec14e97 tempest-VolumesActionsTest-362336132 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:29:40 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-66d4092b-fd43-481e-ab66-9b042ec14e97 tempest-VolumesActionsTest-362336132 None] Deleted volume successfully. Aug 26 14:29:40 devstack sudo[105142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-09df078d-3b8e-4c8b-b9a4-d7be24705bcb 1073741824 Aug 26 14:29:40 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-66d4092b-fd43-481e-ab66-9b042ec14e97 tempest-VolumesActionsTest-362336132 None] Lock "cinder-5f43f348-8bb7-4b19-b175-d92e8fba245a-delete_volume" released by "delete_volume" :: held 2.116s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:29:40 devstack sudo[105142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:29:41 devstack sudo[105142]: pam_unix(sudo:session): session closed for user root Aug 26 14:29:41 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-417a4d54-0d94-49ac-8655-6a91cfe3f923 tempest-VolumesDeleteCascade-1307048346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-09df078d-3b8e-4c8b-b9a4-d7be24705bcb 1073741824" returned: 0 in 0.974s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:29:41 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-417a4d54-0d94-49ac-8655-6a91cfe3f923 tempest-VolumesDeleteCascade-1307048346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-09df078d-3b8e-4c8b-b9a4-d7be24705bcb {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:29:41 devstack sudo[105158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-09df078d-3b8e-4c8b-b9a4-d7be24705bcb Aug 26 14:29:41 devstack sudo[105158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:29:41 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-558a42ef-db45-43f4-aaa7-e20a8825b476 tempest-VolumesTestJSON-788898559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:29:41 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-558a42ef-db45-43f4-aaa7-e20a8825b476 tempest-VolumesTestJSON-788898559 None] Flow 'volume_create_manager' (9d78bc6c-b123-4c00-8b83-ab635206d037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:29:41 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-558a42ef-db45-43f4-aaa7-e20a8825b476 tempest-VolumesTestJSON-788898559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c8abbd9-5141-437b-bab7-3dde60a1aef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:29:41 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-558a42ef-db45-43f4-aaa7-e20a8825b476 tempest-VolumesTestJSON-788898559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c8abbd9-5141-437b-bab7-3dde60a1aef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:29:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2134093461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93883eec-5975-4e7d-a707-8082c38fe2d2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9b2d3b1bf913443fa136d1b33f8b3ea8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:29:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:29:42Z,use_quota=True,user_id='1575871eb51546f79cfae7ea87e2c635',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:29:41 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-558a42ef-db45-43f4-aaa7-e20a8825b476 tempest-VolumesTestJSON-788898559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fdc1d0c-c94f-4748-b359-55122df4cdf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:29:41 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-558a42ef-db45-43f4-aaa7-e20a8825b476 tempest-VolumesTestJSON-788898559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fdc1d0c-c94f-4748-b359-55122df4cdf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:29:41 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-558a42ef-db45-43f4-aaa7-e20a8825b476 tempest-VolumesTestJSON-788898559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (429975c7-6fb0-43ab-a1c3-f51272f39a3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:29:41 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-558a42ef-db45-43f4-aaa7-e20a8825b476 tempest-VolumesTestJSON-788898559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (429975c7-6fb0-43ab-a1c3-f51272f39a3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93883eec-5975-4e7d-a707-8082c38fe2d2', 'volume_name': 'volume-93883eec-5975-4e7d-a707-8082c38fe2d2', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:29:41 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-558a42ef-db45-43f4-aaa7-e20a8825b476 tempest-VolumesTestJSON-788898559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a261d04-32fa-4e0f-9166-530c197b4c1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:29:41 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-558a42ef-db45-43f4-aaa7-e20a8825b476 tempest-VolumesTestJSON-788898559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a261d04-32fa-4e0f-9166-530c197b4c1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:29:41 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-558a42ef-db45-43f4-aaa7-e20a8825b476 tempest-VolumesTestJSON-788898559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d5b923d-b136-4d26-b425-c2385f968bcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:29:41 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-558a42ef-db45-43f4-aaa7-e20a8825b476 tempest-VolumesTestJSON-788898559 None] Volume 93883eec-5975-4e7d-a707-8082c38fe2d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93883eec-5975-4e7d-a707-8082c38fe2d2', 'volume_size': 1} Aug 26 14:29:41 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-558a42ef-db45-43f4-aaa7-e20a8825b476 tempest-VolumesTestJSON-788898559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:29:42 devstack sudo[105158]: pam_unix(sudo:session): session closed for user root Aug 26 14:29:42 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-417a4d54-0d94-49ac-8655-6a91cfe3f923 tempest-VolumesDeleteCascade-1307048346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-09df078d-3b8e-4c8b-b9a4-d7be24705bcb" returned: 0 in 0.498s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:29:42 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-417a4d54-0d94-49ac-8655-6a91cfe3f923 tempest-VolumesDeleteCascade-1307048346 None] <== create_volume: return (1525ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:29:42 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-417a4d54-0d94-49ac-8655-6a91cfe3f923 tempest-VolumesDeleteCascade-1307048346 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.527s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:29:42 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-558a42ef-db45-43f4-aaa7-e20a8825b476 tempest-VolumesTestJSON-788898559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.076s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:29:42 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-558a42ef-db45-43f4-aaa7-e20a8825b476 tempest-VolumesTestJSON-788898559 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:29:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2134093461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93883eec-5975-4e7d-a707-8082c38fe2d2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9b2d3b1bf913443fa136d1b33f8b3ea8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:29:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:29:42Z,use_quota=True,user_id='1575871eb51546f79cfae7ea87e2c635',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:29:42 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-558a42ef-db45-43f4-aaa7-e20a8825b476 tempest-VolumesTestJSON-788898559 None] Creating volume 93883eec-5975-4e7d-a707-8082c38fe2d2 {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:29:42 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-558a42ef-db45-43f4-aaa7-e20a8825b476 tempest-VolumesTestJSON-788898559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:29:42 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-558a42ef-db45-43f4-aaa7-e20a8825b476 tempest-VolumesTestJSON-788898559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:29:42 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-558a42ef-db45-43f4-aaa7-e20a8825b476 tempest-VolumesTestJSON-788898559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:29:42 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-558a42ef-db45-43f4-aaa7-e20a8825b476 tempest-VolumesTestJSON-788898559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:29:42 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-558a42ef-db45-43f4-aaa7-e20a8825b476 tempest-VolumesTestJSON-788898559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:29:42 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-558a42ef-db45-43f4-aaa7-e20a8825b476 tempest-VolumesTestJSON-788898559 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:29:42 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-558a42ef-db45-43f4-aaa7-e20a8825b476 tempest-VolumesTestJSON-788898559 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:29:42 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-558a42ef-db45-43f4-aaa7-e20a8825b476 tempest-VolumesTestJSON-788898559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-93883eec-5975-4e7d-a707-8082c38fe2d2 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:29:42 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-417a4d54-0d94-49ac-8655-6a91cfe3f923 tempest-VolumesDeleteCascade-1307048346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eadc893f-9b38-43d4-a095-7da069e4e16e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09df078d-3b8e-4c8b-b9a4-d7be24705bcb', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:29:42 devstack sudo[105180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-93883eec-5975-4e7d-a707-8082c38fe2d2 1073741824 Aug 26 14:29:42 devstack sudo[105180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:29:42 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-417a4d54-0d94-49ac-8655-6a91cfe3f923 tempest-VolumesDeleteCascade-1307048346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0035dc8-858b-4d07-bfbf-b22ee7c6a8d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:29:42 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-417a4d54-0d94-49ac-8655-6a91cfe3f923 tempest-VolumesDeleteCascade-1307048346 None] Volume volume-09df078d-3b8e-4c8b-b9a4-d7be24705bcb (09df078d-3b8e-4c8b-b9a4-d7be24705bcb): created successfully Aug 26 14:29:42 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-417a4d54-0d94-49ac-8655-6a91cfe3f923 tempest-VolumesDeleteCascade-1307048346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0035dc8-858b-4d07-bfbf-b22ee7c6a8d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:29:42 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-417a4d54-0d94-49ac-8655-6a91cfe3f923 tempest-VolumesDeleteCascade-1307048346 None] Flow 'volume_create_manager' (7da04847-dc15-4e16-b374-c452fbb3befe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:29:42 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-417a4d54-0d94-49ac-8655-6a91cfe3f923 tempest-VolumesDeleteCascade-1307048346 None] Created volume successfully. Aug 26 14:29:42 devstack sudo[105180]: pam_unix(sudo:session): session closed for user root Aug 26 14:29:42 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-558a42ef-db45-43f4-aaa7-e20a8825b476 tempest-VolumesTestJSON-788898559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-93883eec-5975-4e7d-a707-8082c38fe2d2 1073741824" returned: 0 in 0.699s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:29:42 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-558a42ef-db45-43f4-aaa7-e20a8825b476 tempest-VolumesTestJSON-788898559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-93883eec-5975-4e7d-a707-8082c38fe2d2 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:29:42 devstack sudo[105186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-93883eec-5975-4e7d-a707-8082c38fe2d2 Aug 26 14:29:42 devstack sudo[105186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:29:42 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-f2ff5cbe-3031-4c9b-a203-815dc41cc849 tempest-VolumesDeleteCascade-1307048346 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:29:43 devstack sudo[105186]: pam_unix(sudo:session): session closed for user root Aug 26 14:29:43 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-558a42ef-db45-43f4-aaa7-e20a8825b476 tempest-VolumesTestJSON-788898559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-93883eec-5975-4e7d-a707-8082c38fe2d2" returned: 0 in 0.291s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:29:43 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-558a42ef-db45-43f4-aaa7-e20a8825b476 tempest-VolumesTestJSON-788898559 None] <== create_volume: return (1058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:29:43 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-558a42ef-db45-43f4-aaa7-e20a8825b476 tempest-VolumesTestJSON-788898559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.061s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:29:43 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-f2ff5cbe-3031-4c9b-a203-815dc41cc849 tempest-VolumesDeleteCascade-1307048346 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.245s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:29:43 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-f2ff5cbe-3031-4c9b-a203-815dc41cc849 tempest-VolumesDeleteCascade-1307048346 None] Creating offline snapshot 86415b7c-bbd7-4f49-9dc6-5c8cf891819f of volume 09df078d-3b8e-4c8b-b9a4-d7be24705bcb {{(pid=94394) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 14:29:43 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-558a42ef-db45-43f4-aaa7-e20a8825b476 tempest-VolumesTestJSON-788898559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d5b923d-b136-4d26-b425-c2385f968bcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93883eec-5975-4e7d-a707-8082c38fe2d2', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:29:43 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-558a42ef-db45-43f4-aaa7-e20a8825b476 tempest-VolumesTestJSON-788898559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (075b2e4b-7b02-4508-a1e6-6e43d2e372f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:29:43 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5852309-78be-4009-829b-0769988e52b1]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:29:43 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-f2ff5cbe-3031-4c9b-a203-815dc41cc849 tempest-VolumesDeleteCascade-1307048346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-09df078d-3b8e-4c8b-b9a4-d7be24705bcb {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:29:43 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-558a42ef-db45-43f4-aaa7-e20a8825b476 tempest-VolumesTestJSON-788898559 None] Volume volume-93883eec-5975-4e7d-a707-8082c38fe2d2 (93883eec-5975-4e7d-a707-8082c38fe2d2): created successfully Aug 26 14:29:43 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-558a42ef-db45-43f4-aaa7-e20a8825b476 tempest-VolumesTestJSON-788898559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (075b2e4b-7b02-4508-a1e6-6e43d2e372f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:29:43 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-558a42ef-db45-43f4-aaa7-e20a8825b476 tempest-VolumesTestJSON-788898559 None] Flow 'volume_create_manager' (9d78bc6c-b123-4c00-8b83-ab635206d037) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:29:43 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-558a42ef-db45-43f4-aaa7-e20a8825b476 tempest-VolumesTestJSON-788898559 None] Created volume successfully. Aug 26 14:29:43 devstack sudo[105190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-09df078d-3b8e-4c8b-b9a4-d7be24705bcb Aug 26 14:29:43 devstack sudo[105190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:29:43 devstack sudo[105190]: pam_unix(sudo:session): session closed for user root Aug 26 14:29:43 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-f2ff5cbe-3031-4c9b-a203-815dc41cc849 tempest-VolumesDeleteCascade-1307048346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-09df078d-3b8e-4c8b-b9a4-d7be24705bcb" returned: 0 in 0.454s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:29:43 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-f2ff5cbe-3031-4c9b-a203-815dc41cc849 tempest-VolumesDeleteCascade-1307048346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-09df078d-3b8e-4c8b-b9a4-d7be24705bcb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-09df078d-3b8e-4c8b-b9a4-d7be24705bcb.86415b7c-bbd7-4f49-9dc6-5c8cf891819f 1G {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:29:43 devstack sudo[105196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-09df078d-3b8e-4c8b-b9a4-d7be24705bcb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-09df078d-3b8e-4c8b-b9a4-d7be24705bcb.86415b7c-bbd7-4f49-9dc6-5c8cf891819f 1G Aug 26 14:29:43 devstack sudo[105196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:29:44 devstack sudo[105196]: pam_unix(sudo:session): session closed for user root Aug 26 14:29:44 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-f2ff5cbe-3031-4c9b-a203-815dc41cc849 tempest-VolumesDeleteCascade-1307048346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-09df078d-3b8e-4c8b-b9a4-d7be24705bcb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-09df078d-3b8e-4c8b-b9a4-d7be24705bcb.86415b7c-bbd7-4f49-9dc6-5c8cf891819f 1G" returned: 0 in 0.552s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:29:44 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-f2ff5cbe-3031-4c9b-a203-815dc41cc849 tempest-VolumesDeleteCascade-1307048346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09df078d-3b8e-4c8b-b9a4-d7be24705bcb -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-09df078d-3b8e-4c8b-b9a4-d7be24705bcb.86415b7c-bbd7-4f49-9dc6-5c8cf891819f {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:29:44 devstack sudo[105202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09df078d-3b8e-4c8b-b9a4-d7be24705bcb -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-09df078d-3b8e-4c8b-b9a4-d7be24705bcb.86415b7c-bbd7-4f49-9dc6-5c8cf891819f Aug 26 14:29:44 devstack sudo[105202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:29:44 devstack sudo[105202]: pam_unix(sudo:session): session closed for user root Aug 26 14:29:44 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-f2ff5cbe-3031-4c9b-a203-815dc41cc849 tempest-VolumesDeleteCascade-1307048346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09df078d-3b8e-4c8b-b9a4-d7be24705bcb -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-09df078d-3b8e-4c8b-b9a4-d7be24705bcb.86415b7c-bbd7-4f49-9dc6-5c8cf891819f" returned: 0 in 0.448s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:29:44 devstack cinder-volume[94394]: WARNING cinder.volume.drivers.remotefs [None req-f2ff5cbe-3031-4c9b-a203-815dc41cc849 tempest-VolumesDeleteCascade-1307048346 None] /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-09df078d-3b8e-4c8b-b9a4-d7be24705bcb.86415b7c-bbd7-4f49-9dc6-5c8cf891819f is being set with open permissions: ugo+rw Aug 26 14:29:44 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-f2ff5cbe-3031-4c9b-a203-815dc41cc849 tempest-VolumesDeleteCascade-1307048346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-09df078d-3b8e-4c8b-b9a4-d7be24705bcb.86415b7c-bbd7-4f49-9dc6-5c8cf891819f {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:29:44 devstack sudo[105207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-09df078d-3b8e-4c8b-b9a4-d7be24705bcb.86415b7c-bbd7-4f49-9dc6-5c8cf891819f Aug 26 14:29:44 devstack sudo[105207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:29:44 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c89cd64-aad1-4dac-a41a-82e9b8d0cb26 tempest-VolumesActionsTest-362336132 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:29:44 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-6c89cd64-aad1-4dac-a41a-82e9b8d0cb26 tempest-VolumesActionsTest-362336132 None] Flow 'volume_create_manager' (632fd019-8bc1-46c5-b36e-1dce64f1b039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:29:44 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-6c89cd64-aad1-4dac-a41a-82e9b8d0cb26 tempest-VolumesActionsTest-362336132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb47d994-41b1-486b-9cf0-1bf34d104193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:29:44 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-6c89cd64-aad1-4dac-a41a-82e9b8d0cb26 tempest-VolumesActionsTest-362336132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb47d994-41b1-486b-9cf0-1bf34d104193) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:29:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1397525292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f90c25e9-7f42-4b6f-8134-dd8a805804bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a85c881a611446280ade138453b54cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:29:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:29:45Z,use_quota=True,user_id='967c19248c35450f92db5434920581b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:29:44 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-6c89cd64-aad1-4dac-a41a-82e9b8d0cb26 tempest-VolumesActionsTest-362336132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87f1d616-d82e-4cdc-b52a-d7f20f0278dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:29:44 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-6c89cd64-aad1-4dac-a41a-82e9b8d0cb26 tempest-VolumesActionsTest-362336132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87f1d616-d82e-4cdc-b52a-d7f20f0278dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:29:44 devstack sudo[105207]: pam_unix(sudo:session): session closed for user root Aug 26 14:29:44 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-6c89cd64-aad1-4dac-a41a-82e9b8d0cb26 tempest-VolumesActionsTest-362336132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e58cbef-8744-455b-ba73-34d683d0b3bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:29:44 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-6c89cd64-aad1-4dac-a41a-82e9b8d0cb26 tempest-VolumesActionsTest-362336132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e58cbef-8744-455b-ba73-34d683d0b3bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f90c25e9-7f42-4b6f-8134-dd8a805804bf', 'volume_name': 'volume-f90c25e9-7f42-4b6f-8134-dd8a805804bf', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:29:44 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-6c89cd64-aad1-4dac-a41a-82e9b8d0cb26 tempest-VolumesActionsTest-362336132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c82cdff-4f7b-4b35-bd39-f543f8ee2a66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:29:44 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-6c89cd64-aad1-4dac-a41a-82e9b8d0cb26 tempest-VolumesActionsTest-362336132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c82cdff-4f7b-4b35-bd39-f543f8ee2a66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:29:44 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-6c89cd64-aad1-4dac-a41a-82e9b8d0cb26 tempest-VolumesActionsTest-362336132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ed020e3-6ae0-486e-a7d5-a0c3b84e830a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:29:44 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-6c89cd64-aad1-4dac-a41a-82e9b8d0cb26 tempest-VolumesActionsTest-362336132 None] Volume f90c25e9-7f42-4b6f-8134-dd8a805804bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f90c25e9-7f42-4b6f-8134-dd8a805804bf', 'volume_size': 1} Aug 26 14:29:44 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-6c89cd64-aad1-4dac-a41a-82e9b8d0cb26 tempest-VolumesActionsTest-362336132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:29:44 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-f2ff5cbe-3031-4c9b-a203-815dc41cc849 tempest-VolumesDeleteCascade-1307048346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-09df078d-3b8e-4c8b-b9a4-d7be24705bcb.86415b7c-bbd7-4f49-9dc6-5c8cf891819f" returned: 0 in 0.298s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:29:44 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-f2ff5cbe-3031-4c9b-a203-815dc41cc849 tempest-VolumesDeleteCascade-1307048346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-09df078d-3b8e-4c8b-b9a4-d7be24705bcb.info {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:29:44 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-b9edcd26-3b9c-4d3d-9eb0-a1027620fac0 tempest-VolumesTestJSON-788898559 None] Acquiring lock "cinder-93883eec-5975-4e7d-a707-8082c38fe2d2-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:29:44 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-b9edcd26-3b9c-4d3d-9eb0-a1027620fac0 tempest-VolumesTestJSON-788898559 None] Lock "cinder-93883eec-5975-4e7d-a707-8082c38fe2d2-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:29:44 devstack sudo[105210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-09df078d-3b8e-4c8b-b9a4-d7be24705bcb.info Aug 26 14:29:44 devstack sudo[105210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:29:45 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-b9edcd26-3b9c-4d3d-9eb0-a1027620fac0 tempest-VolumesTestJSON-788898559 None] Acquiring lock "cinder-quobyte-93883eec-5975-4e7d-a707-8082c38fe2d2" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:29:45 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-b9edcd26-3b9c-4d3d-9eb0-a1027620fac0 tempest-VolumesTestJSON-788898559 None] Lock "cinder-quobyte-93883eec-5975-4e7d-a707-8082c38fe2d2" acquired by "delete_volume" :: waited 0.025s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:29:45 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d710fd1-a43d-4ac0-ab6e-0517e7644b16]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:29:45 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-b9edcd26-3b9c-4d3d-9eb0-a1027620fac0 tempest-VolumesTestJSON-788898559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-93883eec-5975-4e7d-a707-8082c38fe2d2 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:29:45 devstack sudo[105212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-93883eec-5975-4e7d-a707-8082c38fe2d2 Aug 26 14:29:45 devstack sudo[105212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:29:45 devstack sudo[105210]: pam_unix(sudo:session): session closed for user root Aug 26 14:29:45 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-f2ff5cbe-3031-4c9b-a203-815dc41cc849 tempest-VolumesDeleteCascade-1307048346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-09df078d-3b8e-4c8b-b9a4-d7be24705bcb.info" returned: 0 in 0.310s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:29:45 devstack cinder-volume[94394]: WARNING cinder.volume.drivers.remotefs [None req-f2ff5cbe-3031-4c9b-a203-815dc41cc849 tempest-VolumesDeleteCascade-1307048346 None] /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-09df078d-3b8e-4c8b-b9a4-d7be24705bcb.info is being set with open permissions: ugo+rw Aug 26 14:29:45 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-f2ff5cbe-3031-4c9b-a203-815dc41cc849 tempest-VolumesDeleteCascade-1307048346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-09df078d-3b8e-4c8b-b9a4-d7be24705bcb.info {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:29:45 devstack sudo[105215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-09df078d-3b8e-4c8b-b9a4-d7be24705bcb.info Aug 26 14:29:45 devstack sudo[105215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:29:45 devstack sudo[105212]: pam_unix(sudo:session): session closed for user root Aug 26 14:29:45 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-b9edcd26-3b9c-4d3d-9eb0-a1027620fac0 tempest-VolumesTestJSON-788898559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-93883eec-5975-4e7d-a707-8082c38fe2d2" returned: 0 in 0.384s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:29:45 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-b9edcd26-3b9c-4d3d-9eb0-a1027620fac0 tempest-VolumesTestJSON-788898559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-93883eec-5975-4e7d-a707-8082c38fe2d2 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:29:45 devstack sudo[105221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-93883eec-5975-4e7d-a707-8082c38fe2d2 Aug 26 14:29:45 devstack sudo[105221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:29:45 devstack sudo[105215]: pam_unix(sudo:session): session closed for user root Aug 26 14:29:45 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-f2ff5cbe-3031-4c9b-a203-815dc41cc849 tempest-VolumesDeleteCascade-1307048346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-09df078d-3b8e-4c8b-b9a4-d7be24705bcb.info" returned: 0 in 0.264s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:29:45 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-f2ff5cbe-3031-4c9b-a203-815dc41cc849 tempest-VolumesDeleteCascade-1307048346 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.439s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:29:45 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-6c89cd64-aad1-4dac-a41a-82e9b8d0cb26 tempest-VolumesActionsTest-362336132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.639s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:29:45 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-6c89cd64-aad1-4dac-a41a-82e9b8d0cb26 tempest-VolumesActionsTest-362336132 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:29:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1397525292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f90c25e9-7f42-4b6f-8134-dd8a805804bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a85c881a611446280ade138453b54cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:29:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:29:45Z,use_quota=True,user_id='967c19248c35450f92db5434920581b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:29:45 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-6c89cd64-aad1-4dac-a41a-82e9b8d0cb26 tempest-VolumesActionsTest-362336132 None] Creating volume f90c25e9-7f42-4b6f-8134-dd8a805804bf {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:29:45 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-6c89cd64-aad1-4dac-a41a-82e9b8d0cb26 tempest-VolumesActionsTest-362336132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:29:45 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-6c89cd64-aad1-4dac-a41a-82e9b8d0cb26 tempest-VolumesActionsTest-362336132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:29:45 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-6c89cd64-aad1-4dac-a41a-82e9b8d0cb26 tempest-VolumesActionsTest-362336132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:29:45 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-6c89cd64-aad1-4dac-a41a-82e9b8d0cb26 tempest-VolumesActionsTest-362336132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:29:45 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-6c89cd64-aad1-4dac-a41a-82e9b8d0cb26 tempest-VolumesActionsTest-362336132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:29:45 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-6c89cd64-aad1-4dac-a41a-82e9b8d0cb26 tempest-VolumesActionsTest-362336132 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:29:45 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-6c89cd64-aad1-4dac-a41a-82e9b8d0cb26 tempest-VolumesActionsTest-362336132 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:29:45 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-6c89cd64-aad1-4dac-a41a-82e9b8d0cb26 tempest-VolumesActionsTest-362336132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-f90c25e9-7f42-4b6f-8134-dd8a805804bf 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:29:45 devstack sudo[105223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-f90c25e9-7f42-4b6f-8134-dd8a805804bf 1073741824 Aug 26 14:29:45 devstack sudo[105223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:29:45 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-f2ff5cbe-3031-4c9b-a203-815dc41cc849 tempest-VolumesDeleteCascade-1307048346 None] Create snapshot completed successfully Aug 26 14:29:45 devstack sudo[105221]: pam_unix(sudo:session): session closed for user root Aug 26 14:29:45 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-b9edcd26-3b9c-4d3d-9eb0-a1027620fac0 tempest-VolumesTestJSON-788898559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-93883eec-5975-4e7d-a707-8082c38fe2d2" returned: 0 in 0.290s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:29:45 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-b9edcd26-3b9c-4d3d-9eb0-a1027620fac0 tempest-VolumesTestJSON-788898559 None] Lock "cinder-quobyte-93883eec-5975-4e7d-a707-8082c38fe2d2" released by "delete_volume" :: held 0.715s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:29:45 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-b9edcd26-3b9c-4d3d-9eb0-a1027620fac0 tempest-VolumesTestJSON-788898559 None] Created reservations ['7a8f50e2-38cc-4c94-9208-6cc2595f9da5', 'a635aa95-9dec-476b-9d69-18625ad0fa00', '4273c83c-e6c2-4b4c-a30a-e28b5c5c9e89', '8173ebf4-5fe8-418c-a4d1-fb9ce3f6d524'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:29:45 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-b9edcd26-3b9c-4d3d-9eb0-a1027620fac0 tempest-VolumesTestJSON-788898559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:29:45 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-b9edcd26-3b9c-4d3d-9eb0-a1027620fac0 tempest-VolumesTestJSON-788898559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:29:45 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-b9edcd26-3b9c-4d3d-9eb0-a1027620fac0 tempest-VolumesTestJSON-788898559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:29:45 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-b9edcd26-3b9c-4d3d-9eb0-a1027620fac0 tempest-VolumesTestJSON-788898559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:29:45 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-b9edcd26-3b9c-4d3d-9eb0-a1027620fac0 tempest-VolumesTestJSON-788898559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:29:45 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-b9edcd26-3b9c-4d3d-9eb0-a1027620fac0 tempest-VolumesTestJSON-788898559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:29:45 devstack sudo[105229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:29:45 devstack sudo[105229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:29:46 devstack sudo[105223]: pam_unix(sudo:session): session closed for user root Aug 26 14:29:46 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-6c89cd64-aad1-4dac-a41a-82e9b8d0cb26 tempest-VolumesActionsTest-362336132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-f90c25e9-7f42-4b6f-8134-dd8a805804bf 1073741824" returned: 0 in 0.616s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:29:46 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-2311b22f-2f3e-4472-a470-8572ded69fa7 tempest-VolumesTestJSON-788898559 None] Acquiring lock "cinder-edecf8a0-c0ca-4adc-9ee3-e1fc78c10f4b-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:29:46 devstack sudo[105229]: pam_unix(sudo:session): session closed for user root Aug 26 14:29:46 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-b9edcd26-3b9c-4d3d-9eb0-a1027620fac0 tempest-VolumesTestJSON-788898559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.340s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:29:46 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-b9edcd26-3b9c-4d3d-9eb0-a1027620fac0 tempest-VolumesTestJSON-788898559 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:29:46 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-2311b22f-2f3e-4472-a470-8572ded69fa7 tempest-VolumesTestJSON-788898559 None] Lock "cinder-edecf8a0-c0ca-4adc-9ee3-e1fc78c10f4b-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:29:46 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-6c89cd64-aad1-4dac-a41a-82e9b8d0cb26 tempest-VolumesActionsTest-362336132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-f90c25e9-7f42-4b6f-8134-dd8a805804bf {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:29:46 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-b9edcd26-3b9c-4d3d-9eb0-a1027620fac0 tempest-VolumesTestJSON-788898559 None] Deleted volume successfully. Aug 26 14:29:46 devstack sudo[105233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-f90c25e9-7f42-4b6f-8134-dd8a805804bf Aug 26 14:29:46 devstack sudo[105233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:29:46 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-b9edcd26-3b9c-4d3d-9eb0-a1027620fac0 tempest-VolumesTestJSON-788898559 None] Lock "cinder-93883eec-5975-4e7d-a707-8082c38fe2d2-delete_volume" released by "delete_volume" :: held 1.325s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:29:46 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-2311b22f-2f3e-4472-a470-8572ded69fa7 tempest-VolumesTestJSON-788898559 None] Acquiring lock "cinder-quobyte-edecf8a0-c0ca-4adc-9ee3-e1fc78c10f4b" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:29:46 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-2311b22f-2f3e-4472-a470-8572ded69fa7 tempest-VolumesTestJSON-788898559 None] Lock "cinder-quobyte-edecf8a0-c0ca-4adc-9ee3-e1fc78c10f4b" acquired by "delete_volume" :: waited 0.024s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:29:46 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[d42a9aa8-282e-494a-a5d8-ac42c2c3fdeb]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:29:46 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-2311b22f-2f3e-4472-a470-8572ded69fa7 tempest-VolumesTestJSON-788898559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-edecf8a0-c0ca-4adc-9ee3-e1fc78c10f4b {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:29:46 devstack sudo[105235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-edecf8a0-c0ca-4adc-9ee3-e1fc78c10f4b Aug 26 14:29:46 devstack sudo[105235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:29:46 devstack sudo[105233]: pam_unix(sudo:session): session closed for user root Aug 26 14:29:46 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-6c89cd64-aad1-4dac-a41a-82e9b8d0cb26 tempest-VolumesActionsTest-362336132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-f90c25e9-7f42-4b6f-8134-dd8a805804bf" returned: 0 in 0.385s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:29:46 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-6c89cd64-aad1-4dac-a41a-82e9b8d0cb26 tempest-VolumesActionsTest-362336132 None] <== create_volume: return (1106ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:29:46 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-6c89cd64-aad1-4dac-a41a-82e9b8d0cb26 tempest-VolumesActionsTest-362336132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.108s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:29:46 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-6c89cd64-aad1-4dac-a41a-82e9b8d0cb26 tempest-VolumesActionsTest-362336132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ed020e3-6ae0-486e-a7d5-a0c3b84e830a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f90c25e9-7f42-4b6f-8134-dd8a805804bf', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:29:46 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-6c89cd64-aad1-4dac-a41a-82e9b8d0cb26 tempest-VolumesActionsTest-362336132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41724763-81b3-479c-8d8c-a2e4d886005c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:29:46 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-6c89cd64-aad1-4dac-a41a-82e9b8d0cb26 tempest-VolumesActionsTest-362336132 None] Volume volume-f90c25e9-7f42-4b6f-8134-dd8a805804bf (f90c25e9-7f42-4b6f-8134-dd8a805804bf): created successfully Aug 26 14:29:46 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-6c89cd64-aad1-4dac-a41a-82e9b8d0cb26 tempest-VolumesActionsTest-362336132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41724763-81b3-479c-8d8c-a2e4d886005c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:29:46 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-6c89cd64-aad1-4dac-a41a-82e9b8d0cb26 tempest-VolumesActionsTest-362336132 None] Flow 'volume_create_manager' (632fd019-8bc1-46c5-b36e-1dce64f1b039) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:29:46 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-6c89cd64-aad1-4dac-a41a-82e9b8d0cb26 tempest-VolumesActionsTest-362336132 None] Created volume successfully. Aug 26 14:29:46 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-e60e8151-d9ea-4bf0-b2cb-cab7b05e2e65 tempest-VolumesDeleteCascade-1307048346 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:29:46 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-e60e8151-d9ea-4bf0-b2cb-cab7b05e2e65 tempest-VolumesDeleteCascade-1307048346 None] Flow 'volume_create_manager' (53440627-902d-4a89-ae63-779b87d7d71d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:29:46 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-e60e8151-d9ea-4bf0-b2cb-cab7b05e2e65 tempest-VolumesDeleteCascade-1307048346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a69d38d-ed0c-4074-aa03-83d334d131cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:29:46 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-e60e8151-d9ea-4bf0-b2cb-cab7b05e2e65 tempest-VolumesDeleteCascade-1307048346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a69d38d-ed0c-4074-aa03-83d334d131cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:29:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1493067908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcb6f9b8-5d2f-45b1-9623-5e0d087836d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0965d53b96f4cc98fd03e200dd2dd6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:29:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=86415b7c-bbd7-4f49-9dc6-5c8cf891819f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:29:47Z,use_quota=True,user_id='44e3bc86eb074f5789b3d1f4c2c7d33c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:29:46 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-e60e8151-d9ea-4bf0-b2cb-cab7b05e2e65 tempest-VolumesDeleteCascade-1307048346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e8d59cf-9e49-4178-ac0d-184afc3f910e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:29:46 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-e60e8151-d9ea-4bf0-b2cb-cab7b05e2e65 tempest-VolumesDeleteCascade-1307048346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e8d59cf-9e49-4178-ac0d-184afc3f910e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:29:46 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-e60e8151-d9ea-4bf0-b2cb-cab7b05e2e65 tempest-VolumesDeleteCascade-1307048346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e77fe56-2220-4b67-a1e3-715ac5a47897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:29:46 devstack sudo[105235]: pam_unix(sudo:session): session closed for user root Aug 26 14:29:46 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-e60e8151-d9ea-4bf0-b2cb-cab7b05e2e65 tempest-VolumesDeleteCascade-1307048346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e77fe56-2220-4b67-a1e3-715ac5a47897) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'bcb6f9b8-5d2f-45b1-9623-5e0d087836d3', 'volume_name': 'volume-bcb6f9b8-5d2f-45b1-9623-5e0d087836d3', 'volume_size': 1, 'snapshot_id': '86415b7c-bbd7-4f49-9dc6-5c8cf891819f'}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:29:46 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-e60e8151-d9ea-4bf0-b2cb-cab7b05e2e65 tempest-VolumesDeleteCascade-1307048346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba96e2e4-038a-4095-a590-bbbe861b219d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:29:46 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-e60e8151-d9ea-4bf0-b2cb-cab7b05e2e65 tempest-VolumesDeleteCascade-1307048346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba96e2e4-038a-4095-a590-bbbe861b219d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:29:46 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-e60e8151-d9ea-4bf0-b2cb-cab7b05e2e65 tempest-VolumesDeleteCascade-1307048346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f339e08-3fa2-4ce8-b04c-4c8da5ac50f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:29:46 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-e60e8151-d9ea-4bf0-b2cb-cab7b05e2e65 tempest-VolumesDeleteCascade-1307048346 None] Volume bcb6f9b8-5d2f-45b1-9623-5e0d087836d3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-bcb6f9b8-5d2f-45b1-9623-5e0d087836d3', 'volume_size': 1, 'snapshot_id': '86415b7c-bbd7-4f49-9dc6-5c8cf891819f'} Aug 26 14:29:46 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-2311b22f-2f3e-4472-a470-8572ded69fa7 tempest-VolumesTestJSON-788898559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-edecf8a0-c0ca-4adc-9ee3-e1fc78c10f4b" returned: 0 in 0.553s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:29:46 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-2311b22f-2f3e-4472-a470-8572ded69fa7 tempest-VolumesTestJSON-788898559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-edecf8a0-c0ca-4adc-9ee3-e1fc78c10f4b {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:29:46 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e60e8151-d9ea-4bf0-b2cb-cab7b05e2e65 tempest-VolumesDeleteCascade-1307048346 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:29:46 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e60e8151-d9ea-4bf0-b2cb-cab7b05e2e65 tempest-VolumesDeleteCascade-1307048346 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:29:46 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-e60e8151-d9ea-4bf0-b2cb-cab7b05e2e65 tempest-VolumesDeleteCascade-1307048346 None] Acquiring lock "cinder-quobyte-86415b7c-bbd7-4f49-9dc6-5c8cf891819f-bcb6f9b8-5d2f-45b1-9623-5e0d087836d3" by "_create_volume_from_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:29:46 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-e60e8151-d9ea-4bf0-b2cb-cab7b05e2e65 tempest-VolumesDeleteCascade-1307048346 None] Lock "cinder-quobyte-86415b7c-bbd7-4f49-9dc6-5c8cf891819f-bcb6f9b8-5d2f-45b1-9623-5e0d087836d3" acquired by "_create_volume_from_snapshot" :: waited 0.029s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:29:46 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-e60e8151-d9ea-4bf0-b2cb-cab7b05e2e65 tempest-VolumesDeleteCascade-1307048346 None] Creating volume bcb6f9b8-5d2f-45b1-9623-5e0d087836d3 from snapshot 86415b7c-bbd7-4f49-9dc6-5c8cf891819f {{(pid=94394) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Aug 26 14:29:46 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e60e8151-d9ea-4bf0-b2cb-cab7b05e2e65 tempest-VolumesDeleteCascade-1307048346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:29:46 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e60e8151-d9ea-4bf0-b2cb-cab7b05e2e65 tempest-VolumesDeleteCascade-1307048346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:29:46 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-e60e8151-d9ea-4bf0-b2cb-cab7b05e2e65 tempest-VolumesDeleteCascade-1307048346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:29:46 devstack sudo[105241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-edecf8a0-c0ca-4adc-9ee3-e1fc78c10f4b Aug 26 14:29:46 devstack sudo[105241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:29:47 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-e60e8151-d9ea-4bf0-b2cb-cab7b05e2e65 tempest-VolumesDeleteCascade-1307048346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:29:47 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e60e8151-d9ea-4bf0-b2cb-cab7b05e2e65 tempest-VolumesDeleteCascade-1307048346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:29:47 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-e60e8151-d9ea-4bf0-b2cb-cab7b05e2e65 tempest-VolumesDeleteCascade-1307048346 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:29:47 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-e60e8151-d9ea-4bf0-b2cb-cab7b05e2e65 tempest-VolumesDeleteCascade-1307048346 None] Acquiring lock "cinder-quobyte-bcb6f9b8-5d2f-45b1-9623-5e0d087836d3" by "_copy_volume_from_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:29:47 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-e60e8151-d9ea-4bf0-b2cb-cab7b05e2e65 tempest-VolumesDeleteCascade-1307048346 None] Lock "cinder-quobyte-bcb6f9b8-5d2f-45b1-9623-5e0d087836d3" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:29:47 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-e60e8151-d9ea-4bf0-b2cb-cab7b05e2e65 tempest-VolumesDeleteCascade-1307048346 None] snapshot: 86415b7c-bbd7-4f49-9dc6-5c8cf891819f, volume: bcb6f9b8-5d2f-45b1-9623-5e0d087836d3, {{(pid=94394) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 26 14:29:47 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e60e8151-d9ea-4bf0-b2cb-cab7b05e2e65 tempest-VolumesDeleteCascade-1307048346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:29:47 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e60e8151-d9ea-4bf0-b2cb-cab7b05e2e65 tempest-VolumesDeleteCascade-1307048346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:29:47 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-e60e8151-d9ea-4bf0-b2cb-cab7b05e2e65 tempest-VolumesDeleteCascade-1307048346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:29:47 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-e60e8151-d9ea-4bf0-b2cb-cab7b05e2e65 tempest-VolumesDeleteCascade-1307048346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:29:47 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e60e8151-d9ea-4bf0-b2cb-cab7b05e2e65 tempest-VolumesDeleteCascade-1307048346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:29:47 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-aaa97b45-7277-4499-a58b-1d8bf52f2303 tempest-VolumesActionsTest-508015839 None] Acquiring lock "cinder-f90c25e9-7f42-4b6f-8134-dd8a805804bf-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:29:47 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[809f4551-b91e-45f8-862c-a90a9a50c064]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:29:47 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e60e8151-d9ea-4bf0-b2cb-cab7b05e2e65 tempest-VolumesDeleteCascade-1307048346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-09df078d-3b8e-4c8b-b9a4-d7be24705bcb.86415b7c-bbd7-4f49-9dc6-5c8cf891819f {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:29:47 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-aaa97b45-7277-4499-a58b-1d8bf52f2303 tempest-VolumesActionsTest-508015839 None] Lock "cinder-f90c25e9-7f42-4b6f-8134-dd8a805804bf-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:29:47 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-aaa97b45-7277-4499-a58b-1d8bf52f2303 tempest-VolumesActionsTest-508015839 None] Acquiring lock "cinder-quobyte-f90c25e9-7f42-4b6f-8134-dd8a805804bf" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:29:47 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-aaa97b45-7277-4499-a58b-1d8bf52f2303 tempest-VolumesActionsTest-508015839 None] Lock "cinder-quobyte-f90c25e9-7f42-4b6f-8134-dd8a805804bf" acquired by "delete_volume" :: waited 0.019s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:29:47 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[2131e634-14f2-449b-8f62-92f7cc18eba7]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:29:47 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-aaa97b45-7277-4499-a58b-1d8bf52f2303 tempest-VolumesActionsTest-508015839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-f90c25e9-7f42-4b6f-8134-dd8a805804bf {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:29:47 devstack sudo[105243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-09df078d-3b8e-4c8b-b9a4-d7be24705bcb.86415b7c-bbd7-4f49-9dc6-5c8cf891819f Aug 26 14:29:47 devstack sudo[105243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:29:47 devstack sudo[105241]: pam_unix(sudo:session): session closed for user root Aug 26 14:29:47 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-2311b22f-2f3e-4472-a470-8572ded69fa7 tempest-VolumesTestJSON-788898559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-edecf8a0-c0ca-4adc-9ee3-e1fc78c10f4b" returned: 0 in 0.378s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:29:47 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-2311b22f-2f3e-4472-a470-8572ded69fa7 tempest-VolumesTestJSON-788898559 None] Lock "cinder-quobyte-edecf8a0-c0ca-4adc-9ee3-e1fc78c10f4b" released by "delete_volume" :: held 1.010s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:29:47 devstack sudo[105244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-f90c25e9-7f42-4b6f-8134-dd8a805804bf Aug 26 14:29:47 devstack sudo[105244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:29:47 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-2311b22f-2f3e-4472-a470-8572ded69fa7 tempest-VolumesTestJSON-788898559 None] Created reservations ['99b54322-a88a-4279-bb39-45b6e56e026d', '50e172b3-c8f8-4b3f-93c3-d143c85bd357', 'd4d1be36-bdd5-4b7c-be79-7ad7d32d4363', '46488628-41b7-44ff-9f17-c2de1ddf600b'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:29:47 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-2311b22f-2f3e-4472-a470-8572ded69fa7 tempest-VolumesTestJSON-788898559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:29:47 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-2311b22f-2f3e-4472-a470-8572ded69fa7 tempest-VolumesTestJSON-788898559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:29:47 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-2311b22f-2f3e-4472-a470-8572ded69fa7 tempest-VolumesTestJSON-788898559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:29:47 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-2311b22f-2f3e-4472-a470-8572ded69fa7 tempest-VolumesTestJSON-788898559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:29:47 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-2311b22f-2f3e-4472-a470-8572ded69fa7 tempest-VolumesTestJSON-788898559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:29:47 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-2311b22f-2f3e-4472-a470-8572ded69fa7 tempest-VolumesTestJSON-788898559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:29:47 devstack sudo[105249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:29:47 devstack sudo[105249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:29:47 devstack sudo[105243]: pam_unix(sudo:session): session closed for user root Aug 26 14:29:47 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e60e8151-d9ea-4bf0-b2cb-cab7b05e2e65 tempest-VolumesDeleteCascade-1307048346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-09df078d-3b8e-4c8b-b9a4-d7be24705bcb.86415b7c-bbd7-4f49-9dc6-5c8cf891819f" returned: 0 in 0.474s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:29:47 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-e60e8151-d9ea-4bf0-b2cb-cab7b05e2e65 tempest-VolumesDeleteCascade-1307048346 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-09df078d-3b8e-4c8b-b9a4-d7be24705bcb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94394) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 14:29:47 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[30daa03c-dc4c-4cee-af9a-7250165d7ca2]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:29:47 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e60e8151-d9ea-4bf0-b2cb-cab7b05e2e65 tempest-VolumesDeleteCascade-1307048346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-09df078d-3b8e-4c8b-b9a4-d7be24705bcb {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:29:47 devstack sudo[105244]: pam_unix(sudo:session): session closed for user root Aug 26 14:29:47 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-aaa97b45-7277-4499-a58b-1d8bf52f2303 tempest-VolumesActionsTest-508015839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-f90c25e9-7f42-4b6f-8134-dd8a805804bf" returned: 0 in 0.497s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:29:47 devstack sudo[105255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-09df078d-3b8e-4c8b-b9a4-d7be24705bcb Aug 26 14:29:47 devstack sudo[105255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:29:47 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-aaa97b45-7277-4499-a58b-1d8bf52f2303 tempest-VolumesActionsTest-508015839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-f90c25e9-7f42-4b6f-8134-dd8a805804bf {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:29:47 devstack sudo[105258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-f90c25e9-7f42-4b6f-8134-dd8a805804bf Aug 26 14:29:47 devstack sudo[105258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:29:47 devstack sudo[105249]: pam_unix(sudo:session): session closed for user root Aug 26 14:29:47 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-2311b22f-2f3e-4472-a470-8572ded69fa7 tempest-VolumesTestJSON-788898559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.304s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:29:47 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-2311b22f-2f3e-4472-a470-8572ded69fa7 tempest-VolumesTestJSON-788898559 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:29:47 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-2311b22f-2f3e-4472-a470-8572ded69fa7 tempest-VolumesTestJSON-788898559 None] Deleted volume successfully. Aug 26 14:29:47 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-2311b22f-2f3e-4472-a470-8572ded69fa7 tempest-VolumesTestJSON-788898559 None] Lock "cinder-edecf8a0-c0ca-4adc-9ee3-e1fc78c10f4b-delete_volume" released by "delete_volume" :: held 1.605s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:29:48 devstack sudo[105258]: pam_unix(sudo:session): session closed for user root Aug 26 14:29:48 devstack sudo[105255]: pam_unix(sudo:session): session closed for user root Aug 26 14:29:48 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-aaa97b45-7277-4499-a58b-1d8bf52f2303 tempest-VolumesActionsTest-508015839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-f90c25e9-7f42-4b6f-8134-dd8a805804bf" returned: 0 in 0.285s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:29:48 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e60e8151-d9ea-4bf0-b2cb-cab7b05e2e65 tempest-VolumesDeleteCascade-1307048346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-09df078d-3b8e-4c8b-b9a4-d7be24705bcb" returned: 0 in 0.421s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:29:48 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-e60e8151-d9ea-4bf0-b2cb-cab7b05e2e65 tempest-VolumesDeleteCascade-1307048346 None] will copy from snapshot at /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-09df078d-3b8e-4c8b-b9a4-d7be24705bcb {{(pid=94394) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 26 14:29:48 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-e60e8151-d9ea-4bf0-b2cb-cab7b05e2e65 tempest-VolumesDeleteCascade-1307048346 None] Creating direct copy from snapshot {{(pid=94394) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 26 14:29:48 devstack cinder-volume[94394]: DEBUG cinder.utils [None req-e60e8151-d9ea-4bf0-b2cb-cab7b05e2e65 tempest-VolumesDeleteCascade-1307048346 None] Path /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-bcb6f9b8-5d2f-45b1-9623-5e0d087836d3 not found in is_blk_device check {{(pid=94394) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 26 14:29:48 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e60e8151-d9ea-4bf0-b2cb-cab7b05e2e65 tempest-VolumesDeleteCascade-1307048346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-09df078d-3b8e-4c8b-b9a4-d7be24705bcb /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-bcb6f9b8-5d2f-45b1-9623-5e0d087836d3 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:29:48 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-aaa97b45-7277-4499-a58b-1d8bf52f2303 tempest-VolumesActionsTest-508015839 None] Lock "cinder-quobyte-f90c25e9-7f42-4b6f-8134-dd8a805804bf" released by "delete_volume" :: held 0.839s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:29:48 devstack sudo[105265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-09df078d-3b8e-4c8b-b9a4-d7be24705bcb /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-bcb6f9b8-5d2f-45b1-9623-5e0d087836d3 Aug 26 14:29:48 devstack sudo[105265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:29:48 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-aaa97b45-7277-4499-a58b-1d8bf52f2303 tempest-VolumesActionsTest-508015839 None] Created reservations ['e57b66de-89c9-4f89-8ef4-d9216b5d1168', '7c2e563c-777d-4651-b5ce-9bc988a1cf54', 'c57ce7eb-b30b-41ab-af34-72394bdc5d44', 'ce926720-20c4-4f75-93d5-47ab46e9eab9'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:29:48 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-aaa97b45-7277-4499-a58b-1d8bf52f2303 tempest-VolumesActionsTest-508015839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:29:48 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-aaa97b45-7277-4499-a58b-1d8bf52f2303 tempest-VolumesActionsTest-508015839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:29:48 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-aaa97b45-7277-4499-a58b-1d8bf52f2303 tempest-VolumesActionsTest-508015839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:29:48 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-aaa97b45-7277-4499-a58b-1d8bf52f2303 tempest-VolumesActionsTest-508015839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:29:48 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-aaa97b45-7277-4499-a58b-1d8bf52f2303 tempest-VolumesActionsTest-508015839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:29:48 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-aaa97b45-7277-4499-a58b-1d8bf52f2303 tempest-VolumesActionsTest-508015839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:29:48 devstack sudo[105267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:29:48 devstack sudo[105267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:29:48 devstack sudo[105267]: pam_unix(sudo:session): session closed for user root Aug 26 14:29:48 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-aaa97b45-7277-4499-a58b-1d8bf52f2303 tempest-VolumesActionsTest-508015839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.300s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:29:48 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-aaa97b45-7277-4499-a58b-1d8bf52f2303 tempest-VolumesActionsTest-508015839 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:29:48 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-92f12b88-5cda-410e-93aa-b18cd25d6d97 tempest-VolumesTestJSON-788898559 None] Acquiring lock "cinder-a9cbc22c-8c32-4c91-ac0a-9b8ac0010f0c-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:29:48 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-aaa97b45-7277-4499-a58b-1d8bf52f2303 tempest-VolumesActionsTest-508015839 None] Deleted volume successfully. Aug 26 14:29:48 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-aaa97b45-7277-4499-a58b-1d8bf52f2303 tempest-VolumesActionsTest-508015839 None] Lock "cinder-f90c25e9-7f42-4b6f-8134-dd8a805804bf-delete_volume" released by "delete_volume" :: held 1.399s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:29:48 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-92f12b88-5cda-410e-93aa-b18cd25d6d97 tempest-VolumesTestJSON-788898559 None] Lock "cinder-a9cbc22c-8c32-4c91-ac0a-9b8ac0010f0c-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:29:48 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-92f12b88-5cda-410e-93aa-b18cd25d6d97 tempest-VolumesTestJSON-788898559 None] Acquiring lock "cinder-quobyte-a9cbc22c-8c32-4c91-ac0a-9b8ac0010f0c" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:29:48 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-92f12b88-5cda-410e-93aa-b18cd25d6d97 tempest-VolumesTestJSON-788898559 None] Lock "cinder-quobyte-a9cbc22c-8c32-4c91-ac0a-9b8ac0010f0c" acquired by "delete_volume" :: waited 0.035s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:29:48 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[95e4b3d4-9542-4fda-a4bd-6a2ca0a8ca1f]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:29:48 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-92f12b88-5cda-410e-93aa-b18cd25d6d97 tempest-VolumesTestJSON-788898559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-a9cbc22c-8c32-4c91-ac0a-9b8ac0010f0c {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:29:49 devstack sudo[105280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-a9cbc22c-8c32-4c91-ac0a-9b8ac0010f0c Aug 26 14:29:49 devstack sudo[105280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:29:49 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-68c40c85-60b7-4bda-ae9b-ed275fa8ea82 tempest-VolumesActionsTest-362336132 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:29:49 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-68c40c85-60b7-4bda-ae9b-ed275fa8ea82 tempest-VolumesActionsTest-362336132 None] Flow 'volume_create_manager' (da87a58c-8a1f-4ab7-a11c-ffba3e8e3dd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:29:49 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-68c40c85-60b7-4bda-ae9b-ed275fa8ea82 tempest-VolumesActionsTest-362336132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba509844-396a-4915-91b4-d212dbf9df61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:29:49 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-68c40c85-60b7-4bda-ae9b-ed275fa8ea82 tempest-VolumesActionsTest-362336132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba509844-396a-4915-91b4-d212dbf9df61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:29:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-850041086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59564465-1db3-4890-8744-2fff541bd07b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a85c881a611446280ade138453b54cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:29:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:29:49Z,use_quota=True,user_id='967c19248c35450f92db5434920581b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:29:49 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-68c40c85-60b7-4bda-ae9b-ed275fa8ea82 tempest-VolumesActionsTest-362336132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14c09543-a3ac-49a0-a91b-c00824c7e84b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:29:49 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-68c40c85-60b7-4bda-ae9b-ed275fa8ea82 tempest-VolumesActionsTest-362336132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14c09543-a3ac-49a0-a91b-c00824c7e84b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:29:49 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-68c40c85-60b7-4bda-ae9b-ed275fa8ea82 tempest-VolumesActionsTest-362336132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9eba687f-907f-4e94-bc81-153194f26ed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:29:49 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-68c40c85-60b7-4bda-ae9b-ed275fa8ea82 tempest-VolumesActionsTest-362336132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9eba687f-907f-4e94-bc81-153194f26ed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59564465-1db3-4890-8744-2fff541bd07b', 'volume_name': 'volume-59564465-1db3-4890-8744-2fff541bd07b', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:29:49 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-68c40c85-60b7-4bda-ae9b-ed275fa8ea82 tempest-VolumesActionsTest-362336132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d32b73cf-b9e0-4bd1-90fb-c158501edd84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:29:49 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-68c40c85-60b7-4bda-ae9b-ed275fa8ea82 tempest-VolumesActionsTest-362336132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d32b73cf-b9e0-4bd1-90fb-c158501edd84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:29:49 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-68c40c85-60b7-4bda-ae9b-ed275fa8ea82 tempest-VolumesActionsTest-362336132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea98ca9f-53a4-4a4e-b524-db1683433057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:29:49 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-68c40c85-60b7-4bda-ae9b-ed275fa8ea82 tempest-VolumesActionsTest-362336132 None] Volume 59564465-1db3-4890-8744-2fff541bd07b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59564465-1db3-4890-8744-2fff541bd07b', 'volume_size': 1} Aug 26 14:29:49 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-68c40c85-60b7-4bda-ae9b-ed275fa8ea82 tempest-VolumesActionsTest-362336132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:29:49 devstack sudo[105280]: pam_unix(sudo:session): session closed for user root Aug 26 14:29:49 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-92f12b88-5cda-410e-93aa-b18cd25d6d97 tempest-VolumesTestJSON-788898559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-a9cbc22c-8c32-4c91-ac0a-9b8ac0010f0c" returned: 0 in 1.120s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:29:50 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-92f12b88-5cda-410e-93aa-b18cd25d6d97 tempest-VolumesTestJSON-788898559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-a9cbc22c-8c32-4c91-ac0a-9b8ac0010f0c {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:29:50 devstack sudo[105287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-a9cbc22c-8c32-4c91-ac0a-9b8ac0010f0c Aug 26 14:29:50 devstack sudo[105287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:29:50 devstack sudo[105287]: pam_unix(sudo:session): session closed for user root Aug 26 14:29:50 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-92f12b88-5cda-410e-93aa-b18cd25d6d97 tempest-VolumesTestJSON-788898559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-a9cbc22c-8c32-4c91-ac0a-9b8ac0010f0c" returned: 0 in 0.457s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:29:50 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-92f12b88-5cda-410e-93aa-b18cd25d6d97 tempest-VolumesTestJSON-788898559 None] Lock "cinder-quobyte-a9cbc22c-8c32-4c91-ac0a-9b8ac0010f0c" released by "delete_volume" :: held 1.741s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:29:50 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-92f12b88-5cda-410e-93aa-b18cd25d6d97 tempest-VolumesTestJSON-788898559 None] Created reservations ['a7bf9e18-9687-4d3a-8f69-d52ef35aee9c', '67869f93-54dd-4874-b836-e83688f34240', 'fe73fee3-6396-4991-a8e7-b78e96b56f9e', '61efa21d-352b-4896-9fe9-85396882a2fd'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:29:50 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-9bed92ec-b5bb-4330-bf51-6e1ae498c77c tempest-BackendsCapabilitiesAdminTestsJSON-128666026 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.8208618164062, 'free_capacity_gb': 1774.8208618164062, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=94394) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Aug 26 14:29:50 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-6d0bde45-1406-4b4a-9f17-fd1e1cd804d4 tempest-BackendsCapabilitiesAdminTestsJSON-128666026 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.8208618164062, 'free_capacity_gb': 1774.8208618164062, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=94394) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Aug 26 14:29:50 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-92f12b88-5cda-410e-93aa-b18cd25d6d97 tempest-VolumesTestJSON-788898559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:29:50 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-92f12b88-5cda-410e-93aa-b18cd25d6d97 tempest-VolumesTestJSON-788898559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:29:50 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-92f12b88-5cda-410e-93aa-b18cd25d6d97 tempest-VolumesTestJSON-788898559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:29:50 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-92f12b88-5cda-410e-93aa-b18cd25d6d97 tempest-VolumesTestJSON-788898559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:29:50 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-92f12b88-5cda-410e-93aa-b18cd25d6d97 tempest-VolumesTestJSON-788898559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:29:50 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-92f12b88-5cda-410e-93aa-b18cd25d6d97 tempest-VolumesTestJSON-788898559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:29:51 devstack sudo[105290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:29:51 devstack sudo[105290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:29:51 devstack sudo[105290]: pam_unix(sudo:session): session closed for user root Aug 26 14:29:51 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-92f12b88-5cda-410e-93aa-b18cd25d6d97 tempest-VolumesTestJSON-788898559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.533s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:29:51 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-92f12b88-5cda-410e-93aa-b18cd25d6d97 tempest-VolumesTestJSON-788898559 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:29:51 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-92f12b88-5cda-410e-93aa-b18cd25d6d97 tempest-VolumesTestJSON-788898559 None] Deleted volume successfully. Aug 26 14:29:51 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-92f12b88-5cda-410e-93aa-b18cd25d6d97 tempest-VolumesTestJSON-788898559 None] Lock "cinder-a9cbc22c-8c32-4c91-ac0a-9b8ac0010f0c-delete_volume" released by "delete_volume" :: held 3.022s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:29:53 devstack sudo[105265]: pam_unix(sudo:session): session closed for user root Aug 26 14:29:53 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e60e8151-d9ea-4bf0-b2cb-cab7b05e2e65 tempest-VolumesDeleteCascade-1307048346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-09df078d-3b8e-4c8b-b9a4-d7be24705bcb /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-bcb6f9b8-5d2f-45b1-9623-5e0d087836d3" returned: 0 in 5.636s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:29:53 devstack cinder-volume[94394]: DEBUG cinder.image.image_utils [None req-e60e8151-d9ea-4bf0-b2cb-cab7b05e2e65 tempest-VolumesDeleteCascade-1307048346 None] Image conversion details: src /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-09df078d-3b8e-4c8b-b9a4-d7be24705bcb, size 1024.00 MB, duration 5.64 sec, destination /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-bcb6f9b8-5d2f-45b1-9623-5e0d087836d3 {{(pid=94394) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 14:29:53 devstack cinder-volume[94394]: INFO cinder.image.image_utils [None req-e60e8151-d9ea-4bf0-b2cb-cab7b05e2e65 tempest-VolumesDeleteCascade-1307048346 None] Converted 1024.00 MB image at 181.53 MB/s Aug 26 14:29:53 devstack cinder-volume[94394]: WARNING cinder.volume.drivers.remotefs [None req-e60e8151-d9ea-4bf0-b2cb-cab7b05e2e65 tempest-VolumesDeleteCascade-1307048346 None] /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-bcb6f9b8-5d2f-45b1-9623-5e0d087836d3 is being set with open permissions: ugo+rw Aug 26 14:29:53 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e60e8151-d9ea-4bf0-b2cb-cab7b05e2e65 tempest-VolumesDeleteCascade-1307048346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-bcb6f9b8-5d2f-45b1-9623-5e0d087836d3 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:29:53 devstack sudo[105293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-bcb6f9b8-5d2f-45b1-9623-5e0d087836d3 Aug 26 14:29:53 devstack sudo[105293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:29:53 devstack sudo[105293]: pam_unix(sudo:session): session closed for user root Aug 26 14:29:53 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e60e8151-d9ea-4bf0-b2cb-cab7b05e2e65 tempest-VolumesDeleteCascade-1307048346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-bcb6f9b8-5d2f-45b1-9623-5e0d087836d3" returned: 0 in 0.310s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:29:54 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-e60e8151-d9ea-4bf0-b2cb-cab7b05e2e65 tempest-VolumesDeleteCascade-1307048346 None] Lock "cinder-quobyte-bcb6f9b8-5d2f-45b1-9623-5e0d087836d3" released by "_copy_volume_from_snapshot" :: held 6.970s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:29:54 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-e60e8151-d9ea-4bf0-b2cb-cab7b05e2e65 tempest-VolumesDeleteCascade-1307048346 None] Lock "cinder-quobyte-86415b7c-bbd7-4f49-9dc6-5c8cf891819f-bcb6f9b8-5d2f-45b1-9623-5e0d087836d3" released by "_create_volume_from_snapshot" :: held 7.060s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:29:54 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e60e8151-d9ea-4bf0-b2cb-cab7b05e2e65 tempest-VolumesDeleteCascade-1307048346 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.091s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:29:54 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-68c40c85-60b7-4bda-ae9b-ed275fa8ea82 tempest-VolumesActionsTest-362336132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.575s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:29:54 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-68c40c85-60b7-4bda-ae9b-ed275fa8ea82 tempest-VolumesActionsTest-362336132 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:29:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-850041086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59564465-1db3-4890-8744-2fff541bd07b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a85c881a611446280ade138453b54cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:29:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:29:49Z,use_quota=True,user_id='967c19248c35450f92db5434920581b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:29:54 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-68c40c85-60b7-4bda-ae9b-ed275fa8ea82 tempest-VolumesActionsTest-362336132 None] Creating volume 59564465-1db3-4890-8744-2fff541bd07b {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:29:54 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-68c40c85-60b7-4bda-ae9b-ed275fa8ea82 tempest-VolumesActionsTest-362336132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:29:54 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-68c40c85-60b7-4bda-ae9b-ed275fa8ea82 tempest-VolumesActionsTest-362336132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:29:54 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-68c40c85-60b7-4bda-ae9b-ed275fa8ea82 tempest-VolumesActionsTest-362336132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:29:54 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-68c40c85-60b7-4bda-ae9b-ed275fa8ea82 tempest-VolumesActionsTest-362336132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:29:54 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-68c40c85-60b7-4bda-ae9b-ed275fa8ea82 tempest-VolumesActionsTest-362336132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:29:54 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-68c40c85-60b7-4bda-ae9b-ed275fa8ea82 tempest-VolumesActionsTest-362336132 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:29:54 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-68c40c85-60b7-4bda-ae9b-ed275fa8ea82 tempest-VolumesActionsTest-362336132 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:29:54 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-68c40c85-60b7-4bda-ae9b-ed275fa8ea82 tempest-VolumesActionsTest-362336132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-59564465-1db3-4890-8744-2fff541bd07b 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:29:54 devstack sudo[105296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-59564465-1db3-4890-8744-2fff541bd07b 1073741824 Aug 26 14:29:54 devstack sudo[105296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:29:54 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-e60e8151-d9ea-4bf0-b2cb-cab7b05e2e65 tempest-VolumesDeleteCascade-1307048346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f339e08-3fa2-4ce8-b04c-4c8da5ac50f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcb6f9b8-5d2f-45b1-9623-5e0d087836d3', 'volume_size': 1, 'snapshot_id': '86415b7c-bbd7-4f49-9dc6-5c8cf891819f'}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:29:54 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-e60e8151-d9ea-4bf0-b2cb-cab7b05e2e65 tempest-VolumesDeleteCascade-1307048346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80b72f07-2a8c-4939-805a-098023fbc996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:29:54 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-e60e8151-d9ea-4bf0-b2cb-cab7b05e2e65 tempest-VolumesDeleteCascade-1307048346 None] Volume volume-bcb6f9b8-5d2f-45b1-9623-5e0d087836d3 (bcb6f9b8-5d2f-45b1-9623-5e0d087836d3): created successfully Aug 26 14:29:54 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-e60e8151-d9ea-4bf0-b2cb-cab7b05e2e65 tempest-VolumesDeleteCascade-1307048346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80b72f07-2a8c-4939-805a-098023fbc996) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:29:54 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-e60e8151-d9ea-4bf0-b2cb-cab7b05e2e65 tempest-VolumesDeleteCascade-1307048346 None] Flow 'volume_create_manager' (53440627-902d-4a89-ae63-779b87d7d71d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:29:54 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-e60e8151-d9ea-4bf0-b2cb-cab7b05e2e65 tempest-VolumesDeleteCascade-1307048346 None] Created volume successfully. Aug 26 14:29:54 devstack sudo[105296]: pam_unix(sudo:session): session closed for user root Aug 26 14:29:54 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-68c40c85-60b7-4bda-ae9b-ed275fa8ea82 tempest-VolumesActionsTest-362336132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-59564465-1db3-4890-8744-2fff541bd07b 1073741824" returned: 0 in 0.527s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:29:54 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-68c40c85-60b7-4bda-ae9b-ed275fa8ea82 tempest-VolumesActionsTest-362336132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-59564465-1db3-4890-8744-2fff541bd07b {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:29:54 devstack sudo[105302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-59564465-1db3-4890-8744-2fff541bd07b Aug 26 14:29:54 devstack sudo[105302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:29:54 devstack sudo[105302]: pam_unix(sudo:session): session closed for user root Aug 26 14:29:54 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-68c40c85-60b7-4bda-ae9b-ed275fa8ea82 tempest-VolumesActionsTest-362336132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-59564465-1db3-4890-8744-2fff541bd07b" returned: 0 in 0.290s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:29:54 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-68c40c85-60b7-4bda-ae9b-ed275fa8ea82 tempest-VolumesActionsTest-362336132 None] <== create_volume: return (859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:29:54 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-68c40c85-60b7-4bda-ae9b-ed275fa8ea82 tempest-VolumesActionsTest-362336132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.867s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:29:54 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-68c40c85-60b7-4bda-ae9b-ed275fa8ea82 tempest-VolumesActionsTest-362336132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea98ca9f-53a4-4a4e-b524-db1683433057) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59564465-1db3-4890-8744-2fff541bd07b', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:29:54 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-68c40c85-60b7-4bda-ae9b-ed275fa8ea82 tempest-VolumesActionsTest-362336132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6244b34-aacb-430a-b8d2-ee277920315c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:29:54 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-1c5b6dad-ff87-488f-8c6c-4d0089e84c28 tempest-VolumesDeleteCascade-1307048346 None] Acquiring lock "cinder-09df078d-3b8e-4c8b-b9a4-d7be24705bcb-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:29:54 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-68c40c85-60b7-4bda-ae9b-ed275fa8ea82 tempest-VolumesActionsTest-362336132 None] Volume volume-59564465-1db3-4890-8744-2fff541bd07b (59564465-1db3-4890-8744-2fff541bd07b): created successfully Aug 26 14:29:54 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-68c40c85-60b7-4bda-ae9b-ed275fa8ea82 tempest-VolumesActionsTest-362336132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6244b34-aacb-430a-b8d2-ee277920315c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:29:54 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-68c40c85-60b7-4bda-ae9b-ed275fa8ea82 tempest-VolumesActionsTest-362336132 None] Flow 'volume_create_manager' (da87a58c-8a1f-4ab7-a11c-ffba3e8e3dd0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:29:55 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-1c5b6dad-ff87-488f-8c6c-4d0089e84c28 tempest-VolumesDeleteCascade-1307048346 None] Lock "cinder-09df078d-3b8e-4c8b-b9a4-d7be24705bcb-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:29:55 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-68c40c85-60b7-4bda-ae9b-ed275fa8ea82 tempest-VolumesActionsTest-362336132 None] Created volume successfully. Aug 26 14:29:55 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-1c5b6dad-ff87-488f-8c6c-4d0089e84c28 tempest-VolumesDeleteCascade-1307048346 None] Performing cascade delete. {{(pid=94394) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Aug 26 14:29:55 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-1c5b6dad-ff87-488f-8c6c-4d0089e84c28 tempest-VolumesDeleteCascade-1307048346 None] Acquiring lock "cinder-86415b7c-bbd7-4f49-9dc6-5c8cf891819f-delete_snapshot" by "delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:29:55 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-1c5b6dad-ff87-488f-8c6c-4d0089e84c28 tempest-VolumesDeleteCascade-1307048346 None] Lock "cinder-86415b7c-bbd7-4f49-9dc6-5c8cf891819f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:29:55 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-1c5b6dad-ff87-488f-8c6c-4d0089e84c28 tempest-VolumesDeleteCascade-1307048346 None] Acquiring lock "cinder-quobyte-09df078d-3b8e-4c8b-b9a4-d7be24705bcb" by "delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:29:55 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-1c5b6dad-ff87-488f-8c6c-4d0089e84c28 tempest-VolumesDeleteCascade-1307048346 None] Lock "cinder-quobyte-09df078d-3b8e-4c8b-b9a4-d7be24705bcb" acquired by "delete_snapshot" :: waited 0.019s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:29:55 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-1c5b6dad-ff87-488f-8c6c-4d0089e84c28 tempest-VolumesDeleteCascade-1307048346 None] Acquiring lock "cinder-quobyte-86415b7c-bbd7-4f49-9dc6-5c8cf891819f" by "_delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:29:55 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-1c5b6dad-ff87-488f-8c6c-4d0089e84c28 tempest-VolumesDeleteCascade-1307048346 None] Lock "cinder-quobyte-86415b7c-bbd7-4f49-9dc6-5c8cf891819f" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:29:55 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-1c5b6dad-ff87-488f-8c6c-4d0089e84c28 tempest-VolumesDeleteCascade-1307048346 None] Deleting offline snapshot 86415b7c-bbd7-4f49-9dc6-5c8cf891819f of volume 09df078d-3b8e-4c8b-b9a4-d7be24705bcb {{(pid=94394) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 14:29:55 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-1c5b6dad-ff87-488f-8c6c-4d0089e84c28 tempest-VolumesDeleteCascade-1307048346 None] snapshot_file for this snap is: volume-09df078d-3b8e-4c8b-b9a4-d7be24705bcb.86415b7c-bbd7-4f49-9dc6-5c8cf891819f {{(pid=94394) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 14:29:55 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[4163ee61-0ca6-4e0a-aa00-475307157d37]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:29:55 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-1c5b6dad-ff87-488f-8c6c-4d0089e84c28 tempest-VolumesDeleteCascade-1307048346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-09df078d-3b8e-4c8b-b9a4-d7be24705bcb.86415b7c-bbd7-4f49-9dc6-5c8cf891819f {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:29:55 devstack sudo[105305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-09df078d-3b8e-4c8b-b9a4-d7be24705bcb.86415b7c-bbd7-4f49-9dc6-5c8cf891819f Aug 26 14:29:55 devstack sudo[105305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:29:55 devstack sudo[105305]: pam_unix(sudo:session): session closed for user root Aug 26 14:29:55 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-1c5b6dad-ff87-488f-8c6c-4d0089e84c28 tempest-VolumesDeleteCascade-1307048346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-09df078d-3b8e-4c8b-b9a4-d7be24705bcb.86415b7c-bbd7-4f49-9dc6-5c8cf891819f" returned: 0 in 0.398s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:29:55 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-1c5b6dad-ff87-488f-8c6c-4d0089e84c28 tempest-VolumesDeleteCascade-1307048346 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-09df078d-3b8e-4c8b-b9a4-d7be24705bcb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94394) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 14:29:55 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ab6514b-7a46-4c98-b4ca-8760d67c1d67]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:29:55 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-1c5b6dad-ff87-488f-8c6c-4d0089e84c28 tempest-VolumesDeleteCascade-1307048346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-09df078d-3b8e-4c8b-b9a4-d7be24705bcb {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:29:55 devstack sudo[105310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-09df078d-3b8e-4c8b-b9a4-d7be24705bcb Aug 26 14:29:55 devstack sudo[105310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:29:56 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-026cb741-acf3-4fec-861e-13a108c53b63 tempest-VolumesActionsTest-508015839 None] Acquiring lock "cinder-59564465-1db3-4890-8744-2fff541bd07b-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:29:56 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-026cb741-acf3-4fec-861e-13a108c53b63 tempest-VolumesActionsTest-508015839 None] Lock "cinder-59564465-1db3-4890-8744-2fff541bd07b-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:29:56 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-026cb741-acf3-4fec-861e-13a108c53b63 tempest-VolumesActionsTest-508015839 None] Acquiring lock "cinder-quobyte-59564465-1db3-4890-8744-2fff541bd07b" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:29:56 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-026cb741-acf3-4fec-861e-13a108c53b63 tempest-VolumesActionsTest-508015839 None] Lock "cinder-quobyte-59564465-1db3-4890-8744-2fff541bd07b" acquired by "delete_volume" :: waited 0.020s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:29:56 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[7af4bbb1-3b7c-4e72-876b-6e5c318ad2a3]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:29:56 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-026cb741-acf3-4fec-861e-13a108c53b63 tempest-VolumesActionsTest-508015839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-59564465-1db3-4890-8744-2fff541bd07b {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:29:56 devstack sudo[105310]: pam_unix(sudo:session): session closed for user root Aug 26 14:29:56 devstack sudo[105315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-59564465-1db3-4890-8744-2fff541bd07b Aug 26 14:29:56 devstack sudo[105315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:29:56 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-1c5b6dad-ff87-488f-8c6c-4d0089e84c28 tempest-VolumesDeleteCascade-1307048346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-09df078d-3b8e-4c8b-b9a4-d7be24705bcb" returned: 0 in 0.779s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:29:56 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-1c5b6dad-ff87-488f-8c6c-4d0089e84c28 tempest-VolumesDeleteCascade-1307048346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-09df078d-3b8e-4c8b-b9a4-d7be24705bcb.86415b7c-bbd7-4f49-9dc6-5c8cf891819f {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:29:56 devstack sudo[105318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-09df078d-3b8e-4c8b-b9a4-d7be24705bcb.86415b7c-bbd7-4f49-9dc6-5c8cf891819f Aug 26 14:29:56 devstack sudo[105318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:29:56 devstack sudo[105315]: pam_unix(sudo:session): session closed for user root Aug 26 14:29:56 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-026cb741-acf3-4fec-861e-13a108c53b63 tempest-VolumesActionsTest-508015839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-59564465-1db3-4890-8744-2fff541bd07b" returned: 0 in 0.441s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:29:56 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-026cb741-acf3-4fec-861e-13a108c53b63 tempest-VolumesActionsTest-508015839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-59564465-1db3-4890-8744-2fff541bd07b {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:29:56 devstack sudo[105326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-59564465-1db3-4890-8744-2fff541bd07b Aug 26 14:29:56 devstack sudo[105326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:29:56 devstack sudo[105318]: pam_unix(sudo:session): session closed for user root Aug 26 14:29:56 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-1c5b6dad-ff87-488f-8c6c-4d0089e84c28 tempest-VolumesDeleteCascade-1307048346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-09df078d-3b8e-4c8b-b9a4-d7be24705bcb.86415b7c-bbd7-4f49-9dc6-5c8cf891819f" returned: 0 in 0.447s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:29:56 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-1c5b6dad-ff87-488f-8c6c-4d0089e84c28 tempest-VolumesDeleteCascade-1307048346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-09df078d-3b8e-4c8b-b9a4-d7be24705bcb.86415b7c-bbd7-4f49-9dc6-5c8cf891819f {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:29:56 devstack sudo[105330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-09df078d-3b8e-4c8b-b9a4-d7be24705bcb.86415b7c-bbd7-4f49-9dc6-5c8cf891819f Aug 26 14:29:56 devstack sudo[105330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:29:57 devstack sudo[105326]: pam_unix(sudo:session): session closed for user root Aug 26 14:29:57 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-026cb741-acf3-4fec-861e-13a108c53b63 tempest-VolumesActionsTest-508015839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-59564465-1db3-4890-8744-2fff541bd07b" returned: 0 in 0.330s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:29:57 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-026cb741-acf3-4fec-861e-13a108c53b63 tempest-VolumesActionsTest-508015839 None] Lock "cinder-quobyte-59564465-1db3-4890-8744-2fff541bd07b" released by "delete_volume" :: held 0.825s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:29:57 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-026cb741-acf3-4fec-861e-13a108c53b63 tempest-VolumesActionsTest-508015839 None] Created reservations ['982c8ec3-9b93-4364-94ce-09412e6d5546', '1673f658-cef8-43fc-ae46-4bfad412ca64', '82499461-a2f2-46aa-bbf5-40c44aa0db1d', '237c898f-7bbd-47a6-8cdc-7dceee9a71bd'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:29:57 devstack sudo[105330]: pam_unix(sudo:session): session closed for user root Aug 26 14:29:57 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-1c5b6dad-ff87-488f-8c6c-4d0089e84c28 tempest-VolumesDeleteCascade-1307048346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-09df078d-3b8e-4c8b-b9a4-d7be24705bcb.86415b7c-bbd7-4f49-9dc6-5c8cf891819f" returned: 0 in 0.329s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:29:57 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-1c5b6dad-ff87-488f-8c6c-4d0089e84c28 tempest-VolumesDeleteCascade-1307048346 None] Lock "cinder-quobyte-86415b7c-bbd7-4f49-9dc6-5c8cf891819f" released by "_delete_snapshot" :: held 2.081s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:29:57 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-1c5b6dad-ff87-488f-8c6c-4d0089e84c28 tempest-VolumesDeleteCascade-1307048346 None] Lock "cinder-quobyte-09df078d-3b8e-4c8b-b9a4-d7be24705bcb" released by "delete_snapshot" :: held 2.123s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:29:57 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-026cb741-acf3-4fec-861e-13a108c53b63 tempest-VolumesActionsTest-508015839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:29:57 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-026cb741-acf3-4fec-861e-13a108c53b63 tempest-VolumesActionsTest-508015839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:29:57 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-026cb741-acf3-4fec-861e-13a108c53b63 tempest-VolumesActionsTest-508015839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:29:57 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-026cb741-acf3-4fec-861e-13a108c53b63 tempest-VolumesActionsTest-508015839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:29:57 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-026cb741-acf3-4fec-861e-13a108c53b63 tempest-VolumesActionsTest-508015839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:29:57 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-026cb741-acf3-4fec-861e-13a108c53b63 tempest-VolumesActionsTest-508015839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:29:57 devstack sudo[105334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:29:57 devstack sudo[105334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:29:57 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-1c5b6dad-ff87-488f-8c6c-4d0089e84c28 tempest-VolumesDeleteCascade-1307048346 None] Created reservations ['60184a64-3acd-4b7a-b6a2-a6623c1a3982', '16605d5b-2bfb-4bc0-9c85-05a7598bcc72', 'dfec4586-d30c-470f-948e-874a5d580550', 'ce5a744a-a3d2-4f38-8aef-ae85f151c22b'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:29:57 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-1c5b6dad-ff87-488f-8c6c-4d0089e84c28 tempest-VolumesDeleteCascade-1307048346 None] Delete snapshot completed successfully. Aug 26 14:29:57 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-1c5b6dad-ff87-488f-8c6c-4d0089e84c28 tempest-VolumesDeleteCascade-1307048346 None] Lock "cinder-86415b7c-bbd7-4f49-9dc6-5c8cf891819f-delete_snapshot" released by "delete_snapshot" :: held 2.431s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:29:57 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-1c5b6dad-ff87-488f-8c6c-4d0089e84c28 tempest-VolumesDeleteCascade-1307048346 None] Snapshots deleted, issuing volume delete {{(pid=94394) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Aug 26 14:29:57 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-1c5b6dad-ff87-488f-8c6c-4d0089e84c28 tempest-VolumesDeleteCascade-1307048346 None] Acquiring lock "cinder-quobyte-09df078d-3b8e-4c8b-b9a4-d7be24705bcb" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:29:57 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-1c5b6dad-ff87-488f-8c6c-4d0089e84c28 tempest-VolumesDeleteCascade-1307048346 None] Lock "cinder-quobyte-09df078d-3b8e-4c8b-b9a4-d7be24705bcb" acquired by "delete_volume" :: waited 0.035s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:29:57 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb66d274-b150-4a87-9fe4-d1d255175f36]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:29:57 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-1c5b6dad-ff87-488f-8c6c-4d0089e84c28 tempest-VolumesDeleteCascade-1307048346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-09df078d-3b8e-4c8b-b9a4-d7be24705bcb {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:29:57 devstack sudo[105334]: pam_unix(sudo:session): session closed for user root Aug 26 14:29:57 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-026cb741-acf3-4fec-861e-13a108c53b63 tempest-VolumesActionsTest-508015839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.367s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:29:57 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-026cb741-acf3-4fec-861e-13a108c53b63 tempest-VolumesActionsTest-508015839 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:29:57 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-026cb741-acf3-4fec-861e-13a108c53b63 tempest-VolumesActionsTest-508015839 None] Deleted volume successfully. Aug 26 14:29:57 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-026cb741-acf3-4fec-861e-13a108c53b63 tempest-VolumesActionsTest-508015839 None] Lock "cinder-59564465-1db3-4890-8744-2fff541bd07b-delete_volume" released by "delete_volume" :: held 1.573s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:29:57 devstack sudo[105337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-09df078d-3b8e-4c8b-b9a4-d7be24705bcb Aug 26 14:29:57 devstack sudo[105337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:29:58 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b2f98b7-e679-4f4a-bd42-38cf49d38275 tempest-VolumesActionsTest-362336132 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:29:58 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-2b2f98b7-e679-4f4a-bd42-38cf49d38275 tempest-VolumesActionsTest-362336132 None] Flow 'volume_create_manager' (0b398017-da6b-4c64-b988-758d79c197c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:29:58 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-2b2f98b7-e679-4f4a-bd42-38cf49d38275 tempest-VolumesActionsTest-362336132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8a108ed-69ca-4495-a50c-5fed369c430a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:29:58 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-2b2f98b7-e679-4f4a-bd42-38cf49d38275 tempest-VolumesActionsTest-362336132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8a108ed-69ca-4495-a50c-5fed369c430a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:29:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-862625616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ce11082-b2e8-4c76-894c-3b0fe2a0175f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a85c881a611446280ade138453b54cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:29:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:29:58Z,use_quota=True,user_id='967c19248c35450f92db5434920581b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:29:58 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-2b2f98b7-e679-4f4a-bd42-38cf49d38275 tempest-VolumesActionsTest-362336132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddd0f9a0-9f94-4849-bd99-3a2db8dccbb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:29:58 devstack sudo[105337]: pam_unix(sudo:session): session closed for user root Aug 26 14:29:58 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-2b2f98b7-e679-4f4a-bd42-38cf49d38275 tempest-VolumesActionsTest-362336132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddd0f9a0-9f94-4849-bd99-3a2db8dccbb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:29:58 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-2b2f98b7-e679-4f4a-bd42-38cf49d38275 tempest-VolumesActionsTest-362336132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b26b590c-593f-47f2-ac28-742f7575b918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:29:58 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-2b2f98b7-e679-4f4a-bd42-38cf49d38275 tempest-VolumesActionsTest-362336132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b26b590c-593f-47f2-ac28-742f7575b918) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ce11082-b2e8-4c76-894c-3b0fe2a0175f', 'volume_name': 'volume-0ce11082-b2e8-4c76-894c-3b0fe2a0175f', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:29:58 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-2b2f98b7-e679-4f4a-bd42-38cf49d38275 tempest-VolumesActionsTest-362336132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5527b78-8cbe-4878-80af-2cffad0ccb15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:29:58 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-2b2f98b7-e679-4f4a-bd42-38cf49d38275 tempest-VolumesActionsTest-362336132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5527b78-8cbe-4878-80af-2cffad0ccb15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:29:58 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-2b2f98b7-e679-4f4a-bd42-38cf49d38275 tempest-VolumesActionsTest-362336132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08753d20-2fc7-4cf9-9df2-270816a0f7b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:29:58 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-2b2f98b7-e679-4f4a-bd42-38cf49d38275 tempest-VolumesActionsTest-362336132 None] Volume 0ce11082-b2e8-4c76-894c-3b0fe2a0175f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ce11082-b2e8-4c76-894c-3b0fe2a0175f', 'volume_size': 1} Aug 26 14:29:58 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-2b2f98b7-e679-4f4a-bd42-38cf49d38275 tempest-VolumesActionsTest-362336132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:29:58 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-2b2f98b7-e679-4f4a-bd42-38cf49d38275 tempest-VolumesActionsTest-362336132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:29:58 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-2b2f98b7-e679-4f4a-bd42-38cf49d38275 tempest-VolumesActionsTest-362336132 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:29:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-862625616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ce11082-b2e8-4c76-894c-3b0fe2a0175f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a85c881a611446280ade138453b54cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:29:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:29:58Z,use_quota=True,user_id='967c19248c35450f92db5434920581b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:29:58 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-2b2f98b7-e679-4f4a-bd42-38cf49d38275 tempest-VolumesActionsTest-362336132 None] Creating volume 0ce11082-b2e8-4c76-894c-3b0fe2a0175f {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:29:58 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-2b2f98b7-e679-4f4a-bd42-38cf49d38275 tempest-VolumesActionsTest-362336132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:29:58 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-2b2f98b7-e679-4f4a-bd42-38cf49d38275 tempest-VolumesActionsTest-362336132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:29:58 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-2b2f98b7-e679-4f4a-bd42-38cf49d38275 tempest-VolumesActionsTest-362336132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:29:58 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-2b2f98b7-e679-4f4a-bd42-38cf49d38275 tempest-VolumesActionsTest-362336132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:29:58 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-2b2f98b7-e679-4f4a-bd42-38cf49d38275 tempest-VolumesActionsTest-362336132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:29:58 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-2b2f98b7-e679-4f4a-bd42-38cf49d38275 tempest-VolumesActionsTest-362336132 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:29:58 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-2b2f98b7-e679-4f4a-bd42-38cf49d38275 tempest-VolumesActionsTest-362336132 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:29:58 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-2b2f98b7-e679-4f4a-bd42-38cf49d38275 tempest-VolumesActionsTest-362336132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0ce11082-b2e8-4c76-894c-3b0fe2a0175f 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:29:58 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-1c5b6dad-ff87-488f-8c6c-4d0089e84c28 tempest-VolumesDeleteCascade-1307048346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-09df078d-3b8e-4c8b-b9a4-d7be24705bcb" returned: 0 in 0.612s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:29:58 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-1c5b6dad-ff87-488f-8c6c-4d0089e84c28 tempest-VolumesDeleteCascade-1307048346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-09df078d-3b8e-4c8b-b9a4-d7be24705bcb {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:29:58 devstack sudo[105342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0ce11082-b2e8-4c76-894c-3b0fe2a0175f 1073741824 Aug 26 14:29:58 devstack sudo[105342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:29:58 devstack sudo[105343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-09df078d-3b8e-4c8b-b9a4-d7be24705bcb Aug 26 14:29:58 devstack sudo[105343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:29:58 devstack sudo[105343]: pam_unix(sudo:session): session closed for user root Aug 26 14:29:58 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-1c5b6dad-ff87-488f-8c6c-4d0089e84c28 tempest-VolumesDeleteCascade-1307048346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-09df078d-3b8e-4c8b-b9a4-d7be24705bcb" returned: 0 in 0.293s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:29:58 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-1c5b6dad-ff87-488f-8c6c-4d0089e84c28 tempest-VolumesDeleteCascade-1307048346 None] Lock "cinder-quobyte-09df078d-3b8e-4c8b-b9a4-d7be24705bcb" released by "delete_volume" :: held 1.004s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:29:58 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-1c5b6dad-ff87-488f-8c6c-4d0089e84c28 tempest-VolumesDeleteCascade-1307048346 None] Created reservations ['18c2c6a4-d435-41e0-be5c-a8a0daebef65', 'e1c8a4af-3b34-486e-82cb-a06c17c35991', 'b0cf5628-7179-4a59-bad7-ac9118b20e5f', 'ba058a2b-4ae5-4042-b669-80457036b7ac'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:29:58 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-1c5b6dad-ff87-488f-8c6c-4d0089e84c28 tempest-VolumesDeleteCascade-1307048346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:29:58 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-1c5b6dad-ff87-488f-8c6c-4d0089e84c28 tempest-VolumesDeleteCascade-1307048346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:29:58 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-1c5b6dad-ff87-488f-8c6c-4d0089e84c28 tempest-VolumesDeleteCascade-1307048346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:29:58 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-1c5b6dad-ff87-488f-8c6c-4d0089e84c28 tempest-VolumesDeleteCascade-1307048346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:29:58 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-1c5b6dad-ff87-488f-8c6c-4d0089e84c28 tempest-VolumesDeleteCascade-1307048346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:29:58 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-1c5b6dad-ff87-488f-8c6c-4d0089e84c28 tempest-VolumesDeleteCascade-1307048346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:29:58 devstack sudo[105342]: pam_unix(sudo:session): session closed for user root Aug 26 14:29:58 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-2b2f98b7-e679-4f4a-bd42-38cf49d38275 tempest-VolumesActionsTest-362336132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0ce11082-b2e8-4c76-894c-3b0fe2a0175f 1073741824" returned: 0 in 0.595s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:29:58 devstack sudo[105351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:29:58 devstack sudo[105351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:29:58 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-2b2f98b7-e679-4f4a-bd42-38cf49d38275 tempest-VolumesActionsTest-362336132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0ce11082-b2e8-4c76-894c-3b0fe2a0175f {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:29:58 devstack sudo[105353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0ce11082-b2e8-4c76-894c-3b0fe2a0175f Aug 26 14:29:58 devstack sudo[105353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:29:59 devstack sudo[105351]: pam_unix(sudo:session): session closed for user root Aug 26 14:29:59 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-1c5b6dad-ff87-488f-8c6c-4d0089e84c28 tempest-VolumesDeleteCascade-1307048346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.277s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:29:59 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-1c5b6dad-ff87-488f-8c6c-4d0089e84c28 tempest-VolumesDeleteCascade-1307048346 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:29:59 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-1c5b6dad-ff87-488f-8c6c-4d0089e84c28 tempest-VolumesDeleteCascade-1307048346 None] Deleted volume successfully. Aug 26 14:29:59 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-1c5b6dad-ff87-488f-8c6c-4d0089e84c28 tempest-VolumesDeleteCascade-1307048346 None] Lock "cinder-09df078d-3b8e-4c8b-b9a4-d7be24705bcb-delete_volume" released by "delete_volume" :: held 4.127s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:29:59 devstack sudo[105353]: pam_unix(sudo:session): session closed for user root Aug 26 14:29:59 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-2b2f98b7-e679-4f4a-bd42-38cf49d38275 tempest-VolumesActionsTest-362336132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0ce11082-b2e8-4c76-894c-3b0fe2a0175f" returned: 0 in 0.332s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:29:59 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-2b2f98b7-e679-4f4a-bd42-38cf49d38275 tempest-VolumesActionsTest-362336132 None] <== create_volume: return (981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:29:59 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-2b2f98b7-e679-4f4a-bd42-38cf49d38275 tempest-VolumesActionsTest-362336132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.984s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:29:59 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-2b2f98b7-e679-4f4a-bd42-38cf49d38275 tempest-VolumesActionsTest-362336132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08753d20-2fc7-4cf9-9df2-270816a0f7b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ce11082-b2e8-4c76-894c-3b0fe2a0175f', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:29:59 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-2b2f98b7-e679-4f4a-bd42-38cf49d38275 tempest-VolumesActionsTest-362336132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b33481da-126d-4ee7-9f94-cfd7f9a7df5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:29:59 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-2b2f98b7-e679-4f4a-bd42-38cf49d38275 tempest-VolumesActionsTest-362336132 None] Volume volume-0ce11082-b2e8-4c76-894c-3b0fe2a0175f (0ce11082-b2e8-4c76-894c-3b0fe2a0175f): created successfully Aug 26 14:29:59 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-2b2f98b7-e679-4f4a-bd42-38cf49d38275 tempest-VolumesActionsTest-362336132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b33481da-126d-4ee7-9f94-cfd7f9a7df5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:29:59 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-2b2f98b7-e679-4f4a-bd42-38cf49d38275 tempest-VolumesActionsTest-362336132 None] Flow 'volume_create_manager' (0b398017-da6b-4c64-b988-758d79c197c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:29:59 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-2b2f98b7-e679-4f4a-bd42-38cf49d38275 tempest-VolumesActionsTest-362336132 None] Created volume successfully. Aug 26 14:29:59 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-0f472a53-ec36-426c-96fd-73ca7e941620 tempest-VolumesDeleteCascade-1307048346 None] Acquiring lock "cinder-bcb6f9b8-5d2f-45b1-9623-5e0d087836d3-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:29:59 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-0f472a53-ec36-426c-96fd-73ca7e941620 tempest-VolumesDeleteCascade-1307048346 None] Lock "cinder-bcb6f9b8-5d2f-45b1-9623-5e0d087836d3-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:29:59 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-0f472a53-ec36-426c-96fd-73ca7e941620 tempest-VolumesDeleteCascade-1307048346 None] Acquiring lock "cinder-quobyte-bcb6f9b8-5d2f-45b1-9623-5e0d087836d3" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:29:59 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-0f472a53-ec36-426c-96fd-73ca7e941620 tempest-VolumesDeleteCascade-1307048346 None] Lock "cinder-quobyte-bcb6f9b8-5d2f-45b1-9623-5e0d087836d3" acquired by "delete_volume" :: waited 0.022s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:29:59 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a11156d-780f-4c5c-a2c3-be6b5e0c9dc3]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:29:59 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-0f472a53-ec36-426c-96fd-73ca7e941620 tempest-VolumesDeleteCascade-1307048346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-bcb6f9b8-5d2f-45b1-9623-5e0d087836d3 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:29:59 devstack sudo[105357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-bcb6f9b8-5d2f-45b1-9623-5e0d087836d3 Aug 26 14:29:59 devstack sudo[105357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:00 devstack sudo[105357]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:00 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-0f472a53-ec36-426c-96fd-73ca7e941620 tempest-VolumesDeleteCascade-1307048346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-bcb6f9b8-5d2f-45b1-9623-5e0d087836d3" returned: 0 in 0.460s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:00 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-0f472a53-ec36-426c-96fd-73ca7e941620 tempest-VolumesDeleteCascade-1307048346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-bcb6f9b8-5d2f-45b1-9623-5e0d087836d3 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:00 devstack sudo[105363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-bcb6f9b8-5d2f-45b1-9623-5e0d087836d3 Aug 26 14:30:00 devstack sudo[105363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:00 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-76ef5d28-083d-4c57-b998-cf56aa6f4450 tempest-VolumesActionsTest-508015839 None] Acquiring lock "cinder-0ce11082-b2e8-4c76-894c-3b0fe2a0175f-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:30:00 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-76ef5d28-083d-4c57-b998-cf56aa6f4450 tempest-VolumesActionsTest-508015839 None] Lock "cinder-0ce11082-b2e8-4c76-894c-3b0fe2a0175f-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:30:00 devstack sudo[105363]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:00 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-0f472a53-ec36-426c-96fd-73ca7e941620 tempest-VolumesDeleteCascade-1307048346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-bcb6f9b8-5d2f-45b1-9623-5e0d087836d3" returned: 0 in 0.343s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:00 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-0f472a53-ec36-426c-96fd-73ca7e941620 tempest-VolumesDeleteCascade-1307048346 None] Lock "cinder-quobyte-bcb6f9b8-5d2f-45b1-9623-5e0d087836d3" released by "delete_volume" :: held 0.861s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:30:00 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-76ef5d28-083d-4c57-b998-cf56aa6f4450 tempest-VolumesActionsTest-508015839 None] Acquiring lock "cinder-quobyte-0ce11082-b2e8-4c76-894c-3b0fe2a0175f" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:30:00 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-76ef5d28-083d-4c57-b998-cf56aa6f4450 tempest-VolumesActionsTest-508015839 None] Lock "cinder-quobyte-0ce11082-b2e8-4c76-894c-3b0fe2a0175f" acquired by "delete_volume" :: waited 0.027s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:30:00 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[50dac6f1-d81b-433f-8ec5-4c5d597084bd]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:30:00 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-76ef5d28-083d-4c57-b998-cf56aa6f4450 tempest-VolumesActionsTest-508015839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0ce11082-b2e8-4c76-894c-3b0fe2a0175f {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:00 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-0f472a53-ec36-426c-96fd-73ca7e941620 tempest-VolumesDeleteCascade-1307048346 None] Created reservations ['267e37f1-637c-424f-b717-0f6fd01ae5f6', '50d2f674-b8b4-4d3b-8fc7-4129b887a2ac', '7e9c8f40-55ee-4538-b480-ae3478e555ed', 'bd923ae3-c90e-4fb8-9e8d-14f24f4aaa22'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:30:00 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-0f472a53-ec36-426c-96fd-73ca7e941620 tempest-VolumesDeleteCascade-1307048346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:30:00 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-0f472a53-ec36-426c-96fd-73ca7e941620 tempest-VolumesDeleteCascade-1307048346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:30:00 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-0f472a53-ec36-426c-96fd-73ca7e941620 tempest-VolumesDeleteCascade-1307048346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:30:00 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-0f472a53-ec36-426c-96fd-73ca7e941620 tempest-VolumesDeleteCascade-1307048346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:30:00 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-0f472a53-ec36-426c-96fd-73ca7e941620 tempest-VolumesDeleteCascade-1307048346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:30:00 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-0f472a53-ec36-426c-96fd-73ca7e941620 tempest-VolumesDeleteCascade-1307048346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:00 devstack sudo[105366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0ce11082-b2e8-4c76-894c-3b0fe2a0175f Aug 26 14:30:00 devstack sudo[105366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:00 devstack sudo[105368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:30:00 devstack sudo[105368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:01 devstack sudo[105368]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:01 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-0f472a53-ec36-426c-96fd-73ca7e941620 tempest-VolumesDeleteCascade-1307048346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.411s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:01 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-0f472a53-ec36-426c-96fd-73ca7e941620 tempest-VolumesDeleteCascade-1307048346 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:30:01 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-0f472a53-ec36-426c-96fd-73ca7e941620 tempest-VolumesDeleteCascade-1307048346 None] Deleted volume successfully. Aug 26 14:30:01 devstack sudo[105366]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:01 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-0f472a53-ec36-426c-96fd-73ca7e941620 tempest-VolumesDeleteCascade-1307048346 None] Lock "cinder-bcb6f9b8-5d2f-45b1-9623-5e0d087836d3-delete_volume" released by "delete_volume" :: held 1.624s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:30:01 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-76ef5d28-083d-4c57-b998-cf56aa6f4450 tempest-VolumesActionsTest-508015839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0ce11082-b2e8-4c76-894c-3b0fe2a0175f" returned: 0 in 0.589s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:01 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-76ef5d28-083d-4c57-b998-cf56aa6f4450 tempest-VolumesActionsTest-508015839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0ce11082-b2e8-4c76-894c-3b0fe2a0175f {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:01 devstack sudo[105374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0ce11082-b2e8-4c76-894c-3b0fe2a0175f Aug 26 14:30:01 devstack sudo[105374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:01 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-039b3dd9-7188-4605-b116-57f283f79bad tempest-VolumeQuotasAdminTestJSON-861603968 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:30:01 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-039b3dd9-7188-4605-b116-57f283f79bad tempest-VolumeQuotasAdminTestJSON-861603968 None] Flow 'volume_create_manager' (9689c6ce-3fab-4d02-a401-2cfa83fbf091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:30:01 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-039b3dd9-7188-4605-b116-57f283f79bad tempest-VolumeQuotasAdminTestJSON-861603968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75d28e05-d135-404b-9699-bebed00bfd31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:30:01 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-039b3dd9-7188-4605-b116-57f283f79bad tempest-VolumeQuotasAdminTestJSON-861603968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75d28e05-d135-404b-9699-bebed00bfd31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:30:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1308001362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5378e7cb-bc82-486a-98fe-f23606f08170,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06a9ba5d4049477bb7b14438de729193',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:30:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:30:01Z,use_quota=True,user_id='cc4331b614674512ada2443b0a5a16b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:30:01 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-039b3dd9-7188-4605-b116-57f283f79bad tempest-VolumeQuotasAdminTestJSON-861603968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adbfd69c-41b7-4c37-b9c5-a13ae3fc04b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:30:01 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-039b3dd9-7188-4605-b116-57f283f79bad tempest-VolumeQuotasAdminTestJSON-861603968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adbfd69c-41b7-4c37-b9c5-a13ae3fc04b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:30:01 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-039b3dd9-7188-4605-b116-57f283f79bad tempest-VolumeQuotasAdminTestJSON-861603968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82b5f055-1fec-4d51-88b5-de84a19cb250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:30:01 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-039b3dd9-7188-4605-b116-57f283f79bad tempest-VolumeQuotasAdminTestJSON-861603968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82b5f055-1fec-4d51-88b5-de84a19cb250) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5378e7cb-bc82-486a-98fe-f23606f08170', 'volume_name': 'volume-5378e7cb-bc82-486a-98fe-f23606f08170', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:30:01 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-039b3dd9-7188-4605-b116-57f283f79bad tempest-VolumeQuotasAdminTestJSON-861603968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65ba5d93-4bfc-4aa1-a0be-1902f7c29a0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:30:01 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-039b3dd9-7188-4605-b116-57f283f79bad tempest-VolumeQuotasAdminTestJSON-861603968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65ba5d93-4bfc-4aa1-a0be-1902f7c29a0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:30:01 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-039b3dd9-7188-4605-b116-57f283f79bad tempest-VolumeQuotasAdminTestJSON-861603968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74bfc31b-9b0c-4ed3-b25b-472075751dcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:30:01 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-039b3dd9-7188-4605-b116-57f283f79bad tempest-VolumeQuotasAdminTestJSON-861603968 None] Volume 5378e7cb-bc82-486a-98fe-f23606f08170: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5378e7cb-bc82-486a-98fe-f23606f08170', 'volume_size': 1} Aug 26 14:30:01 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-039b3dd9-7188-4605-b116-57f283f79bad tempest-VolumeQuotasAdminTestJSON-861603968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:30:01 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-039b3dd9-7188-4605-b116-57f283f79bad tempest-VolumeQuotasAdminTestJSON-861603968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:30:01 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-039b3dd9-7188-4605-b116-57f283f79bad tempest-VolumeQuotasAdminTestJSON-861603968 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:30:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1308001362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5378e7cb-bc82-486a-98fe-f23606f08170,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06a9ba5d4049477bb7b14438de729193',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:30:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:30:01Z,use_quota=True,user_id='cc4331b614674512ada2443b0a5a16b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:30:01 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-039b3dd9-7188-4605-b116-57f283f79bad tempest-VolumeQuotasAdminTestJSON-861603968 None] Creating volume 5378e7cb-bc82-486a-98fe-f23606f08170 {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:30:01 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-039b3dd9-7188-4605-b116-57f283f79bad tempest-VolumeQuotasAdminTestJSON-861603968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:30:01 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-039b3dd9-7188-4605-b116-57f283f79bad tempest-VolumeQuotasAdminTestJSON-861603968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:30:01 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-039b3dd9-7188-4605-b116-57f283f79bad tempest-VolumeQuotasAdminTestJSON-861603968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:30:01 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-039b3dd9-7188-4605-b116-57f283f79bad tempest-VolumeQuotasAdminTestJSON-861603968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:30:01 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-039b3dd9-7188-4605-b116-57f283f79bad tempest-VolumeQuotasAdminTestJSON-861603968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:30:01 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-039b3dd9-7188-4605-b116-57f283f79bad tempest-VolumeQuotasAdminTestJSON-861603968 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:30:01 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-039b3dd9-7188-4605-b116-57f283f79bad tempest-VolumeQuotasAdminTestJSON-861603968 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:30:01 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-039b3dd9-7188-4605-b116-57f283f79bad tempest-VolumeQuotasAdminTestJSON-861603968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5378e7cb-bc82-486a-98fe-f23606f08170 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:01 devstack sudo[105376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5378e7cb-bc82-486a-98fe-f23606f08170 1073741824 Aug 26 14:30:01 devstack sudo[105376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:01 devstack sudo[105374]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:01 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-76ef5d28-083d-4c57-b998-cf56aa6f4450 tempest-VolumesActionsTest-508015839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0ce11082-b2e8-4c76-894c-3b0fe2a0175f" returned: 0 in 0.303s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:01 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-76ef5d28-083d-4c57-b998-cf56aa6f4450 tempest-VolumesActionsTest-508015839 None] Lock "cinder-quobyte-0ce11082-b2e8-4c76-894c-3b0fe2a0175f" released by "delete_volume" :: held 0.951s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:30:01 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-76ef5d28-083d-4c57-b998-cf56aa6f4450 tempest-VolumesActionsTest-508015839 None] Created reservations ['1b22a5a3-445f-48d1-92a3-0a16a951583c', '03d33ea9-1d23-4ba6-a72e-31fa850f1590', 'a2d8b5b2-0bf5-41bb-8ffe-4fb3519e7b1c', 'd1e8608b-dfff-4972-aa1b-8040cbb1c64c'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:30:01 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-76ef5d28-083d-4c57-b998-cf56aa6f4450 tempest-VolumesActionsTest-508015839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:30:01 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-76ef5d28-083d-4c57-b998-cf56aa6f4450 tempest-VolumesActionsTest-508015839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:30:01 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-76ef5d28-083d-4c57-b998-cf56aa6f4450 tempest-VolumesActionsTest-508015839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:30:01 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-76ef5d28-083d-4c57-b998-cf56aa6f4450 tempest-VolumesActionsTest-508015839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:30:01 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-76ef5d28-083d-4c57-b998-cf56aa6f4450 tempest-VolumesActionsTest-508015839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:30:01 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-76ef5d28-083d-4c57-b998-cf56aa6f4450 tempest-VolumesActionsTest-508015839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:01 devstack sudo[105379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:30:01 devstack sudo[105379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:02 devstack sudo[105379]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:02 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-76ef5d28-083d-4c57-b998-cf56aa6f4450 tempest-VolumesActionsTest-508015839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.288s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:02 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-76ef5d28-083d-4c57-b998-cf56aa6f4450 tempest-VolumesActionsTest-508015839 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:30:02 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-76ef5d28-083d-4c57-b998-cf56aa6f4450 tempest-VolumesActionsTest-508015839 None] Deleted volume successfully. Aug 26 14:30:02 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-76ef5d28-083d-4c57-b998-cf56aa6f4450 tempest-VolumesActionsTest-508015839 None] Lock "cinder-0ce11082-b2e8-4c76-894c-3b0fe2a0175f-delete_volume" released by "delete_volume" :: held 1.570s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:30:02 devstack sudo[105376]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:02 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-039b3dd9-7188-4605-b116-57f283f79bad tempest-VolumeQuotasAdminTestJSON-861603968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5378e7cb-bc82-486a-98fe-f23606f08170 1073741824" returned: 0 in 0.612s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:02 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-039b3dd9-7188-4605-b116-57f283f79bad tempest-VolumeQuotasAdminTestJSON-861603968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5378e7cb-bc82-486a-98fe-f23606f08170 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:02 devstack sudo[105386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5378e7cb-bc82-486a-98fe-f23606f08170 Aug 26 14:30:02 devstack sudo[105386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:02 devstack sudo[105386]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:02 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-039b3dd9-7188-4605-b116-57f283f79bad tempest-VolumeQuotasAdminTestJSON-861603968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5378e7cb-bc82-486a-98fe-f23606f08170" returned: 0 in 0.304s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:02 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-039b3dd9-7188-4605-b116-57f283f79bad tempest-VolumeQuotasAdminTestJSON-861603968 None] <== create_volume: return (968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:30:02 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-039b3dd9-7188-4605-b116-57f283f79bad tempest-VolumeQuotasAdminTestJSON-861603968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.971s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:30:02 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-039b3dd9-7188-4605-b116-57f283f79bad tempest-VolumeQuotasAdminTestJSON-861603968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74bfc31b-9b0c-4ed3-b25b-472075751dcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5378e7cb-bc82-486a-98fe-f23606f08170', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:30:02 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-039b3dd9-7188-4605-b116-57f283f79bad tempest-VolumeQuotasAdminTestJSON-861603968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f50a0123-9a5d-48a5-94ea-27f5f73c80ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:30:02 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-039b3dd9-7188-4605-b116-57f283f79bad tempest-VolumeQuotasAdminTestJSON-861603968 None] Volume volume-5378e7cb-bc82-486a-98fe-f23606f08170 (5378e7cb-bc82-486a-98fe-f23606f08170): created successfully Aug 26 14:30:02 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-039b3dd9-7188-4605-b116-57f283f79bad tempest-VolumeQuotasAdminTestJSON-861603968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f50a0123-9a5d-48a5-94ea-27f5f73c80ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:30:02 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-039b3dd9-7188-4605-b116-57f283f79bad tempest-VolumeQuotasAdminTestJSON-861603968 None] Flow 'volume_create_manager' (9689c6ce-3fab-4d02-a401-2cfa83fbf091) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:30:02 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-039b3dd9-7188-4605-b116-57f283f79bad tempest-VolumeQuotasAdminTestJSON-861603968 None] Created volume successfully. Aug 26 14:30:03 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-b415e6f1-af12-4520-9041-a0b54e0b89d0 tempest-VolumesActionsTest-362336132 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:30:03 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-b415e6f1-af12-4520-9041-a0b54e0b89d0 tempest-VolumesActionsTest-362336132 None] Flow 'volume_create_manager' (f13e04f4-b77f-468a-9f52-ea6d72be74ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:30:03 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-b415e6f1-af12-4520-9041-a0b54e0b89d0 tempest-VolumesActionsTest-362336132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84e6e5eb-6087-4934-82df-f0e09682d22a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:30:03 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-b415e6f1-af12-4520-9041-a0b54e0b89d0 tempest-VolumesActionsTest-362336132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84e6e5eb-6087-4934-82df-f0e09682d22a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:30:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-156046653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8df7c53c-a35a-4020-ae09-561ee9964e52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a85c881a611446280ade138453b54cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:30:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:30:03Z,use_quota=True,user_id='967c19248c35450f92db5434920581b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:30:03 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-b415e6f1-af12-4520-9041-a0b54e0b89d0 tempest-VolumesActionsTest-362336132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cb7fee0-048f-405b-823e-1c5a891ef728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:30:03 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-b415e6f1-af12-4520-9041-a0b54e0b89d0 tempest-VolumesActionsTest-362336132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cb7fee0-048f-405b-823e-1c5a891ef728) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:30:03 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-b415e6f1-af12-4520-9041-a0b54e0b89d0 tempest-VolumesActionsTest-362336132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (167e0a19-ea89-48b5-87f5-b6f102cd70a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:30:03 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-b415e6f1-af12-4520-9041-a0b54e0b89d0 tempest-VolumesActionsTest-362336132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (167e0a19-ea89-48b5-87f5-b6f102cd70a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8df7c53c-a35a-4020-ae09-561ee9964e52', 'volume_name': 'volume-8df7c53c-a35a-4020-ae09-561ee9964e52', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:30:03 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-b415e6f1-af12-4520-9041-a0b54e0b89d0 tempest-VolumesActionsTest-362336132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b21d2ee7-f7c2-4e46-8644-a20489981817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:30:03 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-b415e6f1-af12-4520-9041-a0b54e0b89d0 tempest-VolumesActionsTest-362336132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b21d2ee7-f7c2-4e46-8644-a20489981817) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:30:03 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-b415e6f1-af12-4520-9041-a0b54e0b89d0 tempest-VolumesActionsTest-362336132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20218609-d2f4-4752-aae3-88e3cccc54cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:30:03 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-b415e6f1-af12-4520-9041-a0b54e0b89d0 tempest-VolumesActionsTest-362336132 None] Volume 8df7c53c-a35a-4020-ae09-561ee9964e52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8df7c53c-a35a-4020-ae09-561ee9964e52', 'volume_size': 1} Aug 26 14:30:03 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-b415e6f1-af12-4520-9041-a0b54e0b89d0 tempest-VolumesActionsTest-362336132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:30:03 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-b415e6f1-af12-4520-9041-a0b54e0b89d0 tempest-VolumesActionsTest-362336132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:30:03 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-b415e6f1-af12-4520-9041-a0b54e0b89d0 tempest-VolumesActionsTest-362336132 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:30:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-156046653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8df7c53c-a35a-4020-ae09-561ee9964e52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a85c881a611446280ade138453b54cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:30:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:30:03Z,use_quota=True,user_id='967c19248c35450f92db5434920581b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:30:03 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-b415e6f1-af12-4520-9041-a0b54e0b89d0 tempest-VolumesActionsTest-362336132 None] Creating volume 8df7c53c-a35a-4020-ae09-561ee9964e52 {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:30:03 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-b415e6f1-af12-4520-9041-a0b54e0b89d0 tempest-VolumesActionsTest-362336132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:30:03 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-b415e6f1-af12-4520-9041-a0b54e0b89d0 tempest-VolumesActionsTest-362336132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:30:03 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-b415e6f1-af12-4520-9041-a0b54e0b89d0 tempest-VolumesActionsTest-362336132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:30:03 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-b415e6f1-af12-4520-9041-a0b54e0b89d0 tempest-VolumesActionsTest-362336132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:30:03 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-b415e6f1-af12-4520-9041-a0b54e0b89d0 tempest-VolumesActionsTest-362336132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:30:03 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-b415e6f1-af12-4520-9041-a0b54e0b89d0 tempest-VolumesActionsTest-362336132 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:30:03 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-b415e6f1-af12-4520-9041-a0b54e0b89d0 tempest-VolumesActionsTest-362336132 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:30:03 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-b415e6f1-af12-4520-9041-a0b54e0b89d0 tempest-VolumesActionsTest-362336132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-8df7c53c-a35a-4020-ae09-561ee9964e52 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:03 devstack sudo[105389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-8df7c53c-a35a-4020-ae09-561ee9964e52 1073741824 Aug 26 14:30:03 devstack sudo[105389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:03 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-4638e00c-392a-45af-91bc-66dd9dbddd21 tempest-VolumeQuotasAdminTestJSON-861603968 None] Acquiring lock "cinder-5378e7cb-bc82-486a-98fe-f23606f08170-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:30:03 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-4638e00c-392a-45af-91bc-66dd9dbddd21 tempest-VolumeQuotasAdminTestJSON-861603968 None] Lock "cinder-5378e7cb-bc82-486a-98fe-f23606f08170-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:30:03 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-4638e00c-392a-45af-91bc-66dd9dbddd21 tempest-VolumeQuotasAdminTestJSON-861603968 None] Acquiring lock "cinder-quobyte-5378e7cb-bc82-486a-98fe-f23606f08170" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:30:03 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-4638e00c-392a-45af-91bc-66dd9dbddd21 tempest-VolumeQuotasAdminTestJSON-861603968 None] Lock "cinder-quobyte-5378e7cb-bc82-486a-98fe-f23606f08170" acquired by "delete_volume" :: waited 0.024s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:30:03 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[692a7312-a44e-4514-b792-c40923cb3936]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:30:03 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4638e00c-392a-45af-91bc-66dd9dbddd21 tempest-VolumeQuotasAdminTestJSON-861603968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5378e7cb-bc82-486a-98fe-f23606f08170 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:03 devstack sudo[105391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5378e7cb-bc82-486a-98fe-f23606f08170 Aug 26 14:30:03 devstack sudo[105391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:04 devstack sudo[105389]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:04 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-b415e6f1-af12-4520-9041-a0b54e0b89d0 tempest-VolumesActionsTest-362336132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-8df7c53c-a35a-4020-ae09-561ee9964e52 1073741824" returned: 0 in 0.632s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:04 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-b415e6f1-af12-4520-9041-a0b54e0b89d0 tempest-VolumesActionsTest-362336132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-8df7c53c-a35a-4020-ae09-561ee9964e52 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:04 devstack sudo[105396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-8df7c53c-a35a-4020-ae09-561ee9964e52 Aug 26 14:30:04 devstack sudo[105396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:04 devstack sudo[105391]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:04 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4638e00c-392a-45af-91bc-66dd9dbddd21 tempest-VolumeQuotasAdminTestJSON-861603968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5378e7cb-bc82-486a-98fe-f23606f08170" returned: 0 in 0.527s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:04 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4638e00c-392a-45af-91bc-66dd9dbddd21 tempest-VolumeQuotasAdminTestJSON-861603968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5378e7cb-bc82-486a-98fe-f23606f08170 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:04 devstack sudo[105402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5378e7cb-bc82-486a-98fe-f23606f08170 Aug 26 14:30:04 devstack sudo[105402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:04 devstack sudo[105396]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:04 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-b415e6f1-af12-4520-9041-a0b54e0b89d0 tempest-VolumesActionsTest-362336132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-8df7c53c-a35a-4020-ae09-561ee9964e52" returned: 0 in 0.281s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:04 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-b415e6f1-af12-4520-9041-a0b54e0b89d0 tempest-VolumesActionsTest-362336132 None] <== create_volume: return (977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:30:04 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-b415e6f1-af12-4520-9041-a0b54e0b89d0 tempest-VolumesActionsTest-362336132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.982s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:30:04 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-b415e6f1-af12-4520-9041-a0b54e0b89d0 tempest-VolumesActionsTest-362336132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20218609-d2f4-4752-aae3-88e3cccc54cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8df7c53c-a35a-4020-ae09-561ee9964e52', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:30:04 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-b415e6f1-af12-4520-9041-a0b54e0b89d0 tempest-VolumesActionsTest-362336132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef824706-d86a-4328-aa81-64e9f9cecaa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:30:04 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-b415e6f1-af12-4520-9041-a0b54e0b89d0 tempest-VolumesActionsTest-362336132 None] Volume volume-8df7c53c-a35a-4020-ae09-561ee9964e52 (8df7c53c-a35a-4020-ae09-561ee9964e52): created successfully Aug 26 14:30:04 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-b415e6f1-af12-4520-9041-a0b54e0b89d0 tempest-VolumesActionsTest-362336132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef824706-d86a-4328-aa81-64e9f9cecaa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:30:04 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-b415e6f1-af12-4520-9041-a0b54e0b89d0 tempest-VolumesActionsTest-362336132 None] Flow 'volume_create_manager' (f13e04f4-b77f-468a-9f52-ea6d72be74ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:30:04 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-b415e6f1-af12-4520-9041-a0b54e0b89d0 tempest-VolumesActionsTest-362336132 None] Created volume successfully. Aug 26 14:30:04 devstack sudo[105402]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:04 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4638e00c-392a-45af-91bc-66dd9dbddd21 tempest-VolumeQuotasAdminTestJSON-861603968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5378e7cb-bc82-486a-98fe-f23606f08170" returned: 0 in 0.298s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:04 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-4638e00c-392a-45af-91bc-66dd9dbddd21 tempest-VolumeQuotasAdminTestJSON-861603968 None] Lock "cinder-quobyte-5378e7cb-bc82-486a-98fe-f23606f08170" released by "delete_volume" :: held 0.887s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:30:04 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-4638e00c-392a-45af-91bc-66dd9dbddd21 tempest-VolumeQuotasAdminTestJSON-861603968 None] Created reservations ['2fbd1436-91ec-4712-b729-4e3f85938d6f', '3b80b1cd-8cc0-4caf-97c9-4d59af0d1456', '141d74b7-62eb-4e88-ba2c-e67396aa569d', '2e0d8d69-896f-426a-a80e-d3ba7e4573c2'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:30:04 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-4638e00c-392a-45af-91bc-66dd9dbddd21 tempest-VolumeQuotasAdminTestJSON-861603968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:30:04 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-4638e00c-392a-45af-91bc-66dd9dbddd21 tempest-VolumeQuotasAdminTestJSON-861603968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:30:04 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-4638e00c-392a-45af-91bc-66dd9dbddd21 tempest-VolumeQuotasAdminTestJSON-861603968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:30:04 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-4638e00c-392a-45af-91bc-66dd9dbddd21 tempest-VolumeQuotasAdminTestJSON-861603968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:30:04 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-4638e00c-392a-45af-91bc-66dd9dbddd21 tempest-VolumeQuotasAdminTestJSON-861603968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:30:04 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4638e00c-392a-45af-91bc-66dd9dbddd21 tempest-VolumeQuotasAdminTestJSON-861603968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:04 devstack sudo[105406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:30:04 devstack sudo[105406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:05 devstack sudo[105406]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:05 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4638e00c-392a-45af-91bc-66dd9dbddd21 tempest-VolumeQuotasAdminTestJSON-861603968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.339s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:05 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-4638e00c-392a-45af-91bc-66dd9dbddd21 tempest-VolumeQuotasAdminTestJSON-861603968 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:30:05 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-4638e00c-392a-45af-91bc-66dd9dbddd21 tempest-VolumeQuotasAdminTestJSON-861603968 None] Deleted volume successfully. Aug 26 14:30:05 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-4638e00c-392a-45af-91bc-66dd9dbddd21 tempest-VolumeQuotasAdminTestJSON-861603968 None] Lock "cinder-5378e7cb-bc82-486a-98fe-f23606f08170-delete_volume" released by "delete_volume" :: held 1.543s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:30:05 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-5722225f-eb88-492c-8e87-e4ac56afab17 tempest-VolumesMetadataTest-150271888 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:30:05 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-5722225f-eb88-492c-8e87-e4ac56afab17 tempest-VolumesMetadataTest-150271888 None] Flow 'volume_create_manager' (82120d1f-28ee-4132-b306-3e50d78b9438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:30:05 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-5722225f-eb88-492c-8e87-e4ac56afab17 tempest-VolumesMetadataTest-150271888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71c55bf3-01ab-4e64-aaf9-bb6401f4addf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:30:05 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-5722225f-eb88-492c-8e87-e4ac56afab17 tempest-VolumesMetadataTest-150271888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71c55bf3-01ab-4e64-aaf9-bb6401f4addf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:30:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1819831261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b978d4b8-4be3-401c-a4e9-2f471e0c1118,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2253dbd5e456473195671fa138b94777',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:30:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:30:05Z,use_quota=True,user_id='025d0de881304d0897d261e06f00375a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:30:05 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-5722225f-eb88-492c-8e87-e4ac56afab17 tempest-VolumesMetadataTest-150271888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b17ff62-99be-4ed8-bc2b-68ac1ee6f109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:30:05 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-5722225f-eb88-492c-8e87-e4ac56afab17 tempest-VolumesMetadataTest-150271888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b17ff62-99be-4ed8-bc2b-68ac1ee6f109) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:30:05 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-5722225f-eb88-492c-8e87-e4ac56afab17 tempest-VolumesMetadataTest-150271888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd719bca-5208-45d3-83a7-ddc1393830c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:30:05 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-5722225f-eb88-492c-8e87-e4ac56afab17 tempest-VolumesMetadataTest-150271888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd719bca-5208-45d3-83a7-ddc1393830c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b978d4b8-4be3-401c-a4e9-2f471e0c1118', 'volume_name': 'volume-b978d4b8-4be3-401c-a4e9-2f471e0c1118', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:30:05 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-5722225f-eb88-492c-8e87-e4ac56afab17 tempest-VolumesMetadataTest-150271888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e38b9dfe-d777-4fe1-8fc1-62b8868c931d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:30:05 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-5722225f-eb88-492c-8e87-e4ac56afab17 tempest-VolumesMetadataTest-150271888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e38b9dfe-d777-4fe1-8fc1-62b8868c931d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:30:05 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-5722225f-eb88-492c-8e87-e4ac56afab17 tempest-VolumesMetadataTest-150271888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (101e0af5-c741-400a-832c-62ad0b310eb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:30:05 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-5722225f-eb88-492c-8e87-e4ac56afab17 tempest-VolumesMetadataTest-150271888 None] Volume b978d4b8-4be3-401c-a4e9-2f471e0c1118: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b978d4b8-4be3-401c-a4e9-2f471e0c1118', 'volume_size': 1} Aug 26 14:30:05 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-5722225f-eb88-492c-8e87-e4ac56afab17 tempest-VolumesMetadataTest-150271888 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:30:05 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-5722225f-eb88-492c-8e87-e4ac56afab17 tempest-VolumesMetadataTest-150271888 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:30:05 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-5722225f-eb88-492c-8e87-e4ac56afab17 tempest-VolumesMetadataTest-150271888 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:30:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1819831261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b978d4b8-4be3-401c-a4e9-2f471e0c1118,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2253dbd5e456473195671fa138b94777',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:30:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:30:05Z,use_quota=True,user_id='025d0de881304d0897d261e06f00375a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:30:05 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-5722225f-eb88-492c-8e87-e4ac56afab17 tempest-VolumesMetadataTest-150271888 None] Creating volume b978d4b8-4be3-401c-a4e9-2f471e0c1118 {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:30:05 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-5722225f-eb88-492c-8e87-e4ac56afab17 tempest-VolumesMetadataTest-150271888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:30:05 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-5722225f-eb88-492c-8e87-e4ac56afab17 tempest-VolumesMetadataTest-150271888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:30:05 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-5722225f-eb88-492c-8e87-e4ac56afab17 tempest-VolumesMetadataTest-150271888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:30:05 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-5722225f-eb88-492c-8e87-e4ac56afab17 tempest-VolumesMetadataTest-150271888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:30:05 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-5722225f-eb88-492c-8e87-e4ac56afab17 tempest-VolumesMetadataTest-150271888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:30:05 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-5722225f-eb88-492c-8e87-e4ac56afab17 tempest-VolumesMetadataTest-150271888 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:30:05 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-5722225f-eb88-492c-8e87-e4ac56afab17 tempest-VolumesMetadataTest-150271888 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:30:05 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-5722225f-eb88-492c-8e87-e4ac56afab17 tempest-VolumesMetadataTest-150271888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b978d4b8-4be3-401c-a4e9-2f471e0c1118 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:05 devstack sudo[105410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b978d4b8-4be3-401c-a4e9-2f471e0c1118 1073741824 Aug 26 14:30:05 devstack sudo[105410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:05 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-77c6935c-edec-4abe-9e6b-b229a8d187f2 tempest-VolumeQuotasAdminTestJSON-861603968 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:30:05 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-77c6935c-edec-4abe-9e6b-b229a8d187f2 tempest-VolumeQuotasAdminTestJSON-861603968 None] Flow 'volume_create_manager' (dd5147f7-54a2-48c4-b58e-f0d3d16bc911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:30:05 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-77c6935c-edec-4abe-9e6b-b229a8d187f2 tempest-VolumeQuotasAdminTestJSON-861603968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (868205f7-2f90-4984-97e9-184b5c1ce985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:30:05 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-77c6935c-edec-4abe-9e6b-b229a8d187f2 tempest-VolumeQuotasAdminTestJSON-861603968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (868205f7-2f90-4984-97e9-184b5c1ce985) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:30:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-775889336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f487ab9c-3734-4cfb-8d6d-76ffc84d0919,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06a9ba5d4049477bb7b14438de729193',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:30:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:30:05Z,use_quota=True,user_id='cc4331b614674512ada2443b0a5a16b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:30:05 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-77c6935c-edec-4abe-9e6b-b229a8d187f2 tempest-VolumeQuotasAdminTestJSON-861603968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50d657fd-f77f-449d-8f15-223ff966255b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:30:05 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-77c6935c-edec-4abe-9e6b-b229a8d187f2 tempest-VolumeQuotasAdminTestJSON-861603968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50d657fd-f77f-449d-8f15-223ff966255b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:30:05 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-77c6935c-edec-4abe-9e6b-b229a8d187f2 tempest-VolumeQuotasAdminTestJSON-861603968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56bd4a63-450a-4331-865b-278466bd87b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:30:05 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-77c6935c-edec-4abe-9e6b-b229a8d187f2 tempest-VolumeQuotasAdminTestJSON-861603968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56bd4a63-450a-4331-865b-278466bd87b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f487ab9c-3734-4cfb-8d6d-76ffc84d0919', 'volume_name': 'volume-f487ab9c-3734-4cfb-8d6d-76ffc84d0919', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:30:05 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-77c6935c-edec-4abe-9e6b-b229a8d187f2 tempest-VolumeQuotasAdminTestJSON-861603968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b924c65-dd87-45f1-9f31-07a0e7b60623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:30:05 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-77c6935c-edec-4abe-9e6b-b229a8d187f2 tempest-VolumeQuotasAdminTestJSON-861603968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b924c65-dd87-45f1-9f31-07a0e7b60623) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:30:05 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-77c6935c-edec-4abe-9e6b-b229a8d187f2 tempest-VolumeQuotasAdminTestJSON-861603968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d20d8e82-ee6a-4412-8620-d6c369d18421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:30:05 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-77c6935c-edec-4abe-9e6b-b229a8d187f2 tempest-VolumeQuotasAdminTestJSON-861603968 None] Volume f487ab9c-3734-4cfb-8d6d-76ffc84d0919: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f487ab9c-3734-4cfb-8d6d-76ffc84d0919', 'volume_size': 1} Aug 26 14:30:05 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-77c6935c-edec-4abe-9e6b-b229a8d187f2 tempest-VolumeQuotasAdminTestJSON-861603968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:30:05 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-bb033fee-2676-4c67-b44a-97289a00a416 tempest-VolumesActionsTest-508015839 None] Acquiring lock "cinder-8df7c53c-a35a-4020-ae09-561ee9964e52-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:30:05 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-bb033fee-2676-4c67-b44a-97289a00a416 tempest-VolumesActionsTest-508015839 None] Lock "cinder-8df7c53c-a35a-4020-ae09-561ee9964e52-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:30:05 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-bb033fee-2676-4c67-b44a-97289a00a416 tempest-VolumesActionsTest-508015839 None] Acquiring lock "cinder-quobyte-8df7c53c-a35a-4020-ae09-561ee9964e52" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:30:05 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-bb033fee-2676-4c67-b44a-97289a00a416 tempest-VolumesActionsTest-508015839 None] Lock "cinder-quobyte-8df7c53c-a35a-4020-ae09-561ee9964e52" acquired by "delete_volume" :: waited 0.025s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:30:05 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[623dbf96-8654-46ec-9459-4b76c46a9fbf]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:30:05 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-bb033fee-2676-4c67-b44a-97289a00a416 tempest-VolumesActionsTest-508015839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-8df7c53c-a35a-4020-ae09-561ee9964e52 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:05 devstack sudo[105415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-8df7c53c-a35a-4020-ae09-561ee9964e52 Aug 26 14:30:05 devstack sudo[105415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:05 devstack sudo[105410]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:05 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-5722225f-eb88-492c-8e87-e4ac56afab17 tempest-VolumesMetadataTest-150271888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b978d4b8-4be3-401c-a4e9-2f471e0c1118 1073741824" returned: 0 in 0.619s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:06 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-5722225f-eb88-492c-8e87-e4ac56afab17 tempest-VolumesMetadataTest-150271888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b978d4b8-4be3-401c-a4e9-2f471e0c1118 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:06 devstack sudo[105418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b978d4b8-4be3-401c-a4e9-2f471e0c1118 Aug 26 14:30:06 devstack sudo[105418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:06 devstack sudo[105415]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:06 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-bb033fee-2676-4c67-b44a-97289a00a416 tempest-VolumesActionsTest-508015839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-8df7c53c-a35a-4020-ae09-561ee9964e52" returned: 0 in 0.430s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:06 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-bb033fee-2676-4c67-b44a-97289a00a416 tempest-VolumesActionsTest-508015839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-8df7c53c-a35a-4020-ae09-561ee9964e52 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:06 devstack sudo[105423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-8df7c53c-a35a-4020-ae09-561ee9964e52 Aug 26 14:30:06 devstack sudo[105423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:06 devstack sudo[105418]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:06 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-5722225f-eb88-492c-8e87-e4ac56afab17 tempest-VolumesMetadataTest-150271888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b978d4b8-4be3-401c-a4e9-2f471e0c1118" returned: 0 in 0.291s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:06 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-5722225f-eb88-492c-8e87-e4ac56afab17 tempest-VolumesMetadataTest-150271888 None] <== create_volume: return (966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:30:06 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-5722225f-eb88-492c-8e87-e4ac56afab17 tempest-VolumesMetadataTest-150271888 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:30:06 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-77c6935c-edec-4abe-9e6b-b229a8d187f2 tempest-VolumeQuotasAdminTestJSON-861603968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.796s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:30:06 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-77c6935c-edec-4abe-9e6b-b229a8d187f2 tempest-VolumeQuotasAdminTestJSON-861603968 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:30:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-775889336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f487ab9c-3734-4cfb-8d6d-76ffc84d0919,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06a9ba5d4049477bb7b14438de729193',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:30:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:30:05Z,use_quota=True,user_id='cc4331b614674512ada2443b0a5a16b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:30:06 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-77c6935c-edec-4abe-9e6b-b229a8d187f2 tempest-VolumeQuotasAdminTestJSON-861603968 None] Creating volume f487ab9c-3734-4cfb-8d6d-76ffc84d0919 {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:30:06 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-77c6935c-edec-4abe-9e6b-b229a8d187f2 tempest-VolumeQuotasAdminTestJSON-861603968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:30:06 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-77c6935c-edec-4abe-9e6b-b229a8d187f2 tempest-VolumeQuotasAdminTestJSON-861603968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:30:06 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-77c6935c-edec-4abe-9e6b-b229a8d187f2 tempest-VolumeQuotasAdminTestJSON-861603968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:30:06 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-77c6935c-edec-4abe-9e6b-b229a8d187f2 tempest-VolumeQuotasAdminTestJSON-861603968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:30:06 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-77c6935c-edec-4abe-9e6b-b229a8d187f2 tempest-VolumeQuotasAdminTestJSON-861603968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:30:06 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-77c6935c-edec-4abe-9e6b-b229a8d187f2 tempest-VolumeQuotasAdminTestJSON-861603968 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:30:06 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-77c6935c-edec-4abe-9e6b-b229a8d187f2 tempest-VolumeQuotasAdminTestJSON-861603968 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:30:06 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-77c6935c-edec-4abe-9e6b-b229a8d187f2 tempest-VolumeQuotasAdminTestJSON-861603968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-f487ab9c-3734-4cfb-8d6d-76ffc84d0919 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:06 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-5722225f-eb88-492c-8e87-e4ac56afab17 tempest-VolumesMetadataTest-150271888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (101e0af5-c741-400a-832c-62ad0b310eb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b978d4b8-4be3-401c-a4e9-2f471e0c1118', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:30:06 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-5722225f-eb88-492c-8e87-e4ac56afab17 tempest-VolumesMetadataTest-150271888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c97da5c-7ac2-4cb1-a2d1-766be96535e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:30:06 devstack sudo[105426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-f487ab9c-3734-4cfb-8d6d-76ffc84d0919 1073741824 Aug 26 14:30:06 devstack sudo[105426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:06 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-5722225f-eb88-492c-8e87-e4ac56afab17 tempest-VolumesMetadataTest-150271888 None] Volume volume-b978d4b8-4be3-401c-a4e9-2f471e0c1118 (b978d4b8-4be3-401c-a4e9-2f471e0c1118): created successfully Aug 26 14:30:06 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-5722225f-eb88-492c-8e87-e4ac56afab17 tempest-VolumesMetadataTest-150271888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c97da5c-7ac2-4cb1-a2d1-766be96535e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:30:06 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-5722225f-eb88-492c-8e87-e4ac56afab17 tempest-VolumesMetadataTest-150271888 None] Flow 'volume_create_manager' (82120d1f-28ee-4132-b306-3e50d78b9438) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:30:06 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-5722225f-eb88-492c-8e87-e4ac56afab17 tempest-VolumesMetadataTest-150271888 None] Created volume successfully. Aug 26 14:30:06 devstack sudo[105423]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:06 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-bb033fee-2676-4c67-b44a-97289a00a416 tempest-VolumesActionsTest-508015839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-8df7c53c-a35a-4020-ae09-561ee9964e52" returned: 0 in 0.331s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:06 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-bb033fee-2676-4c67-b44a-97289a00a416 tempest-VolumesActionsTest-508015839 None] Lock "cinder-quobyte-8df7c53c-a35a-4020-ae09-561ee9964e52" released by "delete_volume" :: held 0.817s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:30:06 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-bb033fee-2676-4c67-b44a-97289a00a416 tempest-VolumesActionsTest-508015839 None] Created reservations ['61049d91-c7d3-4d64-8afb-89724c5d30e1', 'f2b5398f-5b00-4389-b7f1-ab8aa4e5190a', '8c32fbfb-b897-4a73-9217-64bc08a37462', '2a28b568-05cb-4d5c-9f69-758d28e0bd0b'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:30:06 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-bb033fee-2676-4c67-b44a-97289a00a416 tempest-VolumesActionsTest-508015839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:30:06 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-bb033fee-2676-4c67-b44a-97289a00a416 tempest-VolumesActionsTest-508015839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:30:06 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-bb033fee-2676-4c67-b44a-97289a00a416 tempest-VolumesActionsTest-508015839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:30:06 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-bb033fee-2676-4c67-b44a-97289a00a416 tempest-VolumesActionsTest-508015839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:30:06 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-bb033fee-2676-4c67-b44a-97289a00a416 tempest-VolumesActionsTest-508015839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:30:06 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-bb033fee-2676-4c67-b44a-97289a00a416 tempest-VolumesActionsTest-508015839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:06 devstack sudo[105432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:30:06 devstack sudo[105432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:06 devstack sudo[105426]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:06 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-77c6935c-edec-4abe-9e6b-b229a8d187f2 tempest-VolumeQuotasAdminTestJSON-861603968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-f487ab9c-3734-4cfb-8d6d-76ffc84d0919 1073741824" returned: 0 in 0.574s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:06 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-77c6935c-edec-4abe-9e6b-b229a8d187f2 tempest-VolumeQuotasAdminTestJSON-861603968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-f487ab9c-3734-4cfb-8d6d-76ffc84d0919 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:06 devstack sudo[105432]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:06 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-bb033fee-2676-4c67-b44a-97289a00a416 tempest-VolumesActionsTest-508015839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.333s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:06 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-bb033fee-2676-4c67-b44a-97289a00a416 tempest-VolumesActionsTest-508015839 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:30:07 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-bb033fee-2676-4c67-b44a-97289a00a416 tempest-VolumesActionsTest-508015839 None] Deleted volume successfully. Aug 26 14:30:07 devstack sudo[105436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-f487ab9c-3734-4cfb-8d6d-76ffc84d0919 Aug 26 14:30:07 devstack sudo[105436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:07 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-bb033fee-2676-4c67-b44a-97289a00a416 tempest-VolumesActionsTest-508015839 None] Lock "cinder-8df7c53c-a35a-4020-ae09-561ee9964e52-delete_volume" released by "delete_volume" :: held 1.394s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:30:07 devstack sudo[105436]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:07 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-77c6935c-edec-4abe-9e6b-b229a8d187f2 tempest-VolumeQuotasAdminTestJSON-861603968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-f487ab9c-3734-4cfb-8d6d-76ffc84d0919" returned: 0 in 0.399s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:07 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-77c6935c-edec-4abe-9e6b-b229a8d187f2 tempest-VolumeQuotasAdminTestJSON-861603968 None] <== create_volume: return (1043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:30:07 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-77c6935c-edec-4abe-9e6b-b229a8d187f2 tempest-VolumeQuotasAdminTestJSON-861603968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.047s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:30:07 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-77c6935c-edec-4abe-9e6b-b229a8d187f2 tempest-VolumeQuotasAdminTestJSON-861603968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d20d8e82-ee6a-4412-8620-d6c369d18421) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f487ab9c-3734-4cfb-8d6d-76ffc84d0919', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:30:07 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-77c6935c-edec-4abe-9e6b-b229a8d187f2 tempest-VolumeQuotasAdminTestJSON-861603968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ef394e5-7654-4e69-88d8-f7e776ef4bf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:30:07 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-77c6935c-edec-4abe-9e6b-b229a8d187f2 tempest-VolumeQuotasAdminTestJSON-861603968 None] Volume volume-f487ab9c-3734-4cfb-8d6d-76ffc84d0919 (f487ab9c-3734-4cfb-8d6d-76ffc84d0919): created successfully Aug 26 14:30:07 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-77c6935c-edec-4abe-9e6b-b229a8d187f2 tempest-VolumeQuotasAdminTestJSON-861603968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ef394e5-7654-4e69-88d8-f7e776ef4bf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:30:07 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-77c6935c-edec-4abe-9e6b-b229a8d187f2 tempest-VolumeQuotasAdminTestJSON-861603968 None] Flow 'volume_create_manager' (dd5147f7-54a2-48c4-b58e-f0d3d16bc911) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:30:07 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-77c6935c-edec-4abe-9e6b-b229a8d187f2 tempest-VolumeQuotasAdminTestJSON-861603968 None] Created volume successfully. Aug 26 14:30:07 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-a21614f0-5db2-4d87-85d0-dc75bd48bd14 tempest-VolumesActionsTest-362336132 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:30:07 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-a21614f0-5db2-4d87-85d0-dc75bd48bd14 tempest-VolumesActionsTest-362336132 None] Flow 'volume_create_manager' (854a3ee9-3155-4f5d-8168-ddc7c0eeede6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:30:07 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-a21614f0-5db2-4d87-85d0-dc75bd48bd14 tempest-VolumesActionsTest-362336132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d6ef344-b9e2-4499-bb2a-9eaa78cc0ed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:30:07 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-a21614f0-5db2-4d87-85d0-dc75bd48bd14 tempest-VolumesActionsTest-362336132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d6ef344-b9e2-4499-bb2a-9eaa78cc0ed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:30:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1278772554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad3bceba-4d76-4fab-9751-27dfea30145d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a85c881a611446280ade138453b54cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:30:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:30:07Z,use_quota=True,user_id='967c19248c35450f92db5434920581b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:30:07 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-a21614f0-5db2-4d87-85d0-dc75bd48bd14 tempest-VolumesActionsTest-362336132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb8cdd6e-d38a-4801-a222-b81ffd4671a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:30:07 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-a21614f0-5db2-4d87-85d0-dc75bd48bd14 tempest-VolumesActionsTest-362336132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb8cdd6e-d38a-4801-a222-b81ffd4671a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:30:07 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-a21614f0-5db2-4d87-85d0-dc75bd48bd14 tempest-VolumesActionsTest-362336132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1fab428-59eb-4b95-9ee5-32f137477748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:30:07 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-a21614f0-5db2-4d87-85d0-dc75bd48bd14 tempest-VolumesActionsTest-362336132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1fab428-59eb-4b95-9ee5-32f137477748) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad3bceba-4d76-4fab-9751-27dfea30145d', 'volume_name': 'volume-ad3bceba-4d76-4fab-9751-27dfea30145d', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:30:07 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-a21614f0-5db2-4d87-85d0-dc75bd48bd14 tempest-VolumesActionsTest-362336132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2e74952-480d-41d0-967a-7d2ab4388a80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:30:07 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-a21614f0-5db2-4d87-85d0-dc75bd48bd14 tempest-VolumesActionsTest-362336132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2e74952-480d-41d0-967a-7d2ab4388a80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:30:07 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-a21614f0-5db2-4d87-85d0-dc75bd48bd14 tempest-VolumesActionsTest-362336132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ab78e53-6ff3-4443-a6f4-f44c0797136b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:30:07 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-a21614f0-5db2-4d87-85d0-dc75bd48bd14 tempest-VolumesActionsTest-362336132 None] Volume ad3bceba-4d76-4fab-9751-27dfea30145d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad3bceba-4d76-4fab-9751-27dfea30145d', 'volume_size': 1} Aug 26 14:30:07 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-a21614f0-5db2-4d87-85d0-dc75bd48bd14 tempest-VolumesActionsTest-362336132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:30:07 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-a21614f0-5db2-4d87-85d0-dc75bd48bd14 tempest-VolumesActionsTest-362336132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:30:07 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-a21614f0-5db2-4d87-85d0-dc75bd48bd14 tempest-VolumesActionsTest-362336132 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:30:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1278772554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad3bceba-4d76-4fab-9751-27dfea30145d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a85c881a611446280ade138453b54cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:30:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:30:07Z,use_quota=True,user_id='967c19248c35450f92db5434920581b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:30:07 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-a21614f0-5db2-4d87-85d0-dc75bd48bd14 tempest-VolumesActionsTest-362336132 None] Creating volume ad3bceba-4d76-4fab-9751-27dfea30145d {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:30:07 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-a21614f0-5db2-4d87-85d0-dc75bd48bd14 tempest-VolumesActionsTest-362336132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:30:07 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-a21614f0-5db2-4d87-85d0-dc75bd48bd14 tempest-VolumesActionsTest-362336132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:30:07 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-a21614f0-5db2-4d87-85d0-dc75bd48bd14 tempest-VolumesActionsTest-362336132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:30:07 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-a21614f0-5db2-4d87-85d0-dc75bd48bd14 tempest-VolumesActionsTest-362336132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:30:07 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-a21614f0-5db2-4d87-85d0-dc75bd48bd14 tempest-VolumesActionsTest-362336132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:30:07 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-a21614f0-5db2-4d87-85d0-dc75bd48bd14 tempest-VolumesActionsTest-362336132 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:30:07 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-a21614f0-5db2-4d87-85d0-dc75bd48bd14 tempest-VolumesActionsTest-362336132 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:30:07 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-a21614f0-5db2-4d87-85d0-dc75bd48bd14 tempest-VolumesActionsTest-362336132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ad3bceba-4d76-4fab-9751-27dfea30145d 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:07 devstack sudo[105439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ad3bceba-4d76-4fab-9751-27dfea30145d 1073741824 Aug 26 14:30:07 devstack sudo[105439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:08 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-4cba6909-1153-4619-a56f-d5527103115c tempest-VolumesMetadataTest-150271888 None] Acquiring lock "cinder-b978d4b8-4be3-401c-a4e9-2f471e0c1118-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:30:08 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-4cba6909-1153-4619-a56f-d5527103115c tempest-VolumesMetadataTest-150271888 None] Lock "cinder-b978d4b8-4be3-401c-a4e9-2f471e0c1118-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:30:08 devstack sudo[105439]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:08 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-a21614f0-5db2-4d87-85d0-dc75bd48bd14 tempest-VolumesActionsTest-362336132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ad3bceba-4d76-4fab-9751-27dfea30145d 1073741824" returned: 0 in 0.551s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:08 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-4cba6909-1153-4619-a56f-d5527103115c tempest-VolumesMetadataTest-150271888 None] Acquiring lock "cinder-quobyte-b978d4b8-4be3-401c-a4e9-2f471e0c1118" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:30:08 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-a21614f0-5db2-4d87-85d0-dc75bd48bd14 tempest-VolumesActionsTest-362336132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ad3bceba-4d76-4fab-9751-27dfea30145d {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:08 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-4cba6909-1153-4619-a56f-d5527103115c tempest-VolumesMetadataTest-150271888 None] Lock "cinder-quobyte-b978d4b8-4be3-401c-a4e9-2f471e0c1118" acquired by "delete_volume" :: waited 0.033s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:30:08 devstack sudo[105445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ad3bceba-4d76-4fab-9751-27dfea30145d Aug 26 14:30:08 devstack sudo[105445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:08 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a1cc8f4-60cb-4cec-ab04-7c8c67412256]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:30:08 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4cba6909-1153-4619-a56f-d5527103115c tempest-VolumesMetadataTest-150271888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b978d4b8-4be3-401c-a4e9-2f471e0c1118 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:08 devstack sudo[105447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b978d4b8-4be3-401c-a4e9-2f471e0c1118 Aug 26 14:30:08 devstack sudo[105447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:08 devstack sudo[105445]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:08 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-a21614f0-5db2-4d87-85d0-dc75bd48bd14 tempest-VolumesActionsTest-362336132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ad3bceba-4d76-4fab-9751-27dfea30145d" returned: 0 in 0.301s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:08 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-a21614f0-5db2-4d87-85d0-dc75bd48bd14 tempest-VolumesActionsTest-362336132 None] <== create_volume: return (925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:30:08 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-a21614f0-5db2-4d87-85d0-dc75bd48bd14 tempest-VolumesActionsTest-362336132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:30:08 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-a21614f0-5db2-4d87-85d0-dc75bd48bd14 tempest-VolumesActionsTest-362336132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ab78e53-6ff3-4443-a6f4-f44c0797136b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad3bceba-4d76-4fab-9751-27dfea30145d', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:30:08 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-a21614f0-5db2-4d87-85d0-dc75bd48bd14 tempest-VolumesActionsTest-362336132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a727f42-dc96-4cdc-befa-4608995fa995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:30:08 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-a21614f0-5db2-4d87-85d0-dc75bd48bd14 tempest-VolumesActionsTest-362336132 None] Volume volume-ad3bceba-4d76-4fab-9751-27dfea30145d (ad3bceba-4d76-4fab-9751-27dfea30145d): created successfully Aug 26 14:30:08 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-a21614f0-5db2-4d87-85d0-dc75bd48bd14 tempest-VolumesActionsTest-362336132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a727f42-dc96-4cdc-befa-4608995fa995) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:30:08 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-a21614f0-5db2-4d87-85d0-dc75bd48bd14 tempest-VolumesActionsTest-362336132 None] Flow 'volume_create_manager' (854a3ee9-3155-4f5d-8168-ddc7c0eeede6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:30:08 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-a21614f0-5db2-4d87-85d0-dc75bd48bd14 tempest-VolumesActionsTest-362336132 None] Created volume successfully. Aug 26 14:30:08 devstack sudo[105447]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:08 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4cba6909-1153-4619-a56f-d5527103115c tempest-VolumesMetadataTest-150271888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b978d4b8-4be3-401c-a4e9-2f471e0c1118" returned: 0 in 0.412s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:08 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4cba6909-1153-4619-a56f-d5527103115c tempest-VolumesMetadataTest-150271888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b978d4b8-4be3-401c-a4e9-2f471e0c1118 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:08 devstack sudo[105453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b978d4b8-4be3-401c-a4e9-2f471e0c1118 Aug 26 14:30:08 devstack sudo[105453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:08 devstack sudo[105453]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:08 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4cba6909-1153-4619-a56f-d5527103115c tempest-VolumesMetadataTest-150271888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b978d4b8-4be3-401c-a4e9-2f471e0c1118" returned: 0 in 0.270s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:08 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-4cba6909-1153-4619-a56f-d5527103115c tempest-VolumesMetadataTest-150271888 None] Lock "cinder-quobyte-b978d4b8-4be3-401c-a4e9-2f471e0c1118" released by "delete_volume" :: held 0.735s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:30:09 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-4cba6909-1153-4619-a56f-d5527103115c tempest-VolumesMetadataTest-150271888 None] Created reservations ['47f1cd83-7d83-4413-850b-c3779c72f340', '40ee4aea-5fb9-48a4-9b3b-4bfa27ecd71e', '43026b5c-14a0-4ace-ae61-164ef557746c', '6de47ca5-68c1-4c99-81b9-eba2815d3ba2'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:30:09 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-4cba6909-1153-4619-a56f-d5527103115c tempest-VolumesMetadataTest-150271888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:30:09 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-4cba6909-1153-4619-a56f-d5527103115c tempest-VolumesMetadataTest-150271888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:30:09 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-4cba6909-1153-4619-a56f-d5527103115c tempest-VolumesMetadataTest-150271888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:30:09 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-4cba6909-1153-4619-a56f-d5527103115c tempest-VolumesMetadataTest-150271888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:30:09 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-4cba6909-1153-4619-a56f-d5527103115c tempest-VolumesMetadataTest-150271888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:30:09 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4cba6909-1153-4619-a56f-d5527103115c tempest-VolumesMetadataTest-150271888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:09 devstack sudo[105456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:30:09 devstack sudo[105456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:09 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-56bffdd8-4596-43d8-8b88-4c2b51e3b968 tempest-VolumeQuotasAdminTestJSON-1688875293 None] Transfer volume completed successfully. Aug 26 14:30:09 devstack sudo[105456]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:09 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4cba6909-1153-4619-a56f-d5527103115c tempest-VolumesMetadataTest-150271888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.294s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:09 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-4cba6909-1153-4619-a56f-d5527103115c tempest-VolumesMetadataTest-150271888 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:30:09 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-4cba6909-1153-4619-a56f-d5527103115c tempest-VolumesMetadataTest-150271888 None] Deleted volume successfully. Aug 26 14:30:09 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-4cba6909-1153-4619-a56f-d5527103115c tempest-VolumesMetadataTest-150271888 None] Lock "cinder-b978d4b8-4be3-401c-a4e9-2f471e0c1118-delete_volume" released by "delete_volume" :: held 1.299s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:30:09 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-f57aa85f-5b95-4473-a7e4-7538dc00d44e tempest-VolumeQuotasAdminTestJSON-222159702 None] Acquiring lock "cinder-f487ab9c-3734-4cfb-8d6d-76ffc84d0919-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:30:10 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-f57aa85f-5b95-4473-a7e4-7538dc00d44e tempest-VolumeQuotasAdminTestJSON-222159702 None] Lock "cinder-f487ab9c-3734-4cfb-8d6d-76ffc84d0919-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:30:10 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-f57aa85f-5b95-4473-a7e4-7538dc00d44e tempest-VolumeQuotasAdminTestJSON-222159702 None] Acquiring lock "cinder-quobyte-f487ab9c-3734-4cfb-8d6d-76ffc84d0919" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:30:10 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-f57aa85f-5b95-4473-a7e4-7538dc00d44e tempest-VolumeQuotasAdminTestJSON-222159702 None] Lock "cinder-quobyte-f487ab9c-3734-4cfb-8d6d-76ffc84d0919" acquired by "delete_volume" :: waited 0.019s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:30:10 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6c70914-1dbc-4d67-baed-8609559fbc8d]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:30:10 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-f57aa85f-5b95-4473-a7e4-7538dc00d44e tempest-VolumeQuotasAdminTestJSON-222159702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-f487ab9c-3734-4cfb-8d6d-76ffc84d0919 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:10 devstack sudo[105460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-f487ab9c-3734-4cfb-8d6d-76ffc84d0919 Aug 26 14:30:10 devstack sudo[105460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:10 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-e8c35f8e-5e88-4741-b47e-08890de7fdf4 tempest-VolumesActionsTest-362336132 None] Acquiring lock "cinder-ad3bceba-4d76-4fab-9751-27dfea30145d-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:30:10 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-e8c35f8e-5e88-4741-b47e-08890de7fdf4 tempest-VolumesActionsTest-362336132 None] Lock "cinder-ad3bceba-4d76-4fab-9751-27dfea30145d-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:30:10 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-e8c35f8e-5e88-4741-b47e-08890de7fdf4 tempest-VolumesActionsTest-362336132 None] Acquiring lock "cinder-quobyte-ad3bceba-4d76-4fab-9751-27dfea30145d" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:30:10 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-e8c35f8e-5e88-4741-b47e-08890de7fdf4 tempest-VolumesActionsTest-362336132 None] Lock "cinder-quobyte-ad3bceba-4d76-4fab-9751-27dfea30145d" acquired by "delete_volume" :: waited 0.015s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:30:10 devstack sudo[105460]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:10 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-f57aa85f-5b95-4473-a7e4-7538dc00d44e tempest-VolumeQuotasAdminTestJSON-222159702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-f487ab9c-3734-4cfb-8d6d-76ffc84d0919" returned: 0 in 0.429s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:10 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-f57aa85f-5b95-4473-a7e4-7538dc00d44e tempest-VolumeQuotasAdminTestJSON-222159702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-f487ab9c-3734-4cfb-8d6d-76ffc84d0919 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:10 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[590fb953-7c4f-4ced-bb58-08efacf954c7]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:30:10 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e8c35f8e-5e88-4741-b47e-08890de7fdf4 tempest-VolumesActionsTest-362336132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ad3bceba-4d76-4fab-9751-27dfea30145d {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:10 devstack sudo[105465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-f487ab9c-3734-4cfb-8d6d-76ffc84d0919 Aug 26 14:30:10 devstack sudo[105465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:10 devstack sudo[105466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ad3bceba-4d76-4fab-9751-27dfea30145d Aug 26 14:30:10 devstack sudo[105466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:10 devstack sudo[105465]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:10 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-f57aa85f-5b95-4473-a7e4-7538dc00d44e tempest-VolumeQuotasAdminTestJSON-222159702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-f487ab9c-3734-4cfb-8d6d-76ffc84d0919" returned: 0 in 0.314s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:10 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-f57aa85f-5b95-4473-a7e4-7538dc00d44e tempest-VolumeQuotasAdminTestJSON-222159702 None] Lock "cinder-quobyte-f487ab9c-3734-4cfb-8d6d-76ffc84d0919" released by "delete_volume" :: held 0.828s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:30:10 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-b8861051-09e9-44c8-8654-719c31adcd02 tempest-GroupsV320Test-971180477 None] Group tempest-GroupsV320Test-Group-391009007: creating Aug 26 14:30:10 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-b8861051-09e9-44c8-8654-719c31adcd02 tempest-GroupsV320Test-971180477 None] Group tempest-GroupsV320Test-Group-391009007: created successfully Aug 26 14:30:11 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-f57aa85f-5b95-4473-a7e4-7538dc00d44e tempest-VolumeQuotasAdminTestJSON-222159702 None] Created reservations ['be9998e4-8118-4ef5-b346-1f9c0f039609', '6cae714c-0902-4802-9db4-c7e1432065fe', 'ed17a265-596d-4431-b9d8-a511407243d2', '9e4740d2-aa27-4005-a5b1-cf53bfe88cb1'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:30:11 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-b8861051-09e9-44c8-8654-719c31adcd02 tempest-GroupsV320Test-971180477 None] Create group completed successfully. Aug 26 14:30:11 devstack sudo[105466]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:11 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e8c35f8e-5e88-4741-b47e-08890de7fdf4 tempest-VolumesActionsTest-362336132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ad3bceba-4d76-4fab-9751-27dfea30145d" returned: 0 in 0.461s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:11 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e8c35f8e-5e88-4741-b47e-08890de7fdf4 tempest-VolumesActionsTest-362336132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ad3bceba-4d76-4fab-9751-27dfea30145d {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:11 devstack sudo[105473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ad3bceba-4d76-4fab-9751-27dfea30145d Aug 26 14:30:11 devstack sudo[105473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:11 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-f57aa85f-5b95-4473-a7e4-7538dc00d44e tempest-VolumeQuotasAdminTestJSON-222159702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:30:11 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-f57aa85f-5b95-4473-a7e4-7538dc00d44e tempest-VolumeQuotasAdminTestJSON-222159702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:30:11 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-f57aa85f-5b95-4473-a7e4-7538dc00d44e tempest-VolumeQuotasAdminTestJSON-222159702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:30:11 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-f57aa85f-5b95-4473-a7e4-7538dc00d44e tempest-VolumeQuotasAdminTestJSON-222159702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:30:11 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-f57aa85f-5b95-4473-a7e4-7538dc00d44e tempest-VolumeQuotasAdminTestJSON-222159702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:30:11 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-f57aa85f-5b95-4473-a7e4-7538dc00d44e tempest-VolumeQuotasAdminTestJSON-222159702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:11 devstack sudo[105475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:30:11 devstack sudo[105475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:11 devstack sudo[105473]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:11 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e8c35f8e-5e88-4741-b47e-08890de7fdf4 tempest-VolumesActionsTest-362336132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ad3bceba-4d76-4fab-9751-27dfea30145d" returned: 0 in 0.311s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:11 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-e8c35f8e-5e88-4741-b47e-08890de7fdf4 tempest-VolumesActionsTest-362336132 None] Lock "cinder-quobyte-ad3bceba-4d76-4fab-9751-27dfea30145d" released by "delete_volume" :: held 0.825s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:30:11 devstack sudo[105475]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:11 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-e8c35f8e-5e88-4741-b47e-08890de7fdf4 tempest-VolumesActionsTest-362336132 None] Created reservations ['b35b8897-fdae-4d21-8508-91b0bc9bdca1', 'd23eaf7e-d73b-431c-8788-44aebbd871e1', 'd709c0e2-0848-4002-a106-cd6394e1d922', '02a93c1e-83be-4f17-a7b4-b6cf552010e4'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:30:11 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-f57aa85f-5b95-4473-a7e4-7538dc00d44e tempest-VolumeQuotasAdminTestJSON-222159702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.320s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:11 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-f57aa85f-5b95-4473-a7e4-7538dc00d44e tempest-VolumeQuotasAdminTestJSON-222159702 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:30:11 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-f57aa85f-5b95-4473-a7e4-7538dc00d44e tempest-VolumeQuotasAdminTestJSON-222159702 None] Deleted volume successfully. Aug 26 14:30:11 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-f57aa85f-5b95-4473-a7e4-7538dc00d44e tempest-VolumeQuotasAdminTestJSON-222159702 None] Lock "cinder-f487ab9c-3734-4cfb-8d6d-76ffc84d0919-delete_volume" released by "delete_volume" :: held 1.465s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:30:11 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e8c35f8e-5e88-4741-b47e-08890de7fdf4 tempest-VolumesActionsTest-362336132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:30:11 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e8c35f8e-5e88-4741-b47e-08890de7fdf4 tempest-VolumesActionsTest-362336132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:30:11 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-e8c35f8e-5e88-4741-b47e-08890de7fdf4 tempest-VolumesActionsTest-362336132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:30:11 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-e8c35f8e-5e88-4741-b47e-08890de7fdf4 tempest-VolumesActionsTest-362336132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:30:11 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e8c35f8e-5e88-4741-b47e-08890de7fdf4 tempest-VolumesActionsTest-362336132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:30:11 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e8c35f8e-5e88-4741-b47e-08890de7fdf4 tempest-VolumesActionsTest-362336132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:11 devstack sudo[105479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:30:11 devstack sudo[105479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:11 devstack sudo[105479]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:11 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e8c35f8e-5e88-4741-b47e-08890de7fdf4 tempest-VolumesActionsTest-362336132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.337s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:11 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-e8c35f8e-5e88-4741-b47e-08890de7fdf4 tempest-VolumesActionsTest-362336132 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:30:11 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-e8c35f8e-5e88-4741-b47e-08890de7fdf4 tempest-VolumesActionsTest-362336132 None] Deleted volume successfully. Aug 26 14:30:11 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-e8c35f8e-5e88-4741-b47e-08890de7fdf4 tempest-VolumesActionsTest-362336132 None] Lock "cinder-ad3bceba-4d76-4fab-9751-27dfea30145d-delete_volume" released by "delete_volume" :: held 1.445s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:30:12 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-d6f53316-5c0f-4a66-a20c-06a5e38cdba6 tempest-GroupsV320Test-971180477 None] Created reservations ['e9961c83-9c74-428d-b5ec-cb758d67f678'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:30:12 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-d6f53316-5c0f-4a66-a20c-06a5e38cdba6 tempest-GroupsV320Test-971180477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:30:12 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-d6f53316-5c0f-4a66-a20c-06a5e38cdba6 tempest-GroupsV320Test-971180477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:30:12 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-d6f53316-5c0f-4a66-a20c-06a5e38cdba6 tempest-GroupsV320Test-971180477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:30:12 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-d6f53316-5c0f-4a66-a20c-06a5e38cdba6 tempest-GroupsV320Test-971180477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:30:12 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-d6f53316-5c0f-4a66-a20c-06a5e38cdba6 tempest-GroupsV320Test-971180477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:30:12 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-d6f53316-5c0f-4a66-a20c-06a5e38cdba6 tempest-GroupsV320Test-971180477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:12 devstack sudo[105482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:30:12 devstack sudo[105482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:13 devstack sudo[105482]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:13 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-d6f53316-5c0f-4a66-a20c-06a5e38cdba6 tempest-GroupsV320Test-971180477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.290s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:13 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-d6f53316-5c0f-4a66-a20c-06a5e38cdba6 tempest-GroupsV320Test-971180477 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:30:13 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-d6f53316-5c0f-4a66-a20c-06a5e38cdba6 tempest-GroupsV320Test-971180477 None] Delete group completed successfully. Aug 26 14:30:13 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-6695f52f-1a1e-4ba3-a962-39577d9a0109 tempest-VolumesCloneNegativeTest-1251521118 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:30:13 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-6695f52f-1a1e-4ba3-a962-39577d9a0109 tempest-VolumesCloneNegativeTest-1251521118 None] Flow 'volume_create_manager' (ba8be782-e3a6-45e6-b088-bf4c9cb8f71e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:30:13 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-6695f52f-1a1e-4ba3-a962-39577d9a0109 tempest-VolumesCloneNegativeTest-1251521118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (776bbbb5-3290-43e2-9a8b-2b5da46c3d0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:30:13 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-6695f52f-1a1e-4ba3-a962-39577d9a0109 tempest-VolumesCloneNegativeTest-1251521118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (776bbbb5-3290-43e2-9a8b-2b5da46c3d0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:30:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-160928164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad158131-baf7-4f88-8460-3e890e38565a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67ee9f4b789d44d8b6c8f12e8773d7c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:30:13Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:30:13Z,use_quota=True,user_id='0ecec4a387d34ec3a31d9b9a3d15c03a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:30:13 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-6695f52f-1a1e-4ba3-a962-39577d9a0109 tempest-VolumesCloneNegativeTest-1251521118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b66b87a5-27e4-4ba0-a79d-be979f45529a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:30:13 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-6695f52f-1a1e-4ba3-a962-39577d9a0109 tempest-VolumesCloneNegativeTest-1251521118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b66b87a5-27e4-4ba0-a79d-be979f45529a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:30:13 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-6695f52f-1a1e-4ba3-a962-39577d9a0109 tempest-VolumesCloneNegativeTest-1251521118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3559fc36-bb0d-4919-ab80-19c704e1b1a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:30:13 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-6695f52f-1a1e-4ba3-a962-39577d9a0109 tempest-VolumesCloneNegativeTest-1251521118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3559fc36-bb0d-4919-ab80-19c704e1b1a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad158131-baf7-4f88-8460-3e890e38565a', 'volume_name': 'volume-ad158131-baf7-4f88-8460-3e890e38565a', 'volume_size': 2}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:30:13 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-6695f52f-1a1e-4ba3-a962-39577d9a0109 tempest-VolumesCloneNegativeTest-1251521118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae0d60b8-997f-49e1-9f4f-07c537ab76e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:30:13 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-6695f52f-1a1e-4ba3-a962-39577d9a0109 tempest-VolumesCloneNegativeTest-1251521118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae0d60b8-997f-49e1-9f4f-07c537ab76e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:30:13 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-6695f52f-1a1e-4ba3-a962-39577d9a0109 tempest-VolumesCloneNegativeTest-1251521118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66866f2a-2eda-4a76-a23a-366385d35b9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:30:13 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-6695f52f-1a1e-4ba3-a962-39577d9a0109 tempest-VolumesCloneNegativeTest-1251521118 None] Volume ad158131-baf7-4f88-8460-3e890e38565a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad158131-baf7-4f88-8460-3e890e38565a', 'volume_size': 2} Aug 26 14:30:13 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-6695f52f-1a1e-4ba3-a962-39577d9a0109 tempest-VolumesCloneNegativeTest-1251521118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:30:13 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-6695f52f-1a1e-4ba3-a962-39577d9a0109 tempest-VolumesCloneNegativeTest-1251521118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:30:13 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-6695f52f-1a1e-4ba3-a962-39577d9a0109 tempest-VolumesCloneNegativeTest-1251521118 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:30:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-160928164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad158131-baf7-4f88-8460-3e890e38565a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67ee9f4b789d44d8b6c8f12e8773d7c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:30:13Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:30:13Z,use_quota=True,user_id='0ecec4a387d34ec3a31d9b9a3d15c03a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:30:13 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-6695f52f-1a1e-4ba3-a962-39577d9a0109 tempest-VolumesCloneNegativeTest-1251521118 None] Creating volume ad158131-baf7-4f88-8460-3e890e38565a {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:30:13 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-6695f52f-1a1e-4ba3-a962-39577d9a0109 tempest-VolumesCloneNegativeTest-1251521118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:30:13 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-6695f52f-1a1e-4ba3-a962-39577d9a0109 tempest-VolumesCloneNegativeTest-1251521118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:30:13 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-6695f52f-1a1e-4ba3-a962-39577d9a0109 tempest-VolumesCloneNegativeTest-1251521118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:30:13 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-6695f52f-1a1e-4ba3-a962-39577d9a0109 tempest-VolumesCloneNegativeTest-1251521118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:30:13 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-6695f52f-1a1e-4ba3-a962-39577d9a0109 tempest-VolumesCloneNegativeTest-1251521118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:30:13 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-6695f52f-1a1e-4ba3-a962-39577d9a0109 tempest-VolumesCloneNegativeTest-1251521118 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:30:13 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-6695f52f-1a1e-4ba3-a962-39577d9a0109 tempest-VolumesCloneNegativeTest-1251521118 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:30:13 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-6695f52f-1a1e-4ba3-a962-39577d9a0109 tempest-VolumesCloneNegativeTest-1251521118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ad158131-baf7-4f88-8460-3e890e38565a 2147483648 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:13 devstack sudo[105486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ad158131-baf7-4f88-8460-3e890e38565a 2147483648 Aug 26 14:30:13 devstack sudo[105486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:14 devstack sudo[105486]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:14 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-6695f52f-1a1e-4ba3-a962-39577d9a0109 tempest-VolumesCloneNegativeTest-1251521118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ad158131-baf7-4f88-8460-3e890e38565a 2147483648" returned: 0 in 0.604s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:14 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-6695f52f-1a1e-4ba3-a962-39577d9a0109 tempest-VolumesCloneNegativeTest-1251521118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ad158131-baf7-4f88-8460-3e890e38565a {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:14 devstack sudo[105493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ad158131-baf7-4f88-8460-3e890e38565a Aug 26 14:30:14 devstack sudo[105493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:14 devstack sudo[105493]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:14 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-6695f52f-1a1e-4ba3-a962-39577d9a0109 tempest-VolumesCloneNegativeTest-1251521118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ad158131-baf7-4f88-8460-3e890e38565a" returned: 0 in 0.346s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:14 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-6695f52f-1a1e-4ba3-a962-39577d9a0109 tempest-VolumesCloneNegativeTest-1251521118 None] <== create_volume: return (1007ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:30:14 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-6695f52f-1a1e-4ba3-a962-39577d9a0109 tempest-VolumesCloneNegativeTest-1251521118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:30:14 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-6695f52f-1a1e-4ba3-a962-39577d9a0109 tempest-VolumesCloneNegativeTest-1251521118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66866f2a-2eda-4a76-a23a-366385d35b9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad158131-baf7-4f88-8460-3e890e38565a', 'volume_size': 2}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:30:14 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-6695f52f-1a1e-4ba3-a962-39577d9a0109 tempest-VolumesCloneNegativeTest-1251521118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (305b6c6e-4d47-4d0f-8e27-284781dcd8cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:30:14 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-6695f52f-1a1e-4ba3-a962-39577d9a0109 tempest-VolumesCloneNegativeTest-1251521118 None] Volume volume-ad158131-baf7-4f88-8460-3e890e38565a (ad158131-baf7-4f88-8460-3e890e38565a): created successfully Aug 26 14:30:14 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-6695f52f-1a1e-4ba3-a962-39577d9a0109 tempest-VolumesCloneNegativeTest-1251521118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (305b6c6e-4d47-4d0f-8e27-284781dcd8cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:30:14 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-6695f52f-1a1e-4ba3-a962-39577d9a0109 tempest-VolumesCloneNegativeTest-1251521118 None] Flow 'volume_create_manager' (ba8be782-e3a6-45e6-b088-bf4c9cb8f71e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:30:14 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-6695f52f-1a1e-4ba3-a962-39577d9a0109 tempest-VolumesCloneNegativeTest-1251521118 None] Created volume successfully. Aug 26 14:30:15 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-e213c926-51ba-4b35-909d-70f1624fde77 tempest-VolumesCloneNegativeTest-1251521118 None] Acquiring lock "cinder-ad158131-baf7-4f88-8460-3e890e38565a-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:30:15 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-e213c926-51ba-4b35-909d-70f1624fde77 tempest-VolumesCloneNegativeTest-1251521118 None] Lock "cinder-ad158131-baf7-4f88-8460-3e890e38565a-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:30:15 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-e213c926-51ba-4b35-909d-70f1624fde77 tempest-VolumesCloneNegativeTest-1251521118 None] Acquiring lock "cinder-quobyte-ad158131-baf7-4f88-8460-3e890e38565a" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:30:15 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-e213c926-51ba-4b35-909d-70f1624fde77 tempest-VolumesCloneNegativeTest-1251521118 None] Lock "cinder-quobyte-ad158131-baf7-4f88-8460-3e890e38565a" acquired by "delete_volume" :: waited 0.031s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:30:15 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[f545154f-dfcd-4653-84ba-7f6e20238d19]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:30:15 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e213c926-51ba-4b35-909d-70f1624fde77 tempest-VolumesCloneNegativeTest-1251521118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ad158131-baf7-4f88-8460-3e890e38565a {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:15 devstack sudo[105496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ad158131-baf7-4f88-8460-3e890e38565a Aug 26 14:30:15 devstack sudo[105496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:16 devstack sudo[105496]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:16 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e213c926-51ba-4b35-909d-70f1624fde77 tempest-VolumesCloneNegativeTest-1251521118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ad158131-baf7-4f88-8460-3e890e38565a" returned: 0 in 0.510s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:16 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e213c926-51ba-4b35-909d-70f1624fde77 tempest-VolumesCloneNegativeTest-1251521118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ad158131-baf7-4f88-8460-3e890e38565a {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:16 devstack sudo[105501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ad158131-baf7-4f88-8460-3e890e38565a Aug 26 14:30:16 devstack sudo[105501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:16 devstack sudo[105501]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:16 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e213c926-51ba-4b35-909d-70f1624fde77 tempest-VolumesCloneNegativeTest-1251521118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ad158131-baf7-4f88-8460-3e890e38565a" returned: 0 in 0.330s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:16 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-e213c926-51ba-4b35-909d-70f1624fde77 tempest-VolumesCloneNegativeTest-1251521118 None] Lock "cinder-quobyte-ad158131-baf7-4f88-8460-3e890e38565a" released by "delete_volume" :: held 0.910s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:30:16 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-e213c926-51ba-4b35-909d-70f1624fde77 tempest-VolumesCloneNegativeTest-1251521118 None] Created reservations ['6059c83b-6c6f-445b-bf18-812e7ef71c86', '5bb9d932-f540-433e-95c8-bb817e20fc6e', '1e1e98b1-c0e3-4f17-a1dc-4d06cb16680e', '9e6e430a-1353-41f5-b0c5-1a9ee3ed42e3'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:30:16 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e213c926-51ba-4b35-909d-70f1624fde77 tempest-VolumesCloneNegativeTest-1251521118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:30:16 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e213c926-51ba-4b35-909d-70f1624fde77 tempest-VolumesCloneNegativeTest-1251521118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:30:16 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-e213c926-51ba-4b35-909d-70f1624fde77 tempest-VolumesCloneNegativeTest-1251521118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:30:16 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-e213c926-51ba-4b35-909d-70f1624fde77 tempest-VolumesCloneNegativeTest-1251521118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:30:16 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e213c926-51ba-4b35-909d-70f1624fde77 tempest-VolumesCloneNegativeTest-1251521118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:30:16 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e213c926-51ba-4b35-909d-70f1624fde77 tempest-VolumesCloneNegativeTest-1251521118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:16 devstack sudo[105505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:30:16 devstack sudo[105505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:17 devstack sudo[105505]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:17 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e213c926-51ba-4b35-909d-70f1624fde77 tempest-VolumesCloneNegativeTest-1251521118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.305s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:17 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-e213c926-51ba-4b35-909d-70f1624fde77 tempest-VolumesCloneNegativeTest-1251521118 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:30:17 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-e213c926-51ba-4b35-909d-70f1624fde77 tempest-VolumesCloneNegativeTest-1251521118 None] Deleted volume successfully. Aug 26 14:30:17 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-e213c926-51ba-4b35-909d-70f1624fde77 tempest-VolumesCloneNegativeTest-1251521118 None] Lock "cinder-ad158131-baf7-4f88-8460-3e890e38565a-delete_volume" released by "delete_volume" :: held 1.596s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:30:22 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7a97895-2a0c-4678-843e-e9543e84a0da tempest-SnapshotsActionsTest-695899691 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:30:22 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-b7a97895-2a0c-4678-843e-e9543e84a0da tempest-SnapshotsActionsTest-695899691 None] Flow 'volume_create_manager' (acd1c629-aa9d-4662-9152-5858fbbd4a83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:30:22 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-b7a97895-2a0c-4678-843e-e9543e84a0da tempest-SnapshotsActionsTest-695899691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d5c2c5e-3e5b-4343-85a8-2b20b05b0b6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:30:22 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-b7a97895-2a0c-4678-843e-e9543e84a0da tempest-SnapshotsActionsTest-695899691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d5c2c5e-3e5b-4343-85a8-2b20b05b0b6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:30:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1388851371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fb30b4d-fd01-4922-b4e3-7bb6dfb45943,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e54445bba8d48bf90cc57180a4385bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:30:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:30:22Z,use_quota=True,user_id='08458f30eea644bc96287df23ffd558b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:30:22 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-b7a97895-2a0c-4678-843e-e9543e84a0da tempest-SnapshotsActionsTest-695899691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (295f49f6-8a35-4acc-878a-b5a8fa0715e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:30:22 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-b7a97895-2a0c-4678-843e-e9543e84a0da tempest-SnapshotsActionsTest-695899691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (295f49f6-8a35-4acc-878a-b5a8fa0715e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:30:22 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-b7a97895-2a0c-4678-843e-e9543e84a0da tempest-SnapshotsActionsTest-695899691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a3b1fff-be43-46cf-82da-e115cf2af7e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:30:22 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-b7a97895-2a0c-4678-843e-e9543e84a0da tempest-SnapshotsActionsTest-695899691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a3b1fff-be43-46cf-82da-e115cf2af7e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4fb30b4d-fd01-4922-b4e3-7bb6dfb45943', 'volume_name': 'volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:30:22 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-b7a97895-2a0c-4678-843e-e9543e84a0da tempest-SnapshotsActionsTest-695899691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd4de2f4-2906-458e-9034-273e00c542c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:30:22 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-b7a97895-2a0c-4678-843e-e9543e84a0da tempest-SnapshotsActionsTest-695899691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd4de2f4-2906-458e-9034-273e00c542c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:30:22 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-b7a97895-2a0c-4678-843e-e9543e84a0da tempest-SnapshotsActionsTest-695899691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f227fa3b-fd2d-47c6-897d-173d846c1c8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:30:22 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-b7a97895-2a0c-4678-843e-e9543e84a0da tempest-SnapshotsActionsTest-695899691 None] Volume 4fb30b4d-fd01-4922-b4e3-7bb6dfb45943: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943', 'volume_size': 1} Aug 26 14:30:22 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-b7a97895-2a0c-4678-843e-e9543e84a0da tempest-SnapshotsActionsTest-695899691 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:30:22 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-b7a97895-2a0c-4678-843e-e9543e84a0da tempest-SnapshotsActionsTest-695899691 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:30:22 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-b7a97895-2a0c-4678-843e-e9543e84a0da tempest-SnapshotsActionsTest-695899691 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:30:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1388851371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fb30b4d-fd01-4922-b4e3-7bb6dfb45943,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e54445bba8d48bf90cc57180a4385bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:30:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:30:22Z,use_quota=True,user_id='08458f30eea644bc96287df23ffd558b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:30:22 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-b7a97895-2a0c-4678-843e-e9543e84a0da tempest-SnapshotsActionsTest-695899691 None] Creating volume 4fb30b4d-fd01-4922-b4e3-7bb6dfb45943 {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:30:22 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-b7a97895-2a0c-4678-843e-e9543e84a0da tempest-SnapshotsActionsTest-695899691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:30:22 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-b7a97895-2a0c-4678-843e-e9543e84a0da tempest-SnapshotsActionsTest-695899691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:30:22 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-b7a97895-2a0c-4678-843e-e9543e84a0da tempest-SnapshotsActionsTest-695899691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:30:22 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-b7a97895-2a0c-4678-843e-e9543e84a0da tempest-SnapshotsActionsTest-695899691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:30:22 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-b7a97895-2a0c-4678-843e-e9543e84a0da tempest-SnapshotsActionsTest-695899691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:30:22 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-b7a97895-2a0c-4678-843e-e9543e84a0da tempest-SnapshotsActionsTest-695899691 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:30:22 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-b7a97895-2a0c-4678-843e-e9543e84a0da tempest-SnapshotsActionsTest-695899691 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:30:22 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-b7a97895-2a0c-4678-843e-e9543e84a0da tempest-SnapshotsActionsTest-695899691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:22 devstack sudo[105517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943 1073741824 Aug 26 14:30:22 devstack sudo[105517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:22 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f08b696-824a-4ac7-802e-d8e49563c7a6 tempest-VolumesGetTest-459511347 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:30:22 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-0f08b696-824a-4ac7-802e-d8e49563c7a6 tempest-VolumesGetTest-459511347 None] Flow 'volume_create_manager' (49bd01a9-42ed-468d-8466-324bbc7c1f7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:30:22 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-0f08b696-824a-4ac7-802e-d8e49563c7a6 tempest-VolumesGetTest-459511347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (825a7116-dc0d-4ca7-b477-330a5506b7be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:30:22 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-0f08b696-824a-4ac7-802e-d8e49563c7a6 tempest-VolumesGetTest-459511347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (825a7116-dc0d-4ca7-b477-330a5506b7be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:30:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1204824990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c968ba7-0f3c-4d8d-bcec-27780e7d1872,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='2563771eca7848979f10833a8a104f6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:30:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:30:22Z,use_quota=True,user_id='f811ce7459cc4202a99345871cc95ded',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:30:22 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-0f08b696-824a-4ac7-802e-d8e49563c7a6 tempest-VolumesGetTest-459511347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7dd1179-d5a5-47f1-be16-a2e839b11d74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:30:22 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-0f08b696-824a-4ac7-802e-d8e49563c7a6 tempest-VolumesGetTest-459511347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7dd1179-d5a5-47f1-be16-a2e839b11d74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:30:22 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-0f08b696-824a-4ac7-802e-d8e49563c7a6 tempest-VolumesGetTest-459511347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d827fae-25b5-4ffb-8e85-775d735cfd29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:30:22 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-0f08b696-824a-4ac7-802e-d8e49563c7a6 tempest-VolumesGetTest-459511347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d827fae-25b5-4ffb-8e85-775d735cfd29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c968ba7-0f3c-4d8d-bcec-27780e7d1872', 'volume_name': 'volume-3c968ba7-0f3c-4d8d-bcec-27780e7d1872', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:30:22 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-0f08b696-824a-4ac7-802e-d8e49563c7a6 tempest-VolumesGetTest-459511347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6438f2e-a8a2-4fd4-b39b-4b12e2f020e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:30:22 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-0f08b696-824a-4ac7-802e-d8e49563c7a6 tempest-VolumesGetTest-459511347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6438f2e-a8a2-4fd4-b39b-4b12e2f020e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:30:22 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-0f08b696-824a-4ac7-802e-d8e49563c7a6 tempest-VolumesGetTest-459511347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6317988-6869-4fa3-9129-0f4e5edb40e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:30:22 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-0f08b696-824a-4ac7-802e-d8e49563c7a6 tempest-VolumesGetTest-459511347 None] Volume 3c968ba7-0f3c-4d8d-bcec-27780e7d1872: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c968ba7-0f3c-4d8d-bcec-27780e7d1872', 'volume_size': 1} Aug 26 14:30:22 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-0f08b696-824a-4ac7-802e-d8e49563c7a6 tempest-VolumesGetTest-459511347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:30:23 devstack sudo[105517]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:23 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-b7a97895-2a0c-4678-843e-e9543e84a0da tempest-SnapshotsActionsTest-695899691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943 1073741824" returned: 0 in 0.537s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:23 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-b7a97895-2a0c-4678-843e-e9543e84a0da tempest-SnapshotsActionsTest-695899691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:23 devstack sudo[105525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943 Aug 26 14:30:23 devstack sudo[105525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:23 devstack sudo[105525]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:23 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-b7a97895-2a0c-4678-843e-e9543e84a0da tempest-SnapshotsActionsTest-695899691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943" returned: 0 in 0.318s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:23 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-b7a97895-2a0c-4678-843e-e9543e84a0da tempest-SnapshotsActionsTest-695899691 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:30:23 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-b7a97895-2a0c-4678-843e-e9543e84a0da tempest-SnapshotsActionsTest-695899691 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.900s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:30:23 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-0f08b696-824a-4ac7-802e-d8e49563c7a6 tempest-VolumesGetTest-459511347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.707s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:30:23 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-0f08b696-824a-4ac7-802e-d8e49563c7a6 tempest-VolumesGetTest-459511347 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:30:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1204824990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c968ba7-0f3c-4d8d-bcec-27780e7d1872,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='2563771eca7848979f10833a8a104f6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:30:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:30:22Z,use_quota=True,user_id='f811ce7459cc4202a99345871cc95ded',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:30:23 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-0f08b696-824a-4ac7-802e-d8e49563c7a6 tempest-VolumesGetTest-459511347 None] Creating volume 3c968ba7-0f3c-4d8d-bcec-27780e7d1872 {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:30:23 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-0f08b696-824a-4ac7-802e-d8e49563c7a6 tempest-VolumesGetTest-459511347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:30:23 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-0f08b696-824a-4ac7-802e-d8e49563c7a6 tempest-VolumesGetTest-459511347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:30:23 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-0f08b696-824a-4ac7-802e-d8e49563c7a6 tempest-VolumesGetTest-459511347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:30:23 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-0f08b696-824a-4ac7-802e-d8e49563c7a6 tempest-VolumesGetTest-459511347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:30:23 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-0f08b696-824a-4ac7-802e-d8e49563c7a6 tempest-VolumesGetTest-459511347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:30:23 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-0f08b696-824a-4ac7-802e-d8e49563c7a6 tempest-VolumesGetTest-459511347 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:30:23 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-0f08b696-824a-4ac7-802e-d8e49563c7a6 tempest-VolumesGetTest-459511347 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:30:23 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-0f08b696-824a-4ac7-802e-d8e49563c7a6 tempest-VolumesGetTest-459511347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3c968ba7-0f3c-4d8d-bcec-27780e7d1872 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:23 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-b7a97895-2a0c-4678-843e-e9543e84a0da tempest-SnapshotsActionsTest-695899691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f227fa3b-fd2d-47c6-897d-173d846c1c8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:30:23 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-b7a97895-2a0c-4678-843e-e9543e84a0da tempest-SnapshotsActionsTest-695899691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5dab7c8-cbc7-4221-a1e8-c77ef2ac7022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:30:23 devstack sudo[105528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3c968ba7-0f3c-4d8d-bcec-27780e7d1872 1073741824 Aug 26 14:30:23 devstack sudo[105528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:23 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-b7a97895-2a0c-4678-843e-e9543e84a0da tempest-SnapshotsActionsTest-695899691 None] Volume volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943 (4fb30b4d-fd01-4922-b4e3-7bb6dfb45943): created successfully Aug 26 14:30:23 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-b7a97895-2a0c-4678-843e-e9543e84a0da tempest-SnapshotsActionsTest-695899691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5dab7c8-cbc7-4221-a1e8-c77ef2ac7022) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:30:23 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-b7a97895-2a0c-4678-843e-e9543e84a0da tempest-SnapshotsActionsTest-695899691 None] Flow 'volume_create_manager' (acd1c629-aa9d-4662-9152-5858fbbd4a83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:30:23 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-b7a97895-2a0c-4678-843e-e9543e84a0da tempest-SnapshotsActionsTest-695899691 None] Created volume successfully. Aug 26 14:30:24 devstack sudo[105528]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:24 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-0f08b696-824a-4ac7-802e-d8e49563c7a6 tempest-VolumesGetTest-459511347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3c968ba7-0f3c-4d8d-bcec-27780e7d1872 1073741824" returned: 0 in 0.525s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:24 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-0f08b696-824a-4ac7-802e-d8e49563c7a6 tempest-VolumesGetTest-459511347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3c968ba7-0f3c-4d8d-bcec-27780e7d1872 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:24 devstack sudo[105534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3c968ba7-0f3c-4d8d-bcec-27780e7d1872 Aug 26 14:30:24 devstack sudo[105534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:24 devstack sudo[105534]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:24 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-0f08b696-824a-4ac7-802e-d8e49563c7a6 tempest-VolumesGetTest-459511347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3c968ba7-0f3c-4d8d-bcec-27780e7d1872" returned: 0 in 0.308s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:24 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-0f08b696-824a-4ac7-802e-d8e49563c7a6 tempest-VolumesGetTest-459511347 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:30:24 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-0f08b696-824a-4ac7-802e-d8e49563c7a6 tempest-VolumesGetTest-459511347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.887s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:30:24 devstack cinder-volume[94394]: DEBUG dbcounter [-] [94394] Writing DB stats cinder:SELECT=176,cinder:UPDATE=228,cinder:INSERT=51,cinder:DELETE=18 {{(pid=94394) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 14:30:24 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-0f08b696-824a-4ac7-802e-d8e49563c7a6 tempest-VolumesGetTest-459511347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6317988-6869-4fa3-9129-0f4e5edb40e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c968ba7-0f3c-4d8d-bcec-27780e7d1872', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:30:24 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-0f08b696-824a-4ac7-802e-d8e49563c7a6 tempest-VolumesGetTest-459511347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfcf2b0f-73b4-4402-96d9-199320e6ae40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:30:24 devstack cinder-volume[94394]: DEBUG dbcounter [-] [94394] Writing DB stats cinder:SELECT=165,cinder:UPDATE=232,cinder:INSERT=59,cinder:DELETE=20 {{(pid=94394) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 14:30:24 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-0f08b696-824a-4ac7-802e-d8e49563c7a6 tempest-VolumesGetTest-459511347 None] Volume volume-3c968ba7-0f3c-4d8d-bcec-27780e7d1872 (3c968ba7-0f3c-4d8d-bcec-27780e7d1872): created successfully Aug 26 14:30:24 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-0f08b696-824a-4ac7-802e-d8e49563c7a6 tempest-VolumesGetTest-459511347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfcf2b0f-73b4-4402-96d9-199320e6ae40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:30:24 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-0f08b696-824a-4ac7-802e-d8e49563c7a6 tempest-VolumesGetTest-459511347 None] Flow 'volume_create_manager' (49bd01a9-42ed-468d-8466-324bbc7c1f7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:30:24 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-0f08b696-824a-4ac7-802e-d8e49563c7a6 tempest-VolumesGetTest-459511347 None] Created volume successfully. Aug 26 14:30:24 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e2bf2355-1430-40dd-9eb2-be627b02d6e3 tempest-SnapshotsActionsTest-695899691 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:30:24 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e2bf2355-1430-40dd-9eb2-be627b02d6e3 tempest-SnapshotsActionsTest-695899691 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:30:24 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-e2bf2355-1430-40dd-9eb2-be627b02d6e3 tempest-SnapshotsActionsTest-695899691 None] Creating offline snapshot 9a2cb941-51f1-4661-b104-c9713dced550 of volume 4fb30b4d-fd01-4922-b4e3-7bb6dfb45943 {{(pid=94394) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 14:30:24 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[83e94e10-3a95-4ad8-bdf0-960aa7020626]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:30:24 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e2bf2355-1430-40dd-9eb2-be627b02d6e3 tempest-SnapshotsActionsTest-695899691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:24 devstack sudo[105537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943 Aug 26 14:30:24 devstack sudo[105537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:25 devstack sudo[105537]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:25 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e2bf2355-1430-40dd-9eb2-be627b02d6e3 tempest-SnapshotsActionsTest-695899691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943" returned: 0 in 0.397s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:25 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e2bf2355-1430-40dd-9eb2-be627b02d6e3 tempest-SnapshotsActionsTest-695899691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.9a2cb941-51f1-4661-b104-c9713dced550 1G {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:25 devstack sudo[105542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.9a2cb941-51f1-4661-b104-c9713dced550 1G Aug 26 14:30:25 devstack sudo[105542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:25 devstack sudo[105542]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:25 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e2bf2355-1430-40dd-9eb2-be627b02d6e3 tempest-SnapshotsActionsTest-695899691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.9a2cb941-51f1-4661-b104-c9713dced550 1G" returned: 0 in 0.552s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:25 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e2bf2355-1430-40dd-9eb2-be627b02d6e3 tempest-SnapshotsActionsTest-695899691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943 -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.9a2cb941-51f1-4661-b104-c9713dced550 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:25 devstack sudo[105548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943 -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.9a2cb941-51f1-4661-b104-c9713dced550 Aug 26 14:30:25 devstack sudo[105548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:26 devstack sudo[105548]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:26 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e2bf2355-1430-40dd-9eb2-be627b02d6e3 tempest-SnapshotsActionsTest-695899691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943 -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.9a2cb941-51f1-4661-b104-c9713dced550" returned: 0 in 0.408s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:26 devstack cinder-volume[94394]: WARNING cinder.volume.drivers.remotefs [None req-e2bf2355-1430-40dd-9eb2-be627b02d6e3 tempest-SnapshotsActionsTest-695899691 None] /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.9a2cb941-51f1-4661-b104-c9713dced550 is being set with open permissions: ugo+rw Aug 26 14:30:26 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e2bf2355-1430-40dd-9eb2-be627b02d6e3 tempest-SnapshotsActionsTest-695899691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.9a2cb941-51f1-4661-b104-c9713dced550 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:26 devstack sudo[105553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.9a2cb941-51f1-4661-b104-c9713dced550 Aug 26 14:30:26 devstack sudo[105553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:26 devstack sudo[105553]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:26 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e2bf2355-1430-40dd-9eb2-be627b02d6e3 tempest-SnapshotsActionsTest-695899691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.9a2cb941-51f1-4661-b104-c9713dced550" returned: 0 in 0.433s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:26 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a4b1034-0ba1-44f1-aa14-efd15f4985df tempest-VolumesGetTest-459511347 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:30:26 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-0a4b1034-0ba1-44f1-aa14-efd15f4985df tempest-VolumesGetTest-459511347 None] Flow 'volume_create_manager' (c55a657e-5aa6-408c-adf5-33e637f10a30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:30:26 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-0a4b1034-0ba1-44f1-aa14-efd15f4985df tempest-VolumesGetTest-459511347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f45c5216-188b-4f98-a981-5f9bd534e016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:30:26 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-0a4b1034-0ba1-44f1-aa14-efd15f4985df tempest-VolumesGetTest-459511347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f45c5216-188b-4f98-a981-5f9bd534e016) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:30:26Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-879691254',display_name='tempest-VolumesGetTest-Volume-445368507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eccbd2c7-d9a5-429d-8ed4-5467644454e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2563771eca7848979f10833a8a104f6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:30:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:30:26Z,use_quota=True,user_id='f811ce7459cc4202a99345871cc95ded',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:30:26 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-0a4b1034-0ba1-44f1-aa14-efd15f4985df tempest-VolumesGetTest-459511347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97dc9838-ede2-429a-b949-06a4a238e014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:30:26 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-0a4b1034-0ba1-44f1-aa14-efd15f4985df tempest-VolumesGetTest-459511347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97dc9838-ede2-429a-b949-06a4a238e014) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:30:26 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-0a4b1034-0ba1-44f1-aa14-efd15f4985df tempest-VolumesGetTest-459511347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99bc1597-2552-4b42-a0a7-7172eaf9d2cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:30:26 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-0a4b1034-0ba1-44f1-aa14-efd15f4985df tempest-VolumesGetTest-459511347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99bc1597-2552-4b42-a0a7-7172eaf9d2cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eccbd2c7-d9a5-429d-8ed4-5467644454e4', 'volume_name': 'volume-eccbd2c7-d9a5-429d-8ed4-5467644454e4', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:30:26 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-0a4b1034-0ba1-44f1-aa14-efd15f4985df tempest-VolumesGetTest-459511347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f2742ee-1ca7-480a-81fd-563a5f82cc81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:30:26 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-0a4b1034-0ba1-44f1-aa14-efd15f4985df tempest-VolumesGetTest-459511347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f2742ee-1ca7-480a-81fd-563a5f82cc81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:30:26 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-0a4b1034-0ba1-44f1-aa14-efd15f4985df tempest-VolumesGetTest-459511347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90bb63af-364c-43ca-adc3-dddce315361c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:30:26 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-0a4b1034-0ba1-44f1-aa14-efd15f4985df tempest-VolumesGetTest-459511347 None] Volume eccbd2c7-d9a5-429d-8ed4-5467644454e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eccbd2c7-d9a5-429d-8ed4-5467644454e4', 'volume_size': 1} Aug 26 14:30:26 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-0a4b1034-0ba1-44f1-aa14-efd15f4985df tempest-VolumesGetTest-459511347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:30:26 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e2bf2355-1430-40dd-9eb2-be627b02d6e3 tempest-SnapshotsActionsTest-695899691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.info {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:26 devstack sudo[105592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.info Aug 26 14:30:26 devstack sudo[105592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:27 devstack sudo[105592]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:27 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e2bf2355-1430-40dd-9eb2-be627b02d6e3 tempest-SnapshotsActionsTest-695899691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.info" returned: 0 in 0.305s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:27 devstack cinder-volume[94394]: WARNING cinder.volume.drivers.remotefs [None req-e2bf2355-1430-40dd-9eb2-be627b02d6e3 tempest-SnapshotsActionsTest-695899691 None] /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.info is being set with open permissions: ugo+rw Aug 26 14:30:27 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e2bf2355-1430-40dd-9eb2-be627b02d6e3 tempest-SnapshotsActionsTest-695899691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.info {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:27 devstack sudo[105595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.info Aug 26 14:30:27 devstack sudo[105595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:27 devstack sudo[105595]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:27 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e2bf2355-1430-40dd-9eb2-be627b02d6e3 tempest-SnapshotsActionsTest-695899691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.info" returned: 0 in 0.260s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:27 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e2bf2355-1430-40dd-9eb2-be627b02d6e3 tempest-SnapshotsActionsTest-695899691 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.602s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:30:27 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-0a4b1034-0ba1-44f1-aa14-efd15f4985df tempest-VolumesGetTest-459511347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.626s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:30:27 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-0a4b1034-0ba1-44f1-aa14-efd15f4985df tempest-VolumesGetTest-459511347 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:30:26Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-879691254',display_name='tempest-VolumesGetTest-Volume-445368507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eccbd2c7-d9a5-429d-8ed4-5467644454e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2563771eca7848979f10833a8a104f6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:30:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:30:26Z,use_quota=True,user_id='f811ce7459cc4202a99345871cc95ded',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:30:27 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-0a4b1034-0ba1-44f1-aa14-efd15f4985df tempest-VolumesGetTest-459511347 None] Creating volume eccbd2c7-d9a5-429d-8ed4-5467644454e4 {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:30:27 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-0a4b1034-0ba1-44f1-aa14-efd15f4985df tempest-VolumesGetTest-459511347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:30:27 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-0a4b1034-0ba1-44f1-aa14-efd15f4985df tempest-VolumesGetTest-459511347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:30:27 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-0a4b1034-0ba1-44f1-aa14-efd15f4985df tempest-VolumesGetTest-459511347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:30:27 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-0a4b1034-0ba1-44f1-aa14-efd15f4985df tempest-VolumesGetTest-459511347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:30:27 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-0a4b1034-0ba1-44f1-aa14-efd15f4985df tempest-VolumesGetTest-459511347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:30:27 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-0a4b1034-0ba1-44f1-aa14-efd15f4985df tempest-VolumesGetTest-459511347 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:30:27 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-0a4b1034-0ba1-44f1-aa14-efd15f4985df tempest-VolumesGetTest-459511347 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:30:27 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-0a4b1034-0ba1-44f1-aa14-efd15f4985df tempest-VolumesGetTest-459511347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-eccbd2c7-d9a5-429d-8ed4-5467644454e4 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:27 devstack sudo[105598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-eccbd2c7-d9a5-429d-8ed4-5467644454e4 1073741824 Aug 26 14:30:27 devstack sudo[105598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:27 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-e2bf2355-1430-40dd-9eb2-be627b02d6e3 tempest-SnapshotsActionsTest-695899691 None] Create snapshot completed successfully Aug 26 14:30:27 devstack sudo[105598]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:27 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-0a4b1034-0ba1-44f1-aa14-efd15f4985df tempest-VolumesGetTest-459511347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-eccbd2c7-d9a5-429d-8ed4-5467644454e4 1073741824" returned: 0 in 0.597s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:27 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddcaf7be-b765-4ce9-9344-89269e9f2ce6 tempest-VolumesImageMetadata-621021804 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:30:27 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-ddcaf7be-b765-4ce9-9344-89269e9f2ce6 tempest-VolumesImageMetadata-621021804 None] Flow 'volume_create_manager' (92acab01-7d63-4cd1-a569-8cd17cc2a43f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:30:27 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-ddcaf7be-b765-4ce9-9344-89269e9f2ce6 tempest-VolumesImageMetadata-621021804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26b8757e-754f-45e1-8c0e-ec3daad18467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:30:28 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-ddcaf7be-b765-4ce9-9344-89269e9f2ce6 tempest-VolumesImageMetadata-621021804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26b8757e-754f-45e1-8c0e-ec3daad18467) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:30:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1456384975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbb85bbc-eda5-46cb-adce-510c281f7ce6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dabb6ce8199f4a8497f8bad2e7baf442',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:30:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:30:28Z,use_quota=True,user_id='52d24f4c145b4308af2d531b6e1bd4f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:30:28 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-ddcaf7be-b765-4ce9-9344-89269e9f2ce6 tempest-VolumesImageMetadata-621021804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6259eb6f-0922-440f-a1c0-65b78a684eb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:30:28 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-ddcaf7be-b765-4ce9-9344-89269e9f2ce6 tempest-VolumesImageMetadata-621021804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6259eb6f-0922-440f-a1c0-65b78a684eb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:30:28 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-ddcaf7be-b765-4ce9-9344-89269e9f2ce6 tempest-VolumesImageMetadata-621021804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06a46a4e-d372-423b-869e-4778e5e37933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:30:28 devstack cinder-volume[94394]: DEBUG cinder.image.glance [None req-ddcaf7be-b765-4ce9-9344-89269e9f2ce6 tempest-VolumesImageMetadata-621021804 None] Creating Keystone auth plugin from conf {{(pid=94394) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 26 14:30:28 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-0a4b1034-0ba1-44f1-aa14-efd15f4985df tempest-VolumesGetTest-459511347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-eccbd2c7-d9a5-429d-8ed4-5467644454e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:28 devstack sudo[105604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-eccbd2c7-d9a5-429d-8ed4-5467644454e4 Aug 26 14:30:28 devstack sudo[105604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:28 devstack sudo[105604]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:28 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-0a4b1034-0ba1-44f1-aa14-efd15f4985df tempest-VolumesGetTest-459511347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-eccbd2c7-d9a5-429d-8ed4-5467644454e4" returned: 0 in 0.286s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:28 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-0a4b1034-0ba1-44f1-aa14-efd15f4985df tempest-VolumesGetTest-459511347 None] <== create_volume: return (1009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:30:28 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-0a4b1034-0ba1-44f1-aa14-efd15f4985df tempest-VolumesGetTest-459511347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.012s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:30:28 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-0a4b1034-0ba1-44f1-aa14-efd15f4985df tempest-VolumesGetTest-459511347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90bb63af-364c-43ca-adc3-dddce315361c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eccbd2c7-d9a5-429d-8ed4-5467644454e4', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:30:28 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-0a4b1034-0ba1-44f1-aa14-efd15f4985df tempest-VolumesGetTest-459511347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09793235-aeda-417f-90d6-7b4b3f0ba0fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:30:28 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-0a4b1034-0ba1-44f1-aa14-efd15f4985df tempest-VolumesGetTest-459511347 None] Volume volume-eccbd2c7-d9a5-429d-8ed4-5467644454e4 (eccbd2c7-d9a5-429d-8ed4-5467644454e4): created successfully Aug 26 14:30:28 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-0a4b1034-0ba1-44f1-aa14-efd15f4985df tempest-VolumesGetTest-459511347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09793235-aeda-417f-90d6-7b4b3f0ba0fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:30:28 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-0a4b1034-0ba1-44f1-aa14-efd15f4985df tempest-VolumesGetTest-459511347 None] Flow 'volume_create_manager' (c55a657e-5aa6-408c-adf5-33e637f10a30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:30:28 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-0a4b1034-0ba1-44f1-aa14-efd15f4985df tempest-VolumesGetTest-459511347 None] Created volume successfully. Aug 26 14:30:28 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-1f1202bf-ebda-47ac-bbd1-8fb666201b2d tempest-SnapshotsActionsTest-695899691 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:30:28 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-1f1202bf-ebda-47ac-bbd1-8fb666201b2d tempest-SnapshotsActionsTest-695899691 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:30:28 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-1f1202bf-ebda-47ac-bbd1-8fb666201b2d tempest-SnapshotsActionsTest-695899691 None] Creating offline snapshot 5d6546e9-18f3-449c-8a70-f617d1c718cf of volume 4fb30b4d-fd01-4922-b4e3-7bb6dfb45943 {{(pid=94394) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 14:30:28 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d86fd63-c6e8-4227-87a0-d60b60ab2352]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:30:28 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-1f1202bf-ebda-47ac-bbd1-8fb666201b2d tempest-SnapshotsActionsTest-695899691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.9a2cb941-51f1-4661-b104-c9713dced550 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:28 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-ddcaf7be-b765-4ce9-9344-89269e9f2ce6 tempest-VolumesImageMetadata-621021804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06a46a4e-d372-423b-869e-4778e5e37933) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cbb85bbc-eda5-46cb-adce-510c281f7ce6', 'volume_name': 'volume-cbb85bbc-eda5-46cb-adce-510c281f7ce6', 'volume_size': 1, 'image_id': '2681f5d8-1c86-4dfd-86fb-c29aaed49dc6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2681f5d8-1c86-4dfd-86fb-c29aaed49dc6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cbf977c46caa48c18e414079bf75016d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2681f5d8-1c86-4dfd-86fb-c29aaed49dc6', 'created_at': datetime.datetime(2026, 8, 26, 12, 16, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 12, 16, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2681f5d8-1c86-4dfd-86fb-c29aaed49dc6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:30:28 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-ddcaf7be-b765-4ce9-9344-89269e9f2ce6 tempest-VolumesImageMetadata-621021804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09e759c1-a066-40bb-bc29-1cce025992b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:30:28 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-ddcaf7be-b765-4ce9-9344-89269e9f2ce6 tempest-VolumesImageMetadata-621021804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09e759c1-a066-40bb-bc29-1cce025992b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:30:28 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-ddcaf7be-b765-4ce9-9344-89269e9f2ce6 tempest-VolumesImageMetadata-621021804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0a207b1-3e2e-4c53-b9f3-1ced1bc0eb0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:30:28 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-ddcaf7be-b765-4ce9-9344-89269e9f2ce6 tempest-VolumesImageMetadata-621021804 None] Volume cbb85bbc-eda5-46cb-adce-510c281f7ce6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cbb85bbc-eda5-46cb-adce-510c281f7ce6', 'volume_size': 1, 'image_id': '2681f5d8-1c86-4dfd-86fb-c29aaed49dc6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2681f5d8-1c86-4dfd-86fb-c29aaed49dc6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cbf977c46caa48c18e414079bf75016d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2681f5d8-1c86-4dfd-86fb-c29aaed49dc6', 'created_at': datetime.datetime(2026, 8, 26, 12, 16, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 12, 16, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2681f5d8-1c86-4dfd-86fb-c29aaed49dc6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 26 14:30:28 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddcaf7be-b765-4ce9-9344-89269e9f2ce6 tempest-VolumesImageMetadata-621021804 None] Trying to clone cbb85bbc-eda5-46cb-adce-510c281f7ce6 from image 2681f5d8-1c86-4dfd-86fb-c29aaed49dc6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/2681f5d8-1c86-4dfd-86fb-c29aaed49dc6', 'metadata': {}}]). {{(pid=94394) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 26 14:30:28 devstack sudo[105607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.9a2cb941-51f1-4661-b104-c9713dced550 Aug 26 14:30:28 devstack sudo[105607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:28 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-4239680d-82c8-4d0c-9717-6d8ae0614330 tempest-VolumesGetTest-459511347 None] Acquiring lock "cinder-eccbd2c7-d9a5-429d-8ed4-5467644454e4-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:30:28 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-4239680d-82c8-4d0c-9717-6d8ae0614330 tempest-VolumesGetTest-459511347 None] Lock "cinder-eccbd2c7-d9a5-429d-8ed4-5467644454e4-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:30:29 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-4239680d-82c8-4d0c-9717-6d8ae0614330 tempest-VolumesGetTest-459511347 None] Acquiring lock "cinder-quobyte-eccbd2c7-d9a5-429d-8ed4-5467644454e4" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:30:29 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-4239680d-82c8-4d0c-9717-6d8ae0614330 tempest-VolumesGetTest-459511347 None] Lock "cinder-quobyte-eccbd2c7-d9a5-429d-8ed4-5467644454e4" acquired by "delete_volume" :: waited 0.047s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:30:29 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3cb1e71-8a39-4e3f-b44f-bda4858a4090]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:30:29 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4239680d-82c8-4d0c-9717-6d8ae0614330 tempest-VolumesGetTest-459511347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-eccbd2c7-d9a5-429d-8ed4-5467644454e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:29 devstack sudo[105607]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:29 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-1f1202bf-ebda-47ac-bbd1-8fb666201b2d tempest-SnapshotsActionsTest-695899691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.9a2cb941-51f1-4661-b104-c9713dced550" returned: 0 in 0.468s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:29 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-1f1202bf-ebda-47ac-bbd1-8fb666201b2d tempest-SnapshotsActionsTest-695899691 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94394) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 14:30:29 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-1f1202bf-ebda-47ac-bbd1-8fb666201b2d tempest-SnapshotsActionsTest-695899691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.9a2cb941-51f1-4661-b104-c9713dced550,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.5d6546e9-18f3-449c-8a70-f617d1c718cf 1G {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:29 devstack sudo[105614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.9a2cb941-51f1-4661-b104-c9713dced550,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.5d6546e9-18f3-449c-8a70-f617d1c718cf 1G Aug 26 14:30:29 devstack sudo[105614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:29 devstack cinder-volume[94394]: DEBUG cinder.image.image_utils [None req-ddcaf7be-b765-4ce9-9344-89269e9f2ce6 tempest-VolumesImageMetadata-621021804 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2681f5d8-1c86-4dfd-86fb-c29aaed49dc6_e03nl2_ndevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=94394) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 26 14:30:29 devstack cinder-volume[94394]: INFO cinder.image.image_utils [None req-ddcaf7be-b765-4ce9-9344-89269e9f2ce6 tempest-VolumesImageMetadata-621021804 None] Image download 20.69 MB at 20.69 MB/s Aug 26 14:30:29 devstack sudo[105613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-eccbd2c7-d9a5-429d-8ed4-5467644454e4 Aug 26 14:30:29 devstack sudo[105613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:29 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[d984ba1e-195f-4f81-ac09-7a296037a93f]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:30:29 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-ddcaf7be-b765-4ce9-9344-89269e9f2ce6 tempest-VolumesImageMetadata-621021804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2681f5d8-1c86-4dfd-86fb-c29aaed49dc6_e03nl2_ndevstack@QuobyteHD {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:29 devstack sudo[105617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2681f5d8-1c86-4dfd-86fb-c29aaed49dc6_e03nl2_ndevstack@QuobyteHD Aug 26 14:30:29 devstack sudo[105617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:29 devstack sudo[105613]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:29 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4239680d-82c8-4d0c-9717-6d8ae0614330 tempest-VolumesGetTest-459511347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-eccbd2c7-d9a5-429d-8ed4-5467644454e4" returned: 0 in 0.472s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:29 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4239680d-82c8-4d0c-9717-6d8ae0614330 tempest-VolumesGetTest-459511347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-eccbd2c7-d9a5-429d-8ed4-5467644454e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:29 devstack sudo[105626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-eccbd2c7-d9a5-429d-8ed4-5467644454e4 Aug 26 14:30:29 devstack sudo[105626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:29 devstack sudo[105617]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:29 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-ddcaf7be-b765-4ce9-9344-89269e9f2ce6 tempest-VolumesImageMetadata-621021804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2681f5d8-1c86-4dfd-86fb-c29aaed49dc6_e03nl2_ndevstack@QuobyteHD" returned: 0 in 0.407s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:29 devstack cinder-volume[94394]: DEBUG cinder.image.image_utils [None req-ddcaf7be-b765-4ce9-9344-89269e9f2ce6 tempest-VolumesImageMetadata-621021804 None] Temporary image 2681f5d8-1c86-4dfd-86fb-c29aaed49dc6 is fetched for user 52d24f4c145b4308af2d531b6e1bd4f5. {{(pid=94394) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 26 14:30:29 devstack sudo[105614]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:29 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-1f1202bf-ebda-47ac-bbd1-8fb666201b2d tempest-SnapshotsActionsTest-695899691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.9a2cb941-51f1-4661-b104-c9713dced550,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.5d6546e9-18f3-449c-8a70-f617d1c718cf 1G" returned: 0 in 0.611s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:29 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-1f1202bf-ebda-47ac-bbd1-8fb666201b2d tempest-SnapshotsActionsTest-695899691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.9a2cb941-51f1-4661-b104-c9713dced550 -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.5d6546e9-18f3-449c-8a70-f617d1c718cf {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:29 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cb0d51f-c502-4c6f-aef1-ae1ce7693f47]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:30:29 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-ddcaf7be-b765-4ce9-9344-89269e9f2ce6 tempest-VolumesImageMetadata-621021804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2681f5d8-1c86-4dfd-86fb-c29aaed49dc6_e03nl2_ndevstack@QuobyteHD {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:29 devstack sudo[105631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.9a2cb941-51f1-4661-b104-c9713dced550 -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.5d6546e9-18f3-449c-8a70-f617d1c718cf Aug 26 14:30:29 devstack sudo[105631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:29 devstack sudo[105626]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:29 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4239680d-82c8-4d0c-9717-6d8ae0614330 tempest-VolumesGetTest-459511347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-eccbd2c7-d9a5-429d-8ed4-5467644454e4" returned: 0 in 0.305s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:29 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-4239680d-82c8-4d0c-9717-6d8ae0614330 tempest-VolumesGetTest-459511347 None] Lock "cinder-quobyte-eccbd2c7-d9a5-429d-8ed4-5467644454e4" released by "delete_volume" :: held 0.829s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:30:29 devstack sudo[105633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2681f5d8-1c86-4dfd-86fb-c29aaed49dc6_e03nl2_ndevstack@QuobyteHD Aug 26 14:30:29 devstack sudo[105633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:29 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-4239680d-82c8-4d0c-9717-6d8ae0614330 tempest-VolumesGetTest-459511347 None] Created reservations ['1171c32d-c24e-40c0-a39f-ec40f3136631', '39ccb565-3d18-4cc2-8bae-4de400a12abc', '10f0dfc5-8717-4c3c-8fd6-6d06e1a46b90', '53009f5a-fe9c-44d3-a456-12c297cea2ac'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:30:30 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-4239680d-82c8-4d0c-9717-6d8ae0614330 tempest-VolumesGetTest-459511347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:30:30 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-4239680d-82c8-4d0c-9717-6d8ae0614330 tempest-VolumesGetTest-459511347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:30:30 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-4239680d-82c8-4d0c-9717-6d8ae0614330 tempest-VolumesGetTest-459511347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:30:30 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-4239680d-82c8-4d0c-9717-6d8ae0614330 tempest-VolumesGetTest-459511347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:30:30 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-4239680d-82c8-4d0c-9717-6d8ae0614330 tempest-VolumesGetTest-459511347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:30:30 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4239680d-82c8-4d0c-9717-6d8ae0614330 tempest-VolumesGetTest-459511347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:30 devstack sudo[105640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:30:30 devstack sudo[105640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:30 devstack sudo[105631]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:30 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-1f1202bf-ebda-47ac-bbd1-8fb666201b2d tempest-SnapshotsActionsTest-695899691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.9a2cb941-51f1-4661-b104-c9713dced550 -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.5d6546e9-18f3-449c-8a70-f617d1c718cf" returned: 0 in 0.392s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:30 devstack cinder-volume[94394]: WARNING cinder.volume.drivers.remotefs [None req-1f1202bf-ebda-47ac-bbd1-8fb666201b2d tempest-SnapshotsActionsTest-695899691 None] /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.5d6546e9-18f3-449c-8a70-f617d1c718cf is being set with open permissions: ugo+rw Aug 26 14:30:30 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-1f1202bf-ebda-47ac-bbd1-8fb666201b2d tempest-SnapshotsActionsTest-695899691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.5d6546e9-18f3-449c-8a70-f617d1c718cf {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:30 devstack sudo[105642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.5d6546e9-18f3-449c-8a70-f617d1c718cf Aug 26 14:30:30 devstack sudo[105642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:30 devstack sudo[105633]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:30 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-ddcaf7be-b765-4ce9-9344-89269e9f2ce6 tempest-VolumesImageMetadata-621021804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2681f5d8-1c86-4dfd-86fb-c29aaed49dc6_e03nl2_ndevstack@QuobyteHD" returned: 0 in 0.493s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:30 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-ddcaf7be-b765-4ce9-9344-89269e9f2ce6 tempest-VolumesImageMetadata-621021804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:30:30 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-78b544d8-51ff-4d17-b523-864ef34692d7 tempest-VolumesGetTest-459511347 None] Acquiring lock "cinder-3c968ba7-0f3c-4d8d-bcec-27780e7d1872-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:30:30 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-78b544d8-51ff-4d17-b523-864ef34692d7 tempest-VolumesGetTest-459511347 None] Lock "cinder-3c968ba7-0f3c-4d8d-bcec-27780e7d1872-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:30:30 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-78b544d8-51ff-4d17-b523-864ef34692d7 tempest-VolumesGetTest-459511347 None] Acquiring lock "cinder-quobyte-3c968ba7-0f3c-4d8d-bcec-27780e7d1872" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:30:30 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-78b544d8-51ff-4d17-b523-864ef34692d7 tempest-VolumesGetTest-459511347 None] Lock "cinder-quobyte-3c968ba7-0f3c-4d8d-bcec-27780e7d1872" acquired by "delete_volume" :: waited 0.024s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:30:30 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa1b7ac6-7b0e-4985-a4c6-8c9746ab74a8]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:30:30 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-78b544d8-51ff-4d17-b523-864ef34692d7 tempest-VolumesGetTest-459511347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3c968ba7-0f3c-4d8d-bcec-27780e7d1872 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:30 devstack sudo[105642]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:30 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-1f1202bf-ebda-47ac-bbd1-8fb666201b2d tempest-SnapshotsActionsTest-695899691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.5d6546e9-18f3-449c-8a70-f617d1c718cf" returned: 0 in 0.348s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:30 devstack sudo[105640]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:30 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4239680d-82c8-4d0c-9717-6d8ae0614330 tempest-VolumesGetTest-459511347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.424s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:30 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-4239680d-82c8-4d0c-9717-6d8ae0614330 tempest-VolumesGetTest-459511347 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:30:30 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-1f1202bf-ebda-47ac-bbd1-8fb666201b2d tempest-SnapshotsActionsTest-695899691 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.958s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:30:30 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-ddcaf7be-b765-4ce9-9344-89269e9f2ce6 tempest-VolumesImageMetadata-621021804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.273s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:30:30 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-ddcaf7be-b765-4ce9-9344-89269e9f2ce6 tempest-VolumesImageMetadata-621021804 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:30:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1456384975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbb85bbc-eda5-46cb-adce-510c281f7ce6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dabb6ce8199f4a8497f8bad2e7baf442',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:30:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:30:28Z,use_quota=True,user_id='52d24f4c145b4308af2d531b6e1bd4f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:30:30 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-ddcaf7be-b765-4ce9-9344-89269e9f2ce6 tempest-VolumesImageMetadata-621021804 None] Creating volume cbb85bbc-eda5-46cb-adce-510c281f7ce6 {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:30:30 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-ddcaf7be-b765-4ce9-9344-89269e9f2ce6 tempest-VolumesImageMetadata-621021804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:30:30 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-ddcaf7be-b765-4ce9-9344-89269e9f2ce6 tempest-VolumesImageMetadata-621021804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:30:30 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-ddcaf7be-b765-4ce9-9344-89269e9f2ce6 tempest-VolumesImageMetadata-621021804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:30:30 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-ddcaf7be-b765-4ce9-9344-89269e9f2ce6 tempest-VolumesImageMetadata-621021804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:30:30 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-ddcaf7be-b765-4ce9-9344-89269e9f2ce6 tempest-VolumesImageMetadata-621021804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:30:30 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-ddcaf7be-b765-4ce9-9344-89269e9f2ce6 tempest-VolumesImageMetadata-621021804 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:30:30 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-ddcaf7be-b765-4ce9-9344-89269e9f2ce6 tempest-VolumesImageMetadata-621021804 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:30:30 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-ddcaf7be-b765-4ce9-9344-89269e9f2ce6 tempest-VolumesImageMetadata-621021804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-cbb85bbc-eda5-46cb-adce-510c281f7ce6 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:30 devstack sudo[105648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3c968ba7-0f3c-4d8d-bcec-27780e7d1872 Aug 26 14:30:30 devstack sudo[105648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:30 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-4239680d-82c8-4d0c-9717-6d8ae0614330 tempest-VolumesGetTest-459511347 None] Deleted volume successfully. Aug 26 14:30:30 devstack sudo[105651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-cbb85bbc-eda5-46cb-adce-510c281f7ce6 1073741824 Aug 26 14:30:30 devstack sudo[105651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:30 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-4239680d-82c8-4d0c-9717-6d8ae0614330 tempest-VolumesGetTest-459511347 None] Lock "cinder-eccbd2c7-d9a5-429d-8ed4-5467644454e4-delete_volume" released by "delete_volume" :: held 1.700s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:30:30 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-1f1202bf-ebda-47ac-bbd1-8fb666201b2d tempest-SnapshotsActionsTest-695899691 None] Create snapshot completed successfully Aug 26 14:30:30 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-8e3e05ae-ab11-482c-9e02-a298f0291c35 tempest-SnapshotsActionsTest-642613075 None] Acquiring lock "cinder-5d6546e9-18f3-449c-8a70-f617d1c718cf-delete_snapshot" by "delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:30:30 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-8e3e05ae-ab11-482c-9e02-a298f0291c35 tempest-SnapshotsActionsTest-642613075 None] Lock "cinder-5d6546e9-18f3-449c-8a70-f617d1c718cf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:30:30 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-8e3e05ae-ab11-482c-9e02-a298f0291c35 tempest-SnapshotsActionsTest-642613075 None] Acquiring lock "cinder-quobyte-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943" by "delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:30:30 devstack sudo[105648]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:30 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-78b544d8-51ff-4d17-b523-864ef34692d7 tempest-VolumesGetTest-459511347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3c968ba7-0f3c-4d8d-bcec-27780e7d1872" returned: 0 in 0.521s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:30 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-78b544d8-51ff-4d17-b523-864ef34692d7 tempest-VolumesGetTest-459511347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3c968ba7-0f3c-4d8d-bcec-27780e7d1872 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:30 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-8e3e05ae-ab11-482c-9e02-a298f0291c35 tempest-SnapshotsActionsTest-642613075 None] Lock "cinder-quobyte-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943" acquired by "delete_snapshot" :: waited 0.041s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:30:30 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-8e3e05ae-ab11-482c-9e02-a298f0291c35 tempest-SnapshotsActionsTest-642613075 None] Acquiring lock "cinder-quobyte-5d6546e9-18f3-449c-8a70-f617d1c718cf" by "_delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:30:30 devstack sudo[105660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3c968ba7-0f3c-4d8d-bcec-27780e7d1872 Aug 26 14:30:30 devstack sudo[105660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:31 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-8e3e05ae-ab11-482c-9e02-a298f0291c35 tempest-SnapshotsActionsTest-642613075 None] Lock "cinder-quobyte-5d6546e9-18f3-449c-8a70-f617d1c718cf" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:30:31 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-8e3e05ae-ab11-482c-9e02-a298f0291c35 tempest-SnapshotsActionsTest-642613075 None] Deleting offline snapshot 5d6546e9-18f3-449c-8a70-f617d1c718cf of volume 4fb30b4d-fd01-4922-b4e3-7bb6dfb45943 {{(pid=94394) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 14:30:31 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-8e3e05ae-ab11-482c-9e02-a298f0291c35 tempest-SnapshotsActionsTest-642613075 None] snapshot_file for this snap is: volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.5d6546e9-18f3-449c-8a70-f617d1c718cf {{(pid=94394) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 14:30:31 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[55c1bda0-2061-45f5-80bc-6fcd53e16540]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:30:31 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-8e3e05ae-ab11-482c-9e02-a298f0291c35 tempest-SnapshotsActionsTest-642613075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.5d6546e9-18f3-449c-8a70-f617d1c718cf {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:31 devstack sudo[105651]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:31 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-ddcaf7be-b765-4ce9-9344-89269e9f2ce6 tempest-VolumesImageMetadata-621021804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-cbb85bbc-eda5-46cb-adce-510c281f7ce6 1073741824" returned: 0 in 0.602s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:31 devstack sudo[105662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.5d6546e9-18f3-449c-8a70-f617d1c718cf Aug 26 14:30:31 devstack sudo[105662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:31 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-ddcaf7be-b765-4ce9-9344-89269e9f2ce6 tempest-VolumesImageMetadata-621021804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-cbb85bbc-eda5-46cb-adce-510c281f7ce6 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:31 devstack sudo[105665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-cbb85bbc-eda5-46cb-adce-510c281f7ce6 Aug 26 14:30:31 devstack sudo[105665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:31 devstack sudo[105660]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:31 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-78b544d8-51ff-4d17-b523-864ef34692d7 tempest-VolumesGetTest-459511347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3c968ba7-0f3c-4d8d-bcec-27780e7d1872" returned: 0 in 0.325s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:31 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-78b544d8-51ff-4d17-b523-864ef34692d7 tempest-VolumesGetTest-459511347 None] Lock "cinder-quobyte-3c968ba7-0f3c-4d8d-bcec-27780e7d1872" released by "delete_volume" :: held 0.900s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:30:31 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-78b544d8-51ff-4d17-b523-864ef34692d7 tempest-VolumesGetTest-459511347 None] Created reservations ['642662b0-d3b8-4016-983d-f818a9f01f12', 'c9c81b58-ba75-48e3-b849-b4d7c49601a2', '1f7618b8-3edf-40a3-b381-49c530a465f8', 'ed492018-78e7-4377-8c99-906862d3a559'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:30:31 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-78b544d8-51ff-4d17-b523-864ef34692d7 tempest-VolumesGetTest-459511347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:30:31 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-78b544d8-51ff-4d17-b523-864ef34692d7 tempest-VolumesGetTest-459511347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:30:31 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-78b544d8-51ff-4d17-b523-864ef34692d7 tempest-VolumesGetTest-459511347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:30:31 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-78b544d8-51ff-4d17-b523-864ef34692d7 tempest-VolumesGetTest-459511347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:30:31 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-78b544d8-51ff-4d17-b523-864ef34692d7 tempest-VolumesGetTest-459511347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:30:31 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-78b544d8-51ff-4d17-b523-864ef34692d7 tempest-VolumesGetTest-459511347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:31 devstack sudo[105672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:30:31 devstack sudo[105672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:31 devstack sudo[105662]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:31 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-8e3e05ae-ab11-482c-9e02-a298f0291c35 tempest-SnapshotsActionsTest-642613075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.5d6546e9-18f3-449c-8a70-f617d1c718cf" returned: 0 in 0.516s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:31 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-8e3e05ae-ab11-482c-9e02-a298f0291c35 tempest-SnapshotsActionsTest-642613075 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94394) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 14:30:31 devstack sudo[105665]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:31 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b21a631-973f-4351-a6f9-11a49e7c0909]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:30:31 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-ddcaf7be-b765-4ce9-9344-89269e9f2ce6 tempest-VolumesImageMetadata-621021804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-cbb85bbc-eda5-46cb-adce-510c281f7ce6" returned: 0 in 0.429s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:31 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-8e3e05ae-ab11-482c-9e02-a298f0291c35 tempest-SnapshotsActionsTest-642613075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.9a2cb941-51f1-4661-b104-c9713dced550 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:31 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-ddcaf7be-b765-4ce9-9344-89269e9f2ce6 tempest-VolumesImageMetadata-621021804 None] <== create_volume: return (1096ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:30:31 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-ddcaf7be-b765-4ce9-9344-89269e9f2ce6 tempest-VolumesImageMetadata-621021804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.104s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:30:31 devstack cinder-volume[94394]: DEBUG cinder.volume.volume_utils [None req-ddcaf7be-b765-4ce9-9344-89269e9f2ce6 tempest-VolumesImageMetadata-621021804 None] Attempting download of 2681f5d8-1c86-4dfd-86fb-c29aaed49dc6 ((None, [{'url': 'file:///opt/stack/data/glance/images/2681f5d8-1c86-4dfd-86fb-c29aaed49dc6', 'metadata': {}}])) to volume cbb85bbc-eda5-46cb-adce-510c281f7ce6. {{(pid=94394) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 26 14:30:31 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[144601c1-d779-4bad-ac5d-816254ebc500]: (4, 'raw') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:30:31 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-ddcaf7be-b765-4ce9-9344-89269e9f2ce6 tempest-VolumesImageMetadata-621021804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2681f5d8-1c86-4dfd-86fb-c29aaed49dc6_y4kh0c7z {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:31 devstack sudo[105675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.9a2cb941-51f1-4661-b104-c9713dced550 Aug 26 14:30:31 devstack sudo[105675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:31 devstack sudo[105672]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:31 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-78b544d8-51ff-4d17-b523-864ef34692d7 tempest-VolumesGetTest-459511347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.323s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:31 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-78b544d8-51ff-4d17-b523-864ef34692d7 tempest-VolumesGetTest-459511347 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:30:31 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-78b544d8-51ff-4d17-b523-864ef34692d7 tempest-VolumesGetTest-459511347 None] Deleted volume successfully. Aug 26 14:30:31 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-78b544d8-51ff-4d17-b523-864ef34692d7 tempest-VolumesGetTest-459511347 None] Lock "cinder-3c968ba7-0f3c-4d8d-bcec-27780e7d1872-delete_volume" released by "delete_volume" :: held 1.552s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:30:31 devstack sudo[105677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2681f5d8-1c86-4dfd-86fb-c29aaed49dc6_y4kh0c7z Aug 26 14:30:31 devstack sudo[105677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:32 devstack sudo[105675]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:32 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-8e3e05ae-ab11-482c-9e02-a298f0291c35 tempest-SnapshotsActionsTest-642613075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.9a2cb941-51f1-4661-b104-c9713dced550" returned: 0 in 0.496s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:32 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-8e3e05ae-ab11-482c-9e02-a298f0291c35 tempest-SnapshotsActionsTest-642613075 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94394) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 14:30:32 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-8e3e05ae-ab11-482c-9e02-a298f0291c35 tempest-SnapshotsActionsTest-642613075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.5d6546e9-18f3-449c-8a70-f617d1c718cf {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:32 devstack sudo[105683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.5d6546e9-18f3-449c-8a70-f617d1c718cf Aug 26 14:30:32 devstack sudo[105683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:32 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cb6a7dc-3034-4bb7-a707-953f521817ae tempest-VolumesGetTest-459511347 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:30:32 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-7cb6a7dc-3034-4bb7-a707-953f521817ae tempest-VolumesGetTest-459511347 None] Flow 'volume_create_manager' (89fa454a-b30d-422e-82b2-24fcdf9fdc0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:30:32 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-7cb6a7dc-3034-4bb7-a707-953f521817ae tempest-VolumesGetTest-459511347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e136675c-f7c5-4769-99e8-f621e6bd97f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:30:32 devstack sudo[105677]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:32 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-ddcaf7be-b765-4ce9-9344-89269e9f2ce6 tempest-VolumesImageMetadata-621021804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2681f5d8-1c86-4dfd-86fb-c29aaed49dc6_y4kh0c7z" returned: 0 in 0.524s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:32 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-ddcaf7be-b765-4ce9-9344-89269e9f2ce6 tempest-VolumesImageMetadata-621021804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2681f5d8-1c86-4dfd-86fb-c29aaed49dc6_y4kh0c7z {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:32 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-7cb6a7dc-3034-4bb7-a707-953f521817ae tempest-VolumesGetTest-459511347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e136675c-f7c5-4769-99e8-f621e6bd97f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:30:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-25684785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76dd1101-ba41-492a-b48b-ee21fc5fe5aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2563771eca7848979f10833a8a104f6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:30:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:30:32Z,use_quota=True,user_id='f811ce7459cc4202a99345871cc95ded',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:30:32 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-7cb6a7dc-3034-4bb7-a707-953f521817ae tempest-VolumesGetTest-459511347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c99e69bd-d6e0-4816-bee7-526f91c2ad84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:30:32 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-7cb6a7dc-3034-4bb7-a707-953f521817ae tempest-VolumesGetTest-459511347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c99e69bd-d6e0-4816-bee7-526f91c2ad84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:30:32 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-7cb6a7dc-3034-4bb7-a707-953f521817ae tempest-VolumesGetTest-459511347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02514186-051d-4e4e-927c-778b412c25c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:30:32 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-7cb6a7dc-3034-4bb7-a707-953f521817ae tempest-VolumesGetTest-459511347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02514186-051d-4e4e-927c-778b412c25c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76dd1101-ba41-492a-b48b-ee21fc5fe5aa', 'volume_name': 'volume-76dd1101-ba41-492a-b48b-ee21fc5fe5aa', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:30:32 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-7cb6a7dc-3034-4bb7-a707-953f521817ae tempest-VolumesGetTest-459511347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (594f4a9a-c58c-4822-a206-9d311c94316b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:30:32 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-7cb6a7dc-3034-4bb7-a707-953f521817ae tempest-VolumesGetTest-459511347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (594f4a9a-c58c-4822-a206-9d311c94316b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:30:32 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-7cb6a7dc-3034-4bb7-a707-953f521817ae tempest-VolumesGetTest-459511347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (451f692f-2667-43af-883c-2d5f90af8be0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:30:32 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-7cb6a7dc-3034-4bb7-a707-953f521817ae tempest-VolumesGetTest-459511347 None] Volume 76dd1101-ba41-492a-b48b-ee21fc5fe5aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76dd1101-ba41-492a-b48b-ee21fc5fe5aa', 'volume_size': 1} Aug 26 14:30:32 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-7cb6a7dc-3034-4bb7-a707-953f521817ae tempest-VolumesGetTest-459511347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:30:32 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-7cb6a7dc-3034-4bb7-a707-953f521817ae tempest-VolumesGetTest-459511347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:30:32 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-7cb6a7dc-3034-4bb7-a707-953f521817ae tempest-VolumesGetTest-459511347 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:30:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-25684785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76dd1101-ba41-492a-b48b-ee21fc5fe5aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2563771eca7848979f10833a8a104f6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:30:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:30:32Z,use_quota=True,user_id='f811ce7459cc4202a99345871cc95ded',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:30:32 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-7cb6a7dc-3034-4bb7-a707-953f521817ae tempest-VolumesGetTest-459511347 None] Creating volume 76dd1101-ba41-492a-b48b-ee21fc5fe5aa {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:30:32 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-7cb6a7dc-3034-4bb7-a707-953f521817ae tempest-VolumesGetTest-459511347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:30:32 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-7cb6a7dc-3034-4bb7-a707-953f521817ae tempest-VolumesGetTest-459511347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:30:32 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-7cb6a7dc-3034-4bb7-a707-953f521817ae tempest-VolumesGetTest-459511347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:30:32 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-7cb6a7dc-3034-4bb7-a707-953f521817ae tempest-VolumesGetTest-459511347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:30:32 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-7cb6a7dc-3034-4bb7-a707-953f521817ae tempest-VolumesGetTest-459511347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:30:32 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-7cb6a7dc-3034-4bb7-a707-953f521817ae tempest-VolumesGetTest-459511347 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:30:32 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-7cb6a7dc-3034-4bb7-a707-953f521817ae tempest-VolumesGetTest-459511347 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:30:32 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-7cb6a7dc-3034-4bb7-a707-953f521817ae tempest-VolumesGetTest-459511347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-76dd1101-ba41-492a-b48b-ee21fc5fe5aa 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:32 devstack sudo[105688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-76dd1101-ba41-492a-b48b-ee21fc5fe5aa 1073741824 Aug 26 14:30:32 devstack sudo[105688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:32 devstack sudo[105687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2681f5d8-1c86-4dfd-86fb-c29aaed49dc6_y4kh0c7z Aug 26 14:30:32 devstack sudo[105687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:32 devstack sudo[105683]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:32 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-8e3e05ae-ab11-482c-9e02-a298f0291c35 tempest-SnapshotsActionsTest-642613075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.5d6546e9-18f3-449c-8a70-f617d1c718cf" returned: 0 in 0.530s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:32 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-8e3e05ae-ab11-482c-9e02-a298f0291c35 tempest-SnapshotsActionsTest-642613075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.5d6546e9-18f3-449c-8a70-f617d1c718cf {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:32 devstack sudo[105687]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:32 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-ddcaf7be-b765-4ce9-9344-89269e9f2ce6 tempest-VolumesImageMetadata-621021804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2681f5d8-1c86-4dfd-86fb-c29aaed49dc6_y4kh0c7z" returned: 1 in 0.380s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:32 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-ddcaf7be-b765-4ce9-9344-89269e9f2ce6 tempest-VolumesImageMetadata-621021804 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2681f5d8-1c86-4dfd-86fb-c29aaed49dc6_y4kh0c7z' failed. Not Retrying. {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 14:30:32 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[bee7ab39-6be3-46cb-94e1-c94560e8ca4e]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:30:32 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-ddcaf7be-b765-4ce9-9344-89269e9f2ce6 tempest-VolumesImageMetadata-621021804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2681f5d8-1c86-4dfd-86fb-c29aaed49dc6_e03nl2_ndevstack@QuobyteHD {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:32 devstack sudo[105698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.5d6546e9-18f3-449c-8a70-f617d1c718cf Aug 26 14:30:32 devstack sudo[105698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:32 devstack sudo[105700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2681f5d8-1c86-4dfd-86fb-c29aaed49dc6_e03nl2_ndevstack@QuobyteHD Aug 26 14:30:32 devstack sudo[105700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:32 devstack sudo[105688]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:32 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-7cb6a7dc-3034-4bb7-a707-953f521817ae tempest-VolumesGetTest-459511347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-76dd1101-ba41-492a-b48b-ee21fc5fe5aa 1073741824" returned: 0 in 0.558s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:32 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-7cb6a7dc-3034-4bb7-a707-953f521817ae tempest-VolumesGetTest-459511347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-76dd1101-ba41-492a-b48b-ee21fc5fe5aa {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:32 devstack sudo[105698]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-8e3e05ae-ab11-482c-9e02-a298f0291c35 tempest-SnapshotsActionsTest-642613075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.5d6546e9-18f3-449c-8a70-f617d1c718cf" returned: 0 in 0.331s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:33 devstack sudo[105704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-76dd1101-ba41-492a-b48b-ee21fc5fe5aa Aug 26 14:30:33 devstack sudo[105704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:33 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-8e3e05ae-ab11-482c-9e02-a298f0291c35 tempest-SnapshotsActionsTest-642613075 None] Lock "cinder-quobyte-5d6546e9-18f3-449c-8a70-f617d1c718cf" released by "_delete_snapshot" :: held 2.028s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:30:33 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-8e3e05ae-ab11-482c-9e02-a298f0291c35 tempest-SnapshotsActionsTest-642613075 None] Lock "cinder-quobyte-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943" released by "delete_snapshot" :: held 2.060s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:30:33 devstack sudo[105700]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-ddcaf7be-b765-4ce9-9344-89269e9f2ce6 tempest-VolumesImageMetadata-621021804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2681f5d8-1c86-4dfd-86fb-c29aaed49dc6_e03nl2_ndevstack@QuobyteHD" returned: 0 in 0.428s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:33 devstack cinder-volume[94394]: DEBUG cinder.image.image_utils [None req-ddcaf7be-b765-4ce9-9344-89269e9f2ce6 tempest-VolumesImageMetadata-621021804 None] 2681f5d8-1c86-4dfd-86fb-c29aaed49dc6 was qcow2, converting to qcow2 {{(pid=94394) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 26 14:30:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-ddcaf7be-b765-4ce9-9344-89269e9f2ce6 tempest-VolumesImageMetadata-621021804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2681f5d8-1c86-4dfd-86fb-c29aaed49dc6_e03nl2_ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-cbb85bbc-eda5-46cb-adce-510c281f7ce6 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:33 devstack sudo[105709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2681f5d8-1c86-4dfd-86fb-c29aaed49dc6_e03nl2_ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-cbb85bbc-eda5-46cb-adce-510c281f7ce6 Aug 26 14:30:33 devstack sudo[105709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:33 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-8e3e05ae-ab11-482c-9e02-a298f0291c35 tempest-SnapshotsActionsTest-642613075 None] Created reservations ['abbf5427-7651-4706-abb4-dbe2fcd86025', '21a8836b-b7be-47cd-a9ae-1bef55ed1a61', 'a0b61bdc-fe6e-4a9a-bfa1-6ce46c1c456f', 'bb15daa8-8f9e-41c2-806c-2ecf69efd87c'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:30:33 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-8e3e05ae-ab11-482c-9e02-a298f0291c35 tempest-SnapshotsActionsTest-642613075 None] Delete snapshot completed successfully. Aug 26 14:30:33 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-8e3e05ae-ab11-482c-9e02-a298f0291c35 tempest-SnapshotsActionsTest-642613075 None] Lock "cinder-5d6546e9-18f3-449c-8a70-f617d1c718cf-delete_snapshot" released by "delete_snapshot" :: held 2.307s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:30:33 devstack sudo[105704]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-7cb6a7dc-3034-4bb7-a707-953f521817ae tempest-VolumesGetTest-459511347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-76dd1101-ba41-492a-b48b-ee21fc5fe5aa" returned: 0 in 0.352s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:33 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-7cb6a7dc-3034-4bb7-a707-953f521817ae tempest-VolumesGetTest-459511347 None] <== create_volume: return (967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:30:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-7cb6a7dc-3034-4bb7-a707-953f521817ae tempest-VolumesGetTest-459511347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.970s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:30:33 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-7cb6a7dc-3034-4bb7-a707-953f521817ae tempest-VolumesGetTest-459511347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (451f692f-2667-43af-883c-2d5f90af8be0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76dd1101-ba41-492a-b48b-ee21fc5fe5aa', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:30:33 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-7cb6a7dc-3034-4bb7-a707-953f521817ae tempest-VolumesGetTest-459511347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b44aa51f-3a7a-4e40-9e65-568bc2bfd041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:30:33 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-7cb6a7dc-3034-4bb7-a707-953f521817ae tempest-VolumesGetTest-459511347 None] Volume volume-76dd1101-ba41-492a-b48b-ee21fc5fe5aa (76dd1101-ba41-492a-b48b-ee21fc5fe5aa): created successfully Aug 26 14:30:33 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-7cb6a7dc-3034-4bb7-a707-953f521817ae tempest-VolumesGetTest-459511347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b44aa51f-3a7a-4e40-9e65-568bc2bfd041) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:30:33 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-7cb6a7dc-3034-4bb7-a707-953f521817ae tempest-VolumesGetTest-459511347 None] Flow 'volume_create_manager' (89fa454a-b30d-422e-82b2-24fcdf9fdc0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:30:33 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-7cb6a7dc-3034-4bb7-a707-953f521817ae tempest-VolumesGetTest-459511347 None] Created volume successfully. Aug 26 14:30:33 devstack cinder-volume[94394]: DEBUG oslo_service.periodic_task [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94394) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 14:30:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:30:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:30:33 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:30:33 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:30:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:30:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:33 devstack sudo[105716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:30:33 devstack sudo[105716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:33 devstack sudo[105716]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.268s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:33 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:30:33 devstack cinder-volume[94394]: DEBUG oslo_service.periodic_task [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Running periodic task VolumeManager._thread_info {{(pid=94394) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 14:30:33 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] thread count: 28 {{(pid=94394) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 14:30:33 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] thread info: [<_MainThread(MainThread, started 126600738033792)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94394) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 14:30:34 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-905d00a6-6454-402a-a911-f9361ba43aef tempest-VolumesListAdminTestJSON-228051891 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:30:34 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-905d00a6-6454-402a-a911-f9361ba43aef tempest-VolumesListAdminTestJSON-228051891 None] Flow 'volume_create_manager' (d208787f-4c10-4d09-b8b0-3e437bc95766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:30:34 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-905d00a6-6454-402a-a911-f9361ba43aef tempest-VolumesListAdminTestJSON-228051891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dec865be-5878-48b6-bd9f-acedc6ca3413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:30:34 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-905d00a6-6454-402a-a911-f9361ba43aef tempest-VolumesListAdminTestJSON-228051891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dec865be-5878-48b6-bd9f-acedc6ca3413) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:30:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1670245141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f82d04a8-f3a8-4fb1-ae0c-a5e529fae705,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='953802c77bf241f288774dd88faef88e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:30:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:30:35Z,use_quota=True,user_id='e61f7ece936340c68094fc38e941abdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:30:34 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-905d00a6-6454-402a-a911-f9361ba43aef tempest-VolumesListAdminTestJSON-228051891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0c9fbe3-be23-4642-b8aa-c359a375aa7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:30:34 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-905d00a6-6454-402a-a911-f9361ba43aef tempest-VolumesListAdminTestJSON-228051891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0c9fbe3-be23-4642-b8aa-c359a375aa7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:30:34 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-905d00a6-6454-402a-a911-f9361ba43aef tempest-VolumesListAdminTestJSON-228051891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f149644-4eed-456e-8fe8-278c00b54409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:30:34 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-905d00a6-6454-402a-a911-f9361ba43aef tempest-VolumesListAdminTestJSON-228051891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f149644-4eed-456e-8fe8-278c00b54409) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f82d04a8-f3a8-4fb1-ae0c-a5e529fae705', 'volume_name': 'volume-f82d04a8-f3a8-4fb1-ae0c-a5e529fae705', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:30:34 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-905d00a6-6454-402a-a911-f9361ba43aef tempest-VolumesListAdminTestJSON-228051891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6ea4c1b-cea3-49d5-a55b-d1819cf0d913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:30:34 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-905d00a6-6454-402a-a911-f9361ba43aef tempest-VolumesListAdminTestJSON-228051891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6ea4c1b-cea3-49d5-a55b-d1819cf0d913) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:30:34 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-905d00a6-6454-402a-a911-f9361ba43aef tempest-VolumesListAdminTestJSON-228051891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f811cfb1-66ef-46cb-9e1b-7249c8fd0593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:30:34 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-905d00a6-6454-402a-a911-f9361ba43aef tempest-VolumesListAdminTestJSON-228051891 None] Volume f82d04a8-f3a8-4fb1-ae0c-a5e529fae705: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f82d04a8-f3a8-4fb1-ae0c-a5e529fae705', 'volume_size': 1} Aug 26 14:30:34 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-905d00a6-6454-402a-a911-f9361ba43aef tempest-VolumesListAdminTestJSON-228051891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:30:34 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-905d00a6-6454-402a-a911-f9361ba43aef tempest-VolumesListAdminTestJSON-228051891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:30:34 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-905d00a6-6454-402a-a911-f9361ba43aef tempest-VolumesListAdminTestJSON-228051891 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:30:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1670245141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f82d04a8-f3a8-4fb1-ae0c-a5e529fae705,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='953802c77bf241f288774dd88faef88e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:30:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:30:35Z,use_quota=True,user_id='e61f7ece936340c68094fc38e941abdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:30:34 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-905d00a6-6454-402a-a911-f9361ba43aef tempest-VolumesListAdminTestJSON-228051891 None] Creating volume f82d04a8-f3a8-4fb1-ae0c-a5e529fae705 {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:30:34 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-905d00a6-6454-402a-a911-f9361ba43aef tempest-VolumesListAdminTestJSON-228051891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:30:34 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-905d00a6-6454-402a-a911-f9361ba43aef tempest-VolumesListAdminTestJSON-228051891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:30:34 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-905d00a6-6454-402a-a911-f9361ba43aef tempest-VolumesListAdminTestJSON-228051891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:30:34 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-905d00a6-6454-402a-a911-f9361ba43aef tempest-VolumesListAdminTestJSON-228051891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:30:34 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-905d00a6-6454-402a-a911-f9361ba43aef tempest-VolumesListAdminTestJSON-228051891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:30:34 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-905d00a6-6454-402a-a911-f9361ba43aef tempest-VolumesListAdminTestJSON-228051891 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:30:34 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-905d00a6-6454-402a-a911-f9361ba43aef tempest-VolumesListAdminTestJSON-228051891 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:30:34 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-905d00a6-6454-402a-a911-f9361ba43aef tempest-VolumesListAdminTestJSON-228051891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-f82d04a8-f3a8-4fb1-ae0c-a5e529fae705 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:34 devstack sudo[105722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-f82d04a8-f3a8-4fb1-ae0c-a5e529fae705 1073741824 Aug 26 14:30:34 devstack sudo[105722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:34 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-2b073a99-f7c9-41fc-876f-25f0d97a0086 tempest-SnapshotsActionsTest-695899691 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:30:35 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-76097846-c7cc-41d5-83cd-482b3c73a9a8 tempest-VolumesGetTest-459511347 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:30:35 devstack sudo[105709]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:35 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-ddcaf7be-b765-4ce9-9344-89269e9f2ce6 tempest-VolumesImageMetadata-621021804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2681f5d8-1c86-4dfd-86fb-c29aaed49dc6_e03nl2_ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-cbb85bbc-eda5-46cb-adce-510c281f7ce6" returned: 0 in 2.006s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:35 devstack cinder-volume[94394]: DEBUG cinder.image.image_utils [None req-ddcaf7be-b765-4ce9-9344-89269e9f2ce6 tempest-VolumesImageMetadata-621021804 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2681f5d8-1c86-4dfd-86fb-c29aaed49dc6_e03nl2_ndevstack@QuobyteHD, size 112.00 MB, duration 2.01 sec, destination /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-cbb85bbc-eda5-46cb-adce-510c281f7ce6 {{(pid=94394) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 14:30:35 devstack cinder-volume[94394]: INFO cinder.image.image_utils [None req-ddcaf7be-b765-4ce9-9344-89269e9f2ce6 tempest-VolumesImageMetadata-621021804 None] Converted 112.00 MB image at 55.78 MB/s Aug 26 14:30:35 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-ddcaf7be-b765-4ce9-9344-89269e9f2ce6 tempest-VolumesImageMetadata-621021804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-cbb85bbc-eda5-46cb-adce-510c281f7ce6 1G {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:35 devstack sudo[105724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-cbb85bbc-eda5-46cb-adce-510c281f7ce6 1G Aug 26 14:30:35 devstack sudo[105724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:35 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-76097846-c7cc-41d5-83cd-482b3c73a9a8 tempest-VolumesGetTest-459511347 None] Flow 'volume_create_manager' (c66efe3a-7e9a-4bb6-8c1b-873af21f1c65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:30:35 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-76097846-c7cc-41d5-83cd-482b3c73a9a8 tempest-VolumesGetTest-459511347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (098b85e1-6c0a-4d30-a659-2935ad2fbb29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:30:35 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-76097846-c7cc-41d5-83cd-482b3c73a9a8 tempest-VolumesGetTest-459511347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (098b85e1-6c0a-4d30-a659-2935ad2fbb29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:30:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-9024608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b625232f-8f11-4d70-b523-cce355a45ca4,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='2563771eca7848979f10833a8a104f6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:30:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=76dd1101-ba41-492a-b48b-ee21fc5fe5aa,status='creating',terminated_at=None,updated_at=2026-08-26T12:30:35Z,use_quota=True,user_id='f811ce7459cc4202a99345871cc95ded',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:30:35 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-76097846-c7cc-41d5-83cd-482b3c73a9a8 tempest-VolumesGetTest-459511347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dada73b-4ada-465a-913a-a8f73d8fba52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:30:35 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-76097846-c7cc-41d5-83cd-482b3c73a9a8 tempest-VolumesGetTest-459511347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dada73b-4ada-465a-913a-a8f73d8fba52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:30:35 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-76097846-c7cc-41d5-83cd-482b3c73a9a8 tempest-VolumesGetTest-459511347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af4175bc-b4dc-4169-9a76-46ad48e9c521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:30:35 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-76097846-c7cc-41d5-83cd-482b3c73a9a8 tempest-VolumesGetTest-459511347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af4175bc-b4dc-4169-9a76-46ad48e9c521) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'b625232f-8f11-4d70-b523-cce355a45ca4', 'volume_name': 'volume-b625232f-8f11-4d70-b523-cce355a45ca4', 'volume_size': 1, 'source_volid': '76dd1101-ba41-492a-b48b-ee21fc5fe5aa', 'source_volstatus': 'available'}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:30:35 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-76097846-c7cc-41d5-83cd-482b3c73a9a8 tempest-VolumesGetTest-459511347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b4166f9-5c00-4244-83f9-5168a49c8ff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:30:35 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-76097846-c7cc-41d5-83cd-482b3c73a9a8 tempest-VolumesGetTest-459511347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b4166f9-5c00-4244-83f9-5168a49c8ff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:30:35 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-76097846-c7cc-41d5-83cd-482b3c73a9a8 tempest-VolumesGetTest-459511347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (986dd82b-8f0a-47ed-a17d-96de0dbc8b0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:30:35 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-76097846-c7cc-41d5-83cd-482b3c73a9a8 tempest-VolumesGetTest-459511347 None] Volume b625232f-8f11-4d70-b523-cce355a45ca4: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-b625232f-8f11-4d70-b523-cce355a45ca4', 'volume_size': 1, 'source_volid': '76dd1101-ba41-492a-b48b-ee21fc5fe5aa', 'source_volstatus': 'available'} Aug 26 14:30:35 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-76097846-c7cc-41d5-83cd-482b3c73a9a8 tempest-VolumesGetTest-459511347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:30:35 devstack sudo[105722]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:35 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-905d00a6-6454-402a-a911-f9361ba43aef tempest-VolumesListAdminTestJSON-228051891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-f82d04a8-f3a8-4fb1-ae0c-a5e529fae705 1073741824" returned: 0 in 0.510s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:35 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-905d00a6-6454-402a-a911-f9361ba43aef tempest-VolumesListAdminTestJSON-228051891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-f82d04a8-f3a8-4fb1-ae0c-a5e529fae705 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:35 devstack sudo[105733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-f82d04a8-f3a8-4fb1-ae0c-a5e529fae705 Aug 26 14:30:35 devstack sudo[105733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:35 devstack sudo[105724]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:35 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-ddcaf7be-b765-4ce9-9344-89269e9f2ce6 tempest-VolumesImageMetadata-621021804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-cbb85bbc-eda5-46cb-adce-510c281f7ce6 1G" returned: 0 in 0.363s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:35 devstack cinder-volume[94394]: DEBUG cinder.volume.volume_utils [None req-ddcaf7be-b765-4ce9-9344-89269e9f2ce6 tempest-VolumesImageMetadata-621021804 None] Downloaded image 2681f5d8-1c86-4dfd-86fb-c29aaed49dc6 ((None, [{'url': 'file:///opt/stack/data/glance/images/2681f5d8-1c86-4dfd-86fb-c29aaed49dc6', 'metadata': {}}])) to volume cbb85bbc-eda5-46cb-adce-510c281f7ce6 successfully. {{(pid=94394) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 26 14:30:35 devstack cinder-volume[94394]: DEBUG cinder.image.image_utils [None req-ddcaf7be-b765-4ce9-9344-89269e9f2ce6 tempest-VolumesImageMetadata-621021804 None] Temporary image 2681f5d8-1c86-4dfd-86fb-c29aaed49dc6 for user 52d24f4c145b4308af2d531b6e1bd4f5 is deleted. {{(pid=94394) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 26 14:30:35 devstack cinder-volume[94394]: DEBUG cinder.volume.volume_utils [None req-ddcaf7be-b765-4ce9-9344-89269e9f2ce6 tempest-VolumesImageMetadata-621021804 None] Marking volume cbb85bbc-eda5-46cb-adce-510c281f7ce6 as bootable. {{(pid=94394) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 26 14:30:35 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddcaf7be-b765-4ce9-9344-89269e9f2ce6 tempest-VolumesImageMetadata-621021804 None] Copying metadata from image 2681f5d8-1c86-4dfd-86fb-c29aaed49dc6 to cbb85bbc-eda5-46cb-adce-510c281f7ce6. {{(pid=94394) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 26 14:30:35 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddcaf7be-b765-4ce9-9344-89269e9f2ce6 tempest-VolumesImageMetadata-621021804 None] Creating volume glance metadata for volume cbb85bbc-eda5-46cb-adce-510c281f7ce6 backed by image 2681f5d8-1c86-4dfd-86fb-c29aaed49dc6 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '2681f5d8-1c86-4dfd-86fb-c29aaed49dc6', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=94394) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 26 14:30:35 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-ddcaf7be-b765-4ce9-9344-89269e9f2ce6 tempest-VolumesImageMetadata-621021804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0a207b1-3e2e-4c53-b9f3-1ced1bc0eb0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cbb85bbc-eda5-46cb-adce-510c281f7ce6', 'volume_size': 1, 'image_id': '2681f5d8-1c86-4dfd-86fb-c29aaed49dc6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2681f5d8-1c86-4dfd-86fb-c29aaed49dc6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cbf977c46caa48c18e414079bf75016d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2681f5d8-1c86-4dfd-86fb-c29aaed49dc6', 'created_at': datetime.datetime(2026, 8, 26, 12, 16, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 12, 16, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2681f5d8-1c86-4dfd-86fb-c29aaed49dc6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:30:35 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-ddcaf7be-b765-4ce9-9344-89269e9f2ce6 tempest-VolumesImageMetadata-621021804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c7bfaf6-f013-4218-98ac-6da3d667513c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:30:35 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-ddcaf7be-b765-4ce9-9344-89269e9f2ce6 tempest-VolumesImageMetadata-621021804 None] Volume volume-cbb85bbc-eda5-46cb-adce-510c281f7ce6 (cbb85bbc-eda5-46cb-adce-510c281f7ce6): created successfully Aug 26 14:30:35 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-ddcaf7be-b765-4ce9-9344-89269e9f2ce6 tempest-VolumesImageMetadata-621021804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c7bfaf6-f013-4218-98ac-6da3d667513c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:30:35 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-ddcaf7be-b765-4ce9-9344-89269e9f2ce6 tempest-VolumesImageMetadata-621021804 None] Flow 'volume_create_manager' (92acab01-7d63-4cd1-a569-8cd17cc2a43f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:30:35 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-ddcaf7be-b765-4ce9-9344-89269e9f2ce6 tempest-VolumesImageMetadata-621021804 None] Created volume successfully. Aug 26 14:30:35 devstack sudo[105733]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:35 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-905d00a6-6454-402a-a911-f9361ba43aef tempest-VolumesListAdminTestJSON-228051891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-f82d04a8-f3a8-4fb1-ae0c-a5e529fae705" returned: 0 in 0.264s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:35 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-905d00a6-6454-402a-a911-f9361ba43aef tempest-VolumesListAdminTestJSON-228051891 None] <== create_volume: return (827ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:30:35 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-905d00a6-6454-402a-a911-f9361ba43aef tempest-VolumesListAdminTestJSON-228051891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.831s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:30:35 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-2b073a99-f7c9-41fc-876f-25f0d97a0086 tempest-SnapshotsActionsTest-695899691 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.749s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:30:35 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-905d00a6-6454-402a-a911-f9361ba43aef tempest-VolumesListAdminTestJSON-228051891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f811cfb1-66ef-46cb-9e1b-7249c8fd0593) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f82d04a8-f3a8-4fb1-ae0c-a5e529fae705', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:30:35 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-905d00a6-6454-402a-a911-f9361ba43aef tempest-VolumesListAdminTestJSON-228051891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ce38e13-96d6-4b89-b87d-1a1ef56fdb42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:30:35 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-2b073a99-f7c9-41fc-876f-25f0d97a0086 tempest-SnapshotsActionsTest-695899691 None] Creating offline snapshot 31a52aff-1e8c-4a37-94bf-3ae3189a1363 of volume 4fb30b4d-fd01-4922-b4e3-7bb6dfb45943 {{(pid=94394) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 14:30:35 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-905d00a6-6454-402a-a911-f9361ba43aef tempest-VolumesListAdminTestJSON-228051891 None] Volume volume-f82d04a8-f3a8-4fb1-ae0c-a5e529fae705 (f82d04a8-f3a8-4fb1-ae0c-a5e529fae705): created successfully Aug 26 14:30:35 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-905d00a6-6454-402a-a911-f9361ba43aef tempest-VolumesListAdminTestJSON-228051891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ce38e13-96d6-4b89-b87d-1a1ef56fdb42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:30:35 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-905d00a6-6454-402a-a911-f9361ba43aef tempest-VolumesListAdminTestJSON-228051891 None] Flow 'volume_create_manager' (d208787f-4c10-4d09-b8b0-3e437bc95766) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:30:35 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6e9cac8-baa0-489e-98f8-aa3734e42b21]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:30:35 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-2b073a99-f7c9-41fc-876f-25f0d97a0086 tempest-SnapshotsActionsTest-695899691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.9a2cb941-51f1-4661-b104-c9713dced550 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:35 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-905d00a6-6454-402a-a911-f9361ba43aef tempest-VolumesListAdminTestJSON-228051891 None] Created volume successfully. Aug 26 14:30:35 devstack sudo[105737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.9a2cb941-51f1-4661-b104-c9713dced550 Aug 26 14:30:35 devstack sudo[105737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:36 devstack sudo[105737]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:36 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-2b073a99-f7c9-41fc-876f-25f0d97a0086 tempest-SnapshotsActionsTest-695899691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.9a2cb941-51f1-4661-b104-c9713dced550" returned: 0 in 0.360s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:36 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-2b073a99-f7c9-41fc-876f-25f0d97a0086 tempest-SnapshotsActionsTest-695899691 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94394) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 14:30:36 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-2b073a99-f7c9-41fc-876f-25f0d97a0086 tempest-SnapshotsActionsTest-695899691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.9a2cb941-51f1-4661-b104-c9713dced550,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.31a52aff-1e8c-4a37-94bf-3ae3189a1363 1G {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:36 devstack sudo[105742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.9a2cb941-51f1-4661-b104-c9713dced550,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.31a52aff-1e8c-4a37-94bf-3ae3189a1363 1G Aug 26 14:30:36 devstack sudo[105742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:36 devstack sudo[105742]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:36 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-2b073a99-f7c9-41fc-876f-25f0d97a0086 tempest-SnapshotsActionsTest-695899691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.9a2cb941-51f1-4661-b104-c9713dced550,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.31a52aff-1e8c-4a37-94bf-3ae3189a1363 1G" returned: 0 in 0.460s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:36 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-2b073a99-f7c9-41fc-876f-25f0d97a0086 tempest-SnapshotsActionsTest-695899691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.9a2cb941-51f1-4661-b104-c9713dced550 -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.31a52aff-1e8c-4a37-94bf-3ae3189a1363 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:36 devstack sudo[105750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.9a2cb941-51f1-4661-b104-c9713dced550 -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.31a52aff-1e8c-4a37-94bf-3ae3189a1363 Aug 26 14:30:36 devstack sudo[105750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:36 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-d67d9aea-0595-4fc9-8c77-c645b3063e49 tempest-VolumesImageMetadata-621021804 None] Acquiring lock "cinder-cbb85bbc-eda5-46cb-adce-510c281f7ce6-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:30:36 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-d67d9aea-0595-4fc9-8c77-c645b3063e49 tempest-VolumesImageMetadata-621021804 None] Lock "cinder-cbb85bbc-eda5-46cb-adce-510c281f7ce6-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:30:36 devstack sudo[105750]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:36 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-2b073a99-f7c9-41fc-876f-25f0d97a0086 tempest-SnapshotsActionsTest-695899691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.9a2cb941-51f1-4661-b104-c9713dced550 -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.31a52aff-1e8c-4a37-94bf-3ae3189a1363" returned: 0 in 0.323s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:36 devstack cinder-volume[94394]: WARNING cinder.volume.drivers.remotefs [None req-2b073a99-f7c9-41fc-876f-25f0d97a0086 tempest-SnapshotsActionsTest-695899691 None] /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.31a52aff-1e8c-4a37-94bf-3ae3189a1363 is being set with open permissions: ugo+rw Aug 26 14:30:36 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-2b073a99-f7c9-41fc-876f-25f0d97a0086 tempest-SnapshotsActionsTest-695899691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.31a52aff-1e8c-4a37-94bf-3ae3189a1363 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:36 devstack sudo[105756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.31a52aff-1e8c-4a37-94bf-3ae3189a1363 Aug 26 14:30:36 devstack sudo[105756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:36 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-d67d9aea-0595-4fc9-8c77-c645b3063e49 tempest-VolumesImageMetadata-621021804 None] Acquiring lock "cinder-quobyte-cbb85bbc-eda5-46cb-adce-510c281f7ce6" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:30:37 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-d67d9aea-0595-4fc9-8c77-c645b3063e49 tempest-VolumesImageMetadata-621021804 None] Lock "cinder-quobyte-cbb85bbc-eda5-46cb-adce-510c281f7ce6" acquired by "delete_volume" :: waited 0.024s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:30:37 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ecaa36b-4b97-48f0-badd-2c6d844f089b]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:30:37 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-d67d9aea-0595-4fc9-8c77-c645b3063e49 tempest-VolumesImageMetadata-621021804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-cbb85bbc-eda5-46cb-adce-510c281f7ce6 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:37 devstack sudo[105758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-cbb85bbc-eda5-46cb-adce-510c281f7ce6 Aug 26 14:30:37 devstack sudo[105758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:37 devstack sudo[105756]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:37 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-2b073a99-f7c9-41fc-876f-25f0d97a0086 tempest-SnapshotsActionsTest-695899691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.31a52aff-1e8c-4a37-94bf-3ae3189a1363" returned: 0 in 0.320s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:37 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-2b073a99-f7c9-41fc-876f-25f0d97a0086 tempest-SnapshotsActionsTest-695899691 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.593s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:30:37 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-76097846-c7cc-41d5-83cd-482b3c73a9a8 tempest-VolumesGetTest-459511347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 2.037s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:30:37 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-76097846-c7cc-41d5-83cd-482b3c73a9a8 tempest-VolumesGetTest-459511347 None] Cloning volume 76dd1101-ba41-492a-b48b-ee21fc5fe5aa to volume b625232f-8f11-4d70-b523-cce355a45ca4 Aug 26 14:30:37 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-2b073a99-f7c9-41fc-876f-25f0d97a0086 tempest-SnapshotsActionsTest-695899691 None] Create snapshot completed successfully Aug 26 14:30:37 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-10224bba-8b73-4011-9a88-267b08a016a9 tempest-VolumesListAdminTestJSON-228051891 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:30:37 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-10224bba-8b73-4011-9a88-267b08a016a9 tempest-VolumesListAdminTestJSON-228051891 None] Flow 'volume_create_manager' (1f3f75d3-b615-45bf-bb93-991d021d9f1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:30:37 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-10224bba-8b73-4011-9a88-267b08a016a9 tempest-VolumesListAdminTestJSON-228051891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ccfab0a-2def-49d4-b069-b0657775d669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:30:37 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-76097846-c7cc-41d5-83cd-482b3c73a9a8 tempest-VolumesGetTest-459511347 None] Creating offline snapshot 5dce326d-f188-4467-a0a8-76150aa49d8f of volume 76dd1101-ba41-492a-b48b-ee21fc5fe5aa {{(pid=94394) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 14:30:37 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-10224bba-8b73-4011-9a88-267b08a016a9 tempest-VolumesListAdminTestJSON-228051891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ccfab0a-2def-49d4-b069-b0657775d669) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:30:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1045106429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a30b94a-992b-44f8-8563-31d6603bf5be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='953802c77bf241f288774dd88faef88e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:30:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:30:37Z,use_quota=True,user_id='e61f7ece936340c68094fc38e941abdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:30:37 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-10224bba-8b73-4011-9a88-267b08a016a9 tempest-VolumesListAdminTestJSON-228051891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e2266e5-8a59-4a5c-8858-d7c44ae901d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:30:37 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-10224bba-8b73-4011-9a88-267b08a016a9 tempest-VolumesListAdminTestJSON-228051891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e2266e5-8a59-4a5c-8858-d7c44ae901d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:30:37 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-10224bba-8b73-4011-9a88-267b08a016a9 tempest-VolumesListAdminTestJSON-228051891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3d6f9f3-cc2f-4b44-82b8-e0b8811b5ba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:30:37 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-10224bba-8b73-4011-9a88-267b08a016a9 tempest-VolumesListAdminTestJSON-228051891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3d6f9f3-cc2f-4b44-82b8-e0b8811b5ba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a30b94a-992b-44f8-8563-31d6603bf5be', 'volume_name': 'volume-8a30b94a-992b-44f8-8563-31d6603bf5be', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:30:37 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-10224bba-8b73-4011-9a88-267b08a016a9 tempest-VolumesListAdminTestJSON-228051891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7ed2c1e-1d5d-4baf-89f6-000b6cc16d91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:30:37 devstack sudo[105758]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:37 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-10224bba-8b73-4011-9a88-267b08a016a9 tempest-VolumesListAdminTestJSON-228051891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7ed2c1e-1d5d-4baf-89f6-000b6cc16d91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:30:37 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-10224bba-8b73-4011-9a88-267b08a016a9 tempest-VolumesListAdminTestJSON-228051891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed44aaf5-b953-4f90-bf92-9f4fbf140b34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:30:37 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-10224bba-8b73-4011-9a88-267b08a016a9 tempest-VolumesListAdminTestJSON-228051891 None] Volume 8a30b94a-992b-44f8-8563-31d6603bf5be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a30b94a-992b-44f8-8563-31d6603bf5be', 'volume_size': 1} Aug 26 14:30:37 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-10224bba-8b73-4011-9a88-267b08a016a9 tempest-VolumesListAdminTestJSON-228051891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:30:37 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[629698af-4d29-4dce-af7e-209d8f5417cf]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:30:37 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-76097846-c7cc-41d5-83cd-482b3c73a9a8 tempest-VolumesGetTest-459511347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-76dd1101-ba41-492a-b48b-ee21fc5fe5aa {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:37 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-d67d9aea-0595-4fc9-8c77-c645b3063e49 tempest-VolumesImageMetadata-621021804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-cbb85bbc-eda5-46cb-adce-510c281f7ce6" returned: 0 in 0.442s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:37 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-d67d9aea-0595-4fc9-8c77-c645b3063e49 tempest-VolumesImageMetadata-621021804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-cbb85bbc-eda5-46cb-adce-510c281f7ce6 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:37 devstack sudo[105765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-cbb85bbc-eda5-46cb-adce-510c281f7ce6 Aug 26 14:30:37 devstack sudo[105765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:37 devstack sudo[105764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-76dd1101-ba41-492a-b48b-ee21fc5fe5aa Aug 26 14:30:37 devstack sudo[105764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:37 devstack sudo[105765]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:37 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-d67d9aea-0595-4fc9-8c77-c645b3063e49 tempest-VolumesImageMetadata-621021804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-cbb85bbc-eda5-46cb-adce-510c281f7ce6" returned: 0 in 0.271s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:37 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-d67d9aea-0595-4fc9-8c77-c645b3063e49 tempest-VolumesImageMetadata-621021804 None] Lock "cinder-quobyte-cbb85bbc-eda5-46cb-adce-510c281f7ce6" released by "delete_volume" :: held 0.761s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:30:37 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-d67d9aea-0595-4fc9-8c77-c645b3063e49 tempest-VolumesImageMetadata-621021804 None] Created reservations ['205ff5f6-af43-493d-9956-afbce15994a7', '6bcf777e-ceca-4d0a-acde-c34e65bdaf49', 'cdc3628b-499e-4a06-b732-e2d32f93bbf9', 'f59650c9-b596-4eff-a5b9-93c178189303'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:30:37 devstack sudo[105764]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:37 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-76097846-c7cc-41d5-83cd-482b3c73a9a8 tempest-VolumesGetTest-459511347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-76dd1101-ba41-492a-b48b-ee21fc5fe5aa" returned: 0 in 0.399s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:37 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-76097846-c7cc-41d5-83cd-482b3c73a9a8 tempest-VolumesGetTest-459511347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-76dd1101-ba41-492a-b48b-ee21fc5fe5aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-76dd1101-ba41-492a-b48b-ee21fc5fe5aa.5dce326d-f188-4467-a0a8-76150aa49d8f 1G {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:37 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-d67d9aea-0595-4fc9-8c77-c645b3063e49 tempest-VolumesImageMetadata-621021804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:30:37 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-d67d9aea-0595-4fc9-8c77-c645b3063e49 tempest-VolumesImageMetadata-621021804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:30:37 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-d67d9aea-0595-4fc9-8c77-c645b3063e49 tempest-VolumesImageMetadata-621021804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:30:37 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-d67d9aea-0595-4fc9-8c77-c645b3063e49 tempest-VolumesImageMetadata-621021804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:30:37 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-d67d9aea-0595-4fc9-8c77-c645b3063e49 tempest-VolumesImageMetadata-621021804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:30:37 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-d67d9aea-0595-4fc9-8c77-c645b3063e49 tempest-VolumesImageMetadata-621021804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:37 devstack sudo[105772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-76dd1101-ba41-492a-b48b-ee21fc5fe5aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-76dd1101-ba41-492a-b48b-ee21fc5fe5aa.5dce326d-f188-4467-a0a8-76150aa49d8f 1G Aug 26 14:30:37 devstack sudo[105772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:37 devstack sudo[105773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:30:37 devstack sudo[105773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:38 devstack sudo[105773]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:38 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-c8599c9d-7c21-4b94-8fbd-305e90c7e5a1 tempest-SnapshotsActionsTest-642613075 None] Acquiring lock "cinder-31a52aff-1e8c-4a37-94bf-3ae3189a1363-delete_snapshot" by "delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:30:38 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-d67d9aea-0595-4fc9-8c77-c645b3063e49 tempest-VolumesImageMetadata-621021804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.296s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:38 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-d67d9aea-0595-4fc9-8c77-c645b3063e49 tempest-VolumesImageMetadata-621021804 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:30:38 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-d67d9aea-0595-4fc9-8c77-c645b3063e49 tempest-VolumesImageMetadata-621021804 None] Deleted volume successfully. Aug 26 14:30:38 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-c8599c9d-7c21-4b94-8fbd-305e90c7e5a1 tempest-SnapshotsActionsTest-642613075 None] Lock "cinder-31a52aff-1e8c-4a37-94bf-3ae3189a1363-delete_snapshot" acquired by "delete_snapshot" :: waited 0.050s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:30:38 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-c8599c9d-7c21-4b94-8fbd-305e90c7e5a1 tempest-SnapshotsActionsTest-642613075 None] Acquiring lock "cinder-quobyte-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943" by "delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:30:38 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-d67d9aea-0595-4fc9-8c77-c645b3063e49 tempest-VolumesImageMetadata-621021804 None] Lock "cinder-cbb85bbc-eda5-46cb-adce-510c281f7ce6-delete_volume" released by "delete_volume" :: held 1.349s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:30:38 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-c8599c9d-7c21-4b94-8fbd-305e90c7e5a1 tempest-SnapshotsActionsTest-642613075 None] Lock "cinder-quobyte-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943" acquired by "delete_snapshot" :: waited 0.029s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:30:38 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-c8599c9d-7c21-4b94-8fbd-305e90c7e5a1 tempest-SnapshotsActionsTest-642613075 None] Acquiring lock "cinder-quobyte-31a52aff-1e8c-4a37-94bf-3ae3189a1363" by "_delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:30:38 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-c8599c9d-7c21-4b94-8fbd-305e90c7e5a1 tempest-SnapshotsActionsTest-642613075 None] Lock "cinder-quobyte-31a52aff-1e8c-4a37-94bf-3ae3189a1363" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:30:38 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-c8599c9d-7c21-4b94-8fbd-305e90c7e5a1 tempest-SnapshotsActionsTest-642613075 None] Deleting offline snapshot 31a52aff-1e8c-4a37-94bf-3ae3189a1363 of volume 4fb30b4d-fd01-4922-b4e3-7bb6dfb45943 {{(pid=94394) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 14:30:38 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-c8599c9d-7c21-4b94-8fbd-305e90c7e5a1 tempest-SnapshotsActionsTest-642613075 None] snapshot_file for this snap is: volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.31a52aff-1e8c-4a37-94bf-3ae3189a1363 {{(pid=94394) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 14:30:38 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[24988444-b932-4c95-a527-259b9365717f]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:30:38 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-c8599c9d-7c21-4b94-8fbd-305e90c7e5a1 tempest-SnapshotsActionsTest-642613075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.31a52aff-1e8c-4a37-94bf-3ae3189a1363 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:38 devstack sudo[105772]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:38 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-76097846-c7cc-41d5-83cd-482b3c73a9a8 tempest-VolumesGetTest-459511347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-76dd1101-ba41-492a-b48b-ee21fc5fe5aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-76dd1101-ba41-492a-b48b-ee21fc5fe5aa.5dce326d-f188-4467-a0a8-76150aa49d8f 1G" returned: 0 in 0.541s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:38 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-76097846-c7cc-41d5-83cd-482b3c73a9a8 tempest-VolumesGetTest-459511347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76dd1101-ba41-492a-b48b-ee21fc5fe5aa -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-76dd1101-ba41-492a-b48b-ee21fc5fe5aa.5dce326d-f188-4467-a0a8-76150aa49d8f {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:38 devstack sudo[105782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76dd1101-ba41-492a-b48b-ee21fc5fe5aa -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-76dd1101-ba41-492a-b48b-ee21fc5fe5aa.5dce326d-f188-4467-a0a8-76150aa49d8f Aug 26 14:30:38 devstack sudo[105782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:38 devstack sudo[105781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.31a52aff-1e8c-4a37-94bf-3ae3189a1363 Aug 26 14:30:38 devstack sudo[105781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:38 devstack sudo[105781]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:38 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-c8599c9d-7c21-4b94-8fbd-305e90c7e5a1 tempest-SnapshotsActionsTest-642613075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.31a52aff-1e8c-4a37-94bf-3ae3189a1363" returned: 0 in 0.405s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:38 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-c8599c9d-7c21-4b94-8fbd-305e90c7e5a1 tempest-SnapshotsActionsTest-642613075 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94394) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 14:30:38 devstack sudo[105782]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:38 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-76097846-c7cc-41d5-83cd-482b3c73a9a8 tempest-VolumesGetTest-459511347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76dd1101-ba41-492a-b48b-ee21fc5fe5aa -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-76dd1101-ba41-492a-b48b-ee21fc5fe5aa.5dce326d-f188-4467-a0a8-76150aa49d8f" returned: 0 in 0.353s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:38 devstack cinder-volume[94394]: WARNING cinder.volume.drivers.remotefs [None req-76097846-c7cc-41d5-83cd-482b3c73a9a8 tempest-VolumesGetTest-459511347 None] /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-76dd1101-ba41-492a-b48b-ee21fc5fe5aa.5dce326d-f188-4467-a0a8-76150aa49d8f is being set with open permissions: ugo+rw Aug 26 14:30:38 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-76097846-c7cc-41d5-83cd-482b3c73a9a8 tempest-VolumesGetTest-459511347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-76dd1101-ba41-492a-b48b-ee21fc5fe5aa.5dce326d-f188-4467-a0a8-76150aa49d8f {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:38 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[46040a9a-2a00-4474-8bc7-f9853f1121e6]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:30:38 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-c8599c9d-7c21-4b94-8fbd-305e90c7e5a1 tempest-SnapshotsActionsTest-642613075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.9a2cb941-51f1-4661-b104-c9713dced550 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:38 devstack sudo[105791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-76dd1101-ba41-492a-b48b-ee21fc5fe5aa.5dce326d-f188-4467-a0a8-76150aa49d8f Aug 26 14:30:38 devstack sudo[105791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:38 devstack sudo[105792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.9a2cb941-51f1-4661-b104-c9713dced550 Aug 26 14:30:38 devstack sudo[105792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:39 devstack sudo[105791]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:39 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-76097846-c7cc-41d5-83cd-482b3c73a9a8 tempest-VolumesGetTest-459511347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-76dd1101-ba41-492a-b48b-ee21fc5fe5aa.5dce326d-f188-4467-a0a8-76150aa49d8f" returned: 0 in 0.308s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:39 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-76097846-c7cc-41d5-83cd-482b3c73a9a8 tempest-VolumesGetTest-459511347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-76dd1101-ba41-492a-b48b-ee21fc5fe5aa.info {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:39 devstack sudo[105797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-76dd1101-ba41-492a-b48b-ee21fc5fe5aa.info Aug 26 14:30:39 devstack sudo[105797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:39 devstack sudo[105792]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:39 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-c8599c9d-7c21-4b94-8fbd-305e90c7e5a1 tempest-SnapshotsActionsTest-642613075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.9a2cb941-51f1-4661-b104-c9713dced550" returned: 0 in 0.433s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:39 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-c8599c9d-7c21-4b94-8fbd-305e90c7e5a1 tempest-SnapshotsActionsTest-642613075 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94394) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 14:30:39 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-c8599c9d-7c21-4b94-8fbd-305e90c7e5a1 tempest-SnapshotsActionsTest-642613075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.31a52aff-1e8c-4a37-94bf-3ae3189a1363 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:39 devstack sudo[105801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.31a52aff-1e8c-4a37-94bf-3ae3189a1363 Aug 26 14:30:39 devstack sudo[105801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:39 devstack sudo[105797]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:39 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-76097846-c7cc-41d5-83cd-482b3c73a9a8 tempest-VolumesGetTest-459511347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-76dd1101-ba41-492a-b48b-ee21fc5fe5aa.info" returned: 0 in 0.294s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:39 devstack cinder-volume[94394]: WARNING cinder.volume.drivers.remotefs [None req-76097846-c7cc-41d5-83cd-482b3c73a9a8 tempest-VolumesGetTest-459511347 None] /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-76dd1101-ba41-492a-b48b-ee21fc5fe5aa.info is being set with open permissions: ugo+rw Aug 26 14:30:39 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-76097846-c7cc-41d5-83cd-482b3c73a9a8 tempest-VolumesGetTest-459511347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-76dd1101-ba41-492a-b48b-ee21fc5fe5aa.info {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:39 devstack sudo[105804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-76dd1101-ba41-492a-b48b-ee21fc5fe5aa.info Aug 26 14:30:39 devstack sudo[105804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:39 devstack sudo[105801]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:39 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-c8599c9d-7c21-4b94-8fbd-305e90c7e5a1 tempest-SnapshotsActionsTest-642613075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.31a52aff-1e8c-4a37-94bf-3ae3189a1363" returned: 0 in 0.438s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:39 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-c8599c9d-7c21-4b94-8fbd-305e90c7e5a1 tempest-SnapshotsActionsTest-642613075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.31a52aff-1e8c-4a37-94bf-3ae3189a1363 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:39 devstack sudo[105811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.31a52aff-1e8c-4a37-94bf-3ae3189a1363 Aug 26 14:30:39 devstack sudo[105804]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:39 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-76097846-c7cc-41d5-83cd-482b3c73a9a8 tempest-VolumesGetTest-459511347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-76dd1101-ba41-492a-b48b-ee21fc5fe5aa.info" returned: 0 in 0.289s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:39 devstack sudo[105811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:39 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-76097846-c7cc-41d5-83cd-482b3c73a9a8 tempest-VolumesGetTest-459511347 None] Acquiring lock "cinder-quobyte-b625232f-8f11-4d70-b523-cce355a45ca4" by "_copy_volume_from_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:30:39 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-76097846-c7cc-41d5-83cd-482b3c73a9a8 tempest-VolumesGetTest-459511347 None] Lock "cinder-quobyte-b625232f-8f11-4d70-b523-cce355a45ca4" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:30:39 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-76097846-c7cc-41d5-83cd-482b3c73a9a8 tempest-VolumesGetTest-459511347 None] snapshot: 5dce326d-f188-4467-a0a8-76150aa49d8f, volume: b625232f-8f11-4d70-b523-cce355a45ca4, {{(pid=94394) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 26 14:30:39 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-76097846-c7cc-41d5-83cd-482b3c73a9a8 tempest-VolumesGetTest-459511347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:30:39 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-76097846-c7cc-41d5-83cd-482b3c73a9a8 tempest-VolumesGetTest-459511347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:30:39 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-76097846-c7cc-41d5-83cd-482b3c73a9a8 tempest-VolumesGetTest-459511347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:30:39 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-76097846-c7cc-41d5-83cd-482b3c73a9a8 tempest-VolumesGetTest-459511347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:30:39 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-76097846-c7cc-41d5-83cd-482b3c73a9a8 tempest-VolumesGetTest-459511347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:30:39 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7ded82e-e53f-451a-8d08-6077b2a7d022]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:30:39 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-76097846-c7cc-41d5-83cd-482b3c73a9a8 tempest-VolumesGetTest-459511347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-76dd1101-ba41-492a-b48b-ee21fc5fe5aa.5dce326d-f188-4467-a0a8-76150aa49d8f {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:39 devstack sudo[105813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-76dd1101-ba41-492a-b48b-ee21fc5fe5aa.5dce326d-f188-4467-a0a8-76150aa49d8f Aug 26 14:30:39 devstack sudo[105813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:39 devstack sudo[105811]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:39 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-c8599c9d-7c21-4b94-8fbd-305e90c7e5a1 tempest-SnapshotsActionsTest-642613075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.31a52aff-1e8c-4a37-94bf-3ae3189a1363" returned: 0 in 0.276s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:39 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-c8599c9d-7c21-4b94-8fbd-305e90c7e5a1 tempest-SnapshotsActionsTest-642613075 None] Lock "cinder-quobyte-31a52aff-1e8c-4a37-94bf-3ae3189a1363" released by "_delete_snapshot" :: held 1.680s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:30:39 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-c8599c9d-7c21-4b94-8fbd-305e90c7e5a1 tempest-SnapshotsActionsTest-642613075 None] Lock "cinder-quobyte-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943" released by "delete_snapshot" :: held 1.707s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:30:40 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-c8599c9d-7c21-4b94-8fbd-305e90c7e5a1 tempest-SnapshotsActionsTest-642613075 None] Created reservations ['59f88d40-4142-47bf-9ff8-0ff5ccc01548', 'c170e28f-78e8-4cbb-9842-cce7752c4f88', '7fca1588-76de-4f7e-bb0a-f6b5251e7928', '2ed6e6c3-3781-45e3-b11d-7083052ae089'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:30:40 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-c8599c9d-7c21-4b94-8fbd-305e90c7e5a1 tempest-SnapshotsActionsTest-642613075 None] Delete snapshot completed successfully. Aug 26 14:30:40 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-c8599c9d-7c21-4b94-8fbd-305e90c7e5a1 tempest-SnapshotsActionsTest-642613075 None] Lock "cinder-31a52aff-1e8c-4a37-94bf-3ae3189a1363-delete_snapshot" released by "delete_snapshot" :: held 1.882s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:30:40 devstack sudo[105813]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:40 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-76097846-c7cc-41d5-83cd-482b3c73a9a8 tempest-VolumesGetTest-459511347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-76dd1101-ba41-492a-b48b-ee21fc5fe5aa.5dce326d-f188-4467-a0a8-76150aa49d8f" returned: 0 in 0.391s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:40 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-76097846-c7cc-41d5-83cd-482b3c73a9a8 tempest-VolumesGetTest-459511347 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-76dd1101-ba41-492a-b48b-ee21fc5fe5aa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94394) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 14:30:40 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[160e67c8-47cb-4607-9ccb-45104c786f8e]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:30:40 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-76097846-c7cc-41d5-83cd-482b3c73a9a8 tempest-VolumesGetTest-459511347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-76dd1101-ba41-492a-b48b-ee21fc5fe5aa {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:40 devstack sudo[105820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-76dd1101-ba41-492a-b48b-ee21fc5fe5aa Aug 26 14:30:40 devstack sudo[105820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:40 devstack sudo[105820]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:40 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-76097846-c7cc-41d5-83cd-482b3c73a9a8 tempest-VolumesGetTest-459511347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-76dd1101-ba41-492a-b48b-ee21fc5fe5aa" returned: 0 in 0.440s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:40 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-76097846-c7cc-41d5-83cd-482b3c73a9a8 tempest-VolumesGetTest-459511347 None] will copy from snapshot at /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-76dd1101-ba41-492a-b48b-ee21fc5fe5aa {{(pid=94394) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 26 14:30:40 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-76097846-c7cc-41d5-83cd-482b3c73a9a8 tempest-VolumesGetTest-459511347 None] Creating direct copy from snapshot {{(pid=94394) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 26 14:30:40 devstack cinder-volume[94394]: DEBUG cinder.utils [None req-76097846-c7cc-41d5-83cd-482b3c73a9a8 tempest-VolumesGetTest-459511347 None] Path /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b625232f-8f11-4d70-b523-cce355a45ca4 not found in is_blk_device check {{(pid=94394) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 26 14:30:40 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-76097846-c7cc-41d5-83cd-482b3c73a9a8 tempest-VolumesGetTest-459511347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-76dd1101-ba41-492a-b48b-ee21fc5fe5aa /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b625232f-8f11-4d70-b523-cce355a45ca4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:40 devstack sudo[105825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-76dd1101-ba41-492a-b48b-ee21fc5fe5aa /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b625232f-8f11-4d70-b523-cce355a45ca4 Aug 26 14:30:40 devstack sudo[105825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:40 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-170f5fe9-02d4-4280-b90d-41a6f38dea2e tempest-SnapshotsActionsTest-695899691 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:30:45 devstack sudo[105825]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:45 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-76097846-c7cc-41d5-83cd-482b3c73a9a8 tempest-VolumesGetTest-459511347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-76dd1101-ba41-492a-b48b-ee21fc5fe5aa /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b625232f-8f11-4d70-b523-cce355a45ca4" returned: 0 in 5.052s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:45 devstack cinder-volume[94394]: DEBUG cinder.image.image_utils [None req-76097846-c7cc-41d5-83cd-482b3c73a9a8 tempest-VolumesGetTest-459511347 None] Image conversion details: src /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-76dd1101-ba41-492a-b48b-ee21fc5fe5aa, size 1024.00 MB, duration 5.05 sec, destination /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b625232f-8f11-4d70-b523-cce355a45ca4 {{(pid=94394) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 14:30:45 devstack cinder-volume[94394]: INFO cinder.image.image_utils [None req-76097846-c7cc-41d5-83cd-482b3c73a9a8 tempest-VolumesGetTest-459511347 None] Converted 1024.00 MB image at 202.64 MB/s Aug 26 14:30:45 devstack cinder-volume[94394]: WARNING cinder.volume.drivers.remotefs [None req-76097846-c7cc-41d5-83cd-482b3c73a9a8 tempest-VolumesGetTest-459511347 None] /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b625232f-8f11-4d70-b523-cce355a45ca4 is being set with open permissions: ugo+rw Aug 26 14:30:45 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-76097846-c7cc-41d5-83cd-482b3c73a9a8 tempest-VolumesGetTest-459511347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b625232f-8f11-4d70-b523-cce355a45ca4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:45 devstack sudo[105844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b625232f-8f11-4d70-b523-cce355a45ca4 Aug 26 14:30:45 devstack sudo[105844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:45 devstack sudo[105844]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:45 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-76097846-c7cc-41d5-83cd-482b3c73a9a8 tempest-VolumesGetTest-459511347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b625232f-8f11-4d70-b523-cce355a45ca4" returned: 0 in 0.252s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:45 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-76097846-c7cc-41d5-83cd-482b3c73a9a8 tempest-VolumesGetTest-459511347 None] Lock "cinder-quobyte-b625232f-8f11-4d70-b523-cce355a45ca4" released by "_copy_volume_from_snapshot" :: held 6.214s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:30:45 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-76097846-c7cc-41d5-83cd-482b3c73a9a8 tempest-VolumesGetTest-459511347 None] Acquiring lock "cinder-quobyte-5dce326d-f188-4467-a0a8-76150aa49d8f" by "_delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:30:45 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-76097846-c7cc-41d5-83cd-482b3c73a9a8 tempest-VolumesGetTest-459511347 None] Lock "cinder-quobyte-5dce326d-f188-4467-a0a8-76150aa49d8f" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:30:45 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-76097846-c7cc-41d5-83cd-482b3c73a9a8 tempest-VolumesGetTest-459511347 None] Deleting offline snapshot 5dce326d-f188-4467-a0a8-76150aa49d8f of volume 76dd1101-ba41-492a-b48b-ee21fc5fe5aa {{(pid=94394) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 14:30:46 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-76097846-c7cc-41d5-83cd-482b3c73a9a8 tempest-VolumesGetTest-459511347 None] snapshot_file for this snap is: volume-76dd1101-ba41-492a-b48b-ee21fc5fe5aa.5dce326d-f188-4467-a0a8-76150aa49d8f {{(pid=94394) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 14:30:46 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[821f048c-fcc7-4988-93d0-67ddc96ebec6]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:30:46 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-76097846-c7cc-41d5-83cd-482b3c73a9a8 tempest-VolumesGetTest-459511347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-76dd1101-ba41-492a-b48b-ee21fc5fe5aa.5dce326d-f188-4467-a0a8-76150aa49d8f {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:46 devstack sudo[105847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-76dd1101-ba41-492a-b48b-ee21fc5fe5aa.5dce326d-f188-4467-a0a8-76150aa49d8f Aug 26 14:30:46 devstack sudo[105847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:46 devstack sudo[105847]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:46 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-76097846-c7cc-41d5-83cd-482b3c73a9a8 tempest-VolumesGetTest-459511347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-76dd1101-ba41-492a-b48b-ee21fc5fe5aa.5dce326d-f188-4467-a0a8-76150aa49d8f" returned: 0 in 0.390s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:46 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-76097846-c7cc-41d5-83cd-482b3c73a9a8 tempest-VolumesGetTest-459511347 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-76dd1101-ba41-492a-b48b-ee21fc5fe5aa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94394) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 14:30:46 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[f31a49dd-7293-4bc5-9a67-09d8cf17cc01]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:30:46 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-76097846-c7cc-41d5-83cd-482b3c73a9a8 tempest-VolumesGetTest-459511347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-76dd1101-ba41-492a-b48b-ee21fc5fe5aa {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:46 devstack sudo[105852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-76dd1101-ba41-492a-b48b-ee21fc5fe5aa Aug 26 14:30:46 devstack sudo[105852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:46 devstack sudo[105852]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:46 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-76097846-c7cc-41d5-83cd-482b3c73a9a8 tempest-VolumesGetTest-459511347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-76dd1101-ba41-492a-b48b-ee21fc5fe5aa" returned: 0 in 0.527s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:46 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-76097846-c7cc-41d5-83cd-482b3c73a9a8 tempest-VolumesGetTest-459511347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-76dd1101-ba41-492a-b48b-ee21fc5fe5aa.5dce326d-f188-4467-a0a8-76150aa49d8f {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:47 devstack sudo[105857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-76dd1101-ba41-492a-b48b-ee21fc5fe5aa.5dce326d-f188-4467-a0a8-76150aa49d8f Aug 26 14:30:47 devstack sudo[105857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:47 devstack sudo[105857]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:47 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-76097846-c7cc-41d5-83cd-482b3c73a9a8 tempest-VolumesGetTest-459511347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-76dd1101-ba41-492a-b48b-ee21fc5fe5aa.5dce326d-f188-4467-a0a8-76150aa49d8f" returned: 0 in 0.352s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:47 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-76097846-c7cc-41d5-83cd-482b3c73a9a8 tempest-VolumesGetTest-459511347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-76dd1101-ba41-492a-b48b-ee21fc5fe5aa.5dce326d-f188-4467-a0a8-76150aa49d8f {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:47 devstack sudo[105863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-76dd1101-ba41-492a-b48b-ee21fc5fe5aa.5dce326d-f188-4467-a0a8-76150aa49d8f Aug 26 14:30:47 devstack sudo[105863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:47 devstack sudo[105863]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:47 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-76097846-c7cc-41d5-83cd-482b3c73a9a8 tempest-VolumesGetTest-459511347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-76dd1101-ba41-492a-b48b-ee21fc5fe5aa.5dce326d-f188-4467-a0a8-76150aa49d8f" returned: 0 in 0.306s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:47 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-76097846-c7cc-41d5-83cd-482b3c73a9a8 tempest-VolumesGetTest-459511347 None] Lock "cinder-quobyte-5dce326d-f188-4467-a0a8-76150aa49d8f" released by "_delete_snapshot" :: held 1.678s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:30:47 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-76097846-c7cc-41d5-83cd-482b3c73a9a8 tempest-VolumesGetTest-459511347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.396s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:30:47 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-10224bba-8b73-4011-9a88-267b08a016a9 tempest-VolumesListAdminTestJSON-228051891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.232s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:30:47 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-10224bba-8b73-4011-9a88-267b08a016a9 tempest-VolumesListAdminTestJSON-228051891 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:30:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1045106429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a30b94a-992b-44f8-8563-31d6603bf5be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='953802c77bf241f288774dd88faef88e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:30:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:30:37Z,use_quota=True,user_id='e61f7ece936340c68094fc38e941abdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:30:47 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-10224bba-8b73-4011-9a88-267b08a016a9 tempest-VolumesListAdminTestJSON-228051891 None] Creating volume 8a30b94a-992b-44f8-8563-31d6603bf5be {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:30:47 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-10224bba-8b73-4011-9a88-267b08a016a9 tempest-VolumesListAdminTestJSON-228051891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:30:47 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-10224bba-8b73-4011-9a88-267b08a016a9 tempest-VolumesListAdminTestJSON-228051891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:30:47 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-10224bba-8b73-4011-9a88-267b08a016a9 tempest-VolumesListAdminTestJSON-228051891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:30:47 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-10224bba-8b73-4011-9a88-267b08a016a9 tempest-VolumesListAdminTestJSON-228051891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:30:47 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-10224bba-8b73-4011-9a88-267b08a016a9 tempest-VolumesListAdminTestJSON-228051891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:30:47 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-10224bba-8b73-4011-9a88-267b08a016a9 tempest-VolumesListAdminTestJSON-228051891 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:30:47 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-10224bba-8b73-4011-9a88-267b08a016a9 tempest-VolumesListAdminTestJSON-228051891 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:30:47 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-10224bba-8b73-4011-9a88-267b08a016a9 tempest-VolumesListAdminTestJSON-228051891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-8a30b94a-992b-44f8-8563-31d6603bf5be 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:47 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-76097846-c7cc-41d5-83cd-482b3c73a9a8 tempest-VolumesGetTest-459511347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (986dd82b-8f0a-47ed-a17d-96de0dbc8b0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b625232f-8f11-4d70-b523-cce355a45ca4', 'volume_size': 1, 'source_volid': '76dd1101-ba41-492a-b48b-ee21fc5fe5aa', 'source_volstatus': 'available'}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:30:47 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-76097846-c7cc-41d5-83cd-482b3c73a9a8 tempest-VolumesGetTest-459511347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6472ec0d-d01c-43f0-9cd8-2ec904e8f882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:30:47 devstack sudo[105866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-8a30b94a-992b-44f8-8563-31d6603bf5be 1073741824 Aug 26 14:30:47 devstack sudo[105866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:47 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-76097846-c7cc-41d5-83cd-482b3c73a9a8 tempest-VolumesGetTest-459511347 None] Volume volume-b625232f-8f11-4d70-b523-cce355a45ca4 (b625232f-8f11-4d70-b523-cce355a45ca4): created successfully Aug 26 14:30:47 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-76097846-c7cc-41d5-83cd-482b3c73a9a8 tempest-VolumesGetTest-459511347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6472ec0d-d01c-43f0-9cd8-2ec904e8f882) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:30:47 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-76097846-c7cc-41d5-83cd-482b3c73a9a8 tempest-VolumesGetTest-459511347 None] Flow 'volume_create_manager' (c66efe3a-7e9a-4bb6-8c1b-873af21f1c65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:30:47 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-76097846-c7cc-41d5-83cd-482b3c73a9a8 tempest-VolumesGetTest-459511347 None] Created volume successfully. Aug 26 14:30:48 devstack sudo[105866]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:48 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-10224bba-8b73-4011-9a88-267b08a016a9 tempest-VolumesListAdminTestJSON-228051891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-8a30b94a-992b-44f8-8563-31d6603bf5be 1073741824" returned: 0 in 0.538s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:48 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-10224bba-8b73-4011-9a88-267b08a016a9 tempest-VolumesListAdminTestJSON-228051891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-8a30b94a-992b-44f8-8563-31d6603bf5be {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:48 devstack sudo[105872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-8a30b94a-992b-44f8-8563-31d6603bf5be Aug 26 14:30:48 devstack sudo[105872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:48 devstack sudo[105872]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:48 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-10224bba-8b73-4011-9a88-267b08a016a9 tempest-VolumesListAdminTestJSON-228051891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-8a30b94a-992b-44f8-8563-31d6603bf5be" returned: 0 in 0.345s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:48 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-10224bba-8b73-4011-9a88-267b08a016a9 tempest-VolumesListAdminTestJSON-228051891 None] <== create_volume: return (931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:30:48 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-10224bba-8b73-4011-9a88-267b08a016a9 tempest-VolumesListAdminTestJSON-228051891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:30:48 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-170f5fe9-02d4-4280-b90d-41a6f38dea2e tempest-SnapshotsActionsTest-695899691 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.956s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:30:48 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-10224bba-8b73-4011-9a88-267b08a016a9 tempest-VolumesListAdminTestJSON-228051891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed44aaf5-b953-4f90-bf92-9f4fbf140b34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a30b94a-992b-44f8-8563-31d6603bf5be', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:30:48 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-10224bba-8b73-4011-9a88-267b08a016a9 tempest-VolumesListAdminTestJSON-228051891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d04976e-9c3b-4dd9-8740-aaf89a7771b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:30:48 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-170f5fe9-02d4-4280-b90d-41a6f38dea2e tempest-SnapshotsActionsTest-695899691 None] Creating offline snapshot 52b854a3-d1e9-4398-ac4b-9492685b70d0 of volume 4fb30b4d-fd01-4922-b4e3-7bb6dfb45943 {{(pid=94394) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 14:30:48 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-10224bba-8b73-4011-9a88-267b08a016a9 tempest-VolumesListAdminTestJSON-228051891 None] Volume volume-8a30b94a-992b-44f8-8563-31d6603bf5be (8a30b94a-992b-44f8-8563-31d6603bf5be): created successfully Aug 26 14:30:48 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-10224bba-8b73-4011-9a88-267b08a016a9 tempest-VolumesListAdminTestJSON-228051891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d04976e-9c3b-4dd9-8740-aaf89a7771b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:30:48 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-10224bba-8b73-4011-9a88-267b08a016a9 tempest-VolumesListAdminTestJSON-228051891 None] Flow 'volume_create_manager' (1f3f75d3-b615-45bf-bb93-991d021d9f1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:30:48 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[62f0efee-7e98-4a18-a701-042429d99570]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:30:48 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-170f5fe9-02d4-4280-b90d-41a6f38dea2e tempest-SnapshotsActionsTest-695899691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.9a2cb941-51f1-4661-b104-c9713dced550 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:48 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-10224bba-8b73-4011-9a88-267b08a016a9 tempest-VolumesListAdminTestJSON-228051891 None] Created volume successfully. Aug 26 14:30:48 devstack sudo[105875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.9a2cb941-51f1-4661-b104-c9713dced550 Aug 26 14:30:48 devstack sudo[105875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:49 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-a431e66d-4f5d-45b2-b27a-28eaa8efaa05 tempest-VolumesGetTest-459511347 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:30:49 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-a431e66d-4f5d-45b2-b27a-28eaa8efaa05 tempest-VolumesGetTest-459511347 None] Flow 'volume_create_manager' (162e3605-0de3-44c7-ae82-a15e016c7f69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:30:49 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-a431e66d-4f5d-45b2-b27a-28eaa8efaa05 tempest-VolumesGetTest-459511347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b72dbadd-3624-4904-9cd9-8c460b7074a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:30:49 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-a431e66d-4f5d-45b2-b27a-28eaa8efaa05 tempest-VolumesGetTest-459511347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b72dbadd-3624-4904-9cd9-8c460b7074a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:30:49Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1831084918',display_name='tempest-VolumesGetTest-Volume-1783428268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f6dbfde-dffc-40b7-b0e2-6ebb7a9422df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2563771eca7848979f10833a8a104f6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:30:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:30:49Z,use_quota=True,user_id='f811ce7459cc4202a99345871cc95ded',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:30:49 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-a431e66d-4f5d-45b2-b27a-28eaa8efaa05 tempest-VolumesGetTest-459511347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f33e40f-8412-4f48-806c-db5584bf355c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:30:49 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-a431e66d-4f5d-45b2-b27a-28eaa8efaa05 tempest-VolumesGetTest-459511347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f33e40f-8412-4f48-806c-db5584bf355c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:30:49 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-a431e66d-4f5d-45b2-b27a-28eaa8efaa05 tempest-VolumesGetTest-459511347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c564e43a-e3cd-4342-8461-366f1462b9e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:30:49 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-a431e66d-4f5d-45b2-b27a-28eaa8efaa05 tempest-VolumesGetTest-459511347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c564e43a-e3cd-4342-8461-366f1462b9e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f6dbfde-dffc-40b7-b0e2-6ebb7a9422df', 'volume_name': 'volume-8f6dbfde-dffc-40b7-b0e2-6ebb7a9422df', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:30:49 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-a431e66d-4f5d-45b2-b27a-28eaa8efaa05 tempest-VolumesGetTest-459511347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5e375ed-4489-4365-acad-a451a442c58d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:30:49 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-a431e66d-4f5d-45b2-b27a-28eaa8efaa05 tempest-VolumesGetTest-459511347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5e375ed-4489-4365-acad-a451a442c58d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:30:49 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-a431e66d-4f5d-45b2-b27a-28eaa8efaa05 tempest-VolumesGetTest-459511347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7432c8b1-f264-4812-8424-8adfe7bfcca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:30:49 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-a431e66d-4f5d-45b2-b27a-28eaa8efaa05 tempest-VolumesGetTest-459511347 None] Volume 8f6dbfde-dffc-40b7-b0e2-6ebb7a9422df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f6dbfde-dffc-40b7-b0e2-6ebb7a9422df', 'volume_size': 1} Aug 26 14:30:49 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-a431e66d-4f5d-45b2-b27a-28eaa8efaa05 tempest-VolumesGetTest-459511347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:30:49 devstack sudo[105875]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:49 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-170f5fe9-02d4-4280-b90d-41a6f38dea2e tempest-SnapshotsActionsTest-695899691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.9a2cb941-51f1-4661-b104-c9713dced550" returned: 0 in 0.614s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:49 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-170f5fe9-02d4-4280-b90d-41a6f38dea2e tempest-SnapshotsActionsTest-695899691 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94394) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 14:30:49 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-170f5fe9-02d4-4280-b90d-41a6f38dea2e tempest-SnapshotsActionsTest-695899691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.9a2cb941-51f1-4661-b104-c9713dced550,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.52b854a3-d1e9-4398-ac4b-9492685b70d0 1G {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:49 devstack sudo[105880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.9a2cb941-51f1-4661-b104-c9713dced550,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.52b854a3-d1e9-4398-ac4b-9492685b70d0 1G Aug 26 14:30:49 devstack sudo[105880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:50 devstack sudo[105880]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:50 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-170f5fe9-02d4-4280-b90d-41a6f38dea2e tempest-SnapshotsActionsTest-695899691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.9a2cb941-51f1-4661-b104-c9713dced550,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.52b854a3-d1e9-4398-ac4b-9492685b70d0 1G" returned: 0 in 0.655s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:50 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-170f5fe9-02d4-4280-b90d-41a6f38dea2e tempest-SnapshotsActionsTest-695899691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.9a2cb941-51f1-4661-b104-c9713dced550 -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.52b854a3-d1e9-4398-ac4b-9492685b70d0 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:50 devstack sudo[105887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.9a2cb941-51f1-4661-b104-c9713dced550 -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.52b854a3-d1e9-4398-ac4b-9492685b70d0 Aug 26 14:30:50 devstack sudo[105887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:50 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-22890a34-23f3-4421-bbbf-34f07704a82b tempest-VolumesListAdminTestJSON-228051891 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:30:50 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-22890a34-23f3-4421-bbbf-34f07704a82b tempest-VolumesListAdminTestJSON-228051891 None] Flow 'volume_create_manager' (b9bcc7d0-e754-4505-b03b-8c5eadbf645e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:30:50 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-22890a34-23f3-4421-bbbf-34f07704a82b tempest-VolumesListAdminTestJSON-228051891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfa02e40-e76c-4f37-ba0f-ad41b777ee03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:30:50 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-22890a34-23f3-4421-bbbf-34f07704a82b tempest-VolumesListAdminTestJSON-228051891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfa02e40-e76c-4f37-ba0f-ad41b777ee03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:30:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-131508681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4f6f2c9-69db-4c4e-881d-ddeb0ef56424,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='953802c77bf241f288774dd88faef88e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:30:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:30:50Z,use_quota=True,user_id='e61f7ece936340c68094fc38e941abdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:30:50 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-22890a34-23f3-4421-bbbf-34f07704a82b tempest-VolumesListAdminTestJSON-228051891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a9dde52-3f89-4c97-8f50-6fb905135229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:30:50 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-22890a34-23f3-4421-bbbf-34f07704a82b tempest-VolumesListAdminTestJSON-228051891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a9dde52-3f89-4c97-8f50-6fb905135229) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:30:50 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-22890a34-23f3-4421-bbbf-34f07704a82b tempest-VolumesListAdminTestJSON-228051891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0375705c-1c76-45ed-989e-40311cd16e0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:30:50 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-22890a34-23f3-4421-bbbf-34f07704a82b tempest-VolumesListAdminTestJSON-228051891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0375705c-1c76-45ed-989e-40311cd16e0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4f6f2c9-69db-4c4e-881d-ddeb0ef56424', 'volume_name': 'volume-b4f6f2c9-69db-4c4e-881d-ddeb0ef56424', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:30:50 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-22890a34-23f3-4421-bbbf-34f07704a82b tempest-VolumesListAdminTestJSON-228051891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cbba4f6-f485-4b9a-911a-d650095abd31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:30:50 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-22890a34-23f3-4421-bbbf-34f07704a82b tempest-VolumesListAdminTestJSON-228051891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cbba4f6-f485-4b9a-911a-d650095abd31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:30:50 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-22890a34-23f3-4421-bbbf-34f07704a82b tempest-VolumesListAdminTestJSON-228051891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (005570a8-4a9b-427b-a20e-5b316fec0cf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:30:50 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-22890a34-23f3-4421-bbbf-34f07704a82b tempest-VolumesListAdminTestJSON-228051891 None] Volume b4f6f2c9-69db-4c4e-881d-ddeb0ef56424: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4f6f2c9-69db-4c4e-881d-ddeb0ef56424', 'volume_size': 1} Aug 26 14:30:50 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-22890a34-23f3-4421-bbbf-34f07704a82b tempest-VolumesListAdminTestJSON-228051891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:30:50 devstack sudo[105887]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:50 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-170f5fe9-02d4-4280-b90d-41a6f38dea2e tempest-SnapshotsActionsTest-695899691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.9a2cb941-51f1-4661-b104-c9713dced550 -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.52b854a3-d1e9-4398-ac4b-9492685b70d0" returned: 0 in 0.391s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:50 devstack cinder-volume[94394]: WARNING cinder.volume.drivers.remotefs [None req-170f5fe9-02d4-4280-b90d-41a6f38dea2e tempest-SnapshotsActionsTest-695899691 None] /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.52b854a3-d1e9-4398-ac4b-9492685b70d0 is being set with open permissions: ugo+rw Aug 26 14:30:50 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-170f5fe9-02d4-4280-b90d-41a6f38dea2e tempest-SnapshotsActionsTest-695899691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.52b854a3-d1e9-4398-ac4b-9492685b70d0 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:50 devstack sudo[105892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.52b854a3-d1e9-4398-ac4b-9492685b70d0 Aug 26 14:30:50 devstack sudo[105892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:50 devstack sudo[105892]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:50 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-170f5fe9-02d4-4280-b90d-41a6f38dea2e tempest-SnapshotsActionsTest-695899691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.52b854a3-d1e9-4398-ac4b-9492685b70d0" returned: 0 in 0.279s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:50 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-170f5fe9-02d4-4280-b90d-41a6f38dea2e tempest-SnapshotsActionsTest-695899691 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.116s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:30:50 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-a431e66d-4f5d-45b2-b27a-28eaa8efaa05 tempest-VolumesGetTest-459511347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.652s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:30:50 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-a431e66d-4f5d-45b2-b27a-28eaa8efaa05 tempest-VolumesGetTest-459511347 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:30:49Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1831084918',display_name='tempest-VolumesGetTest-Volume-1783428268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f6dbfde-dffc-40b7-b0e2-6ebb7a9422df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2563771eca7848979f10833a8a104f6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:30:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:30:49Z,use_quota=True,user_id='f811ce7459cc4202a99345871cc95ded',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:30:50 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-a431e66d-4f5d-45b2-b27a-28eaa8efaa05 tempest-VolumesGetTest-459511347 None] Creating volume 8f6dbfde-dffc-40b7-b0e2-6ebb7a9422df {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:30:50 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-a431e66d-4f5d-45b2-b27a-28eaa8efaa05 tempest-VolumesGetTest-459511347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:30:50 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-a431e66d-4f5d-45b2-b27a-28eaa8efaa05 tempest-VolumesGetTest-459511347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:30:50 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-a431e66d-4f5d-45b2-b27a-28eaa8efaa05 tempest-VolumesGetTest-459511347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:30:50 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-a431e66d-4f5d-45b2-b27a-28eaa8efaa05 tempest-VolumesGetTest-459511347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:30:50 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-a431e66d-4f5d-45b2-b27a-28eaa8efaa05 tempest-VolumesGetTest-459511347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:30:50 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-a431e66d-4f5d-45b2-b27a-28eaa8efaa05 tempest-VolumesGetTest-459511347 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:30:50 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-a431e66d-4f5d-45b2-b27a-28eaa8efaa05 tempest-VolumesGetTest-459511347 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:30:50 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-a431e66d-4f5d-45b2-b27a-28eaa8efaa05 tempest-VolumesGetTest-459511347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-8f6dbfde-dffc-40b7-b0e2-6ebb7a9422df 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:50 devstack sudo[105895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-8f6dbfde-dffc-40b7-b0e2-6ebb7a9422df 1073741824 Aug 26 14:30:50 devstack sudo[105895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:50 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-170f5fe9-02d4-4280-b90d-41a6f38dea2e tempest-SnapshotsActionsTest-695899691 None] Create snapshot completed successfully Aug 26 14:30:51 devstack sudo[105895]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:51 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-50329a6b-6d6c-42ac-9526-44ff1287257c tempest-SnapshotsActionsTest-642613075 None] Acquiring lock "cinder-52b854a3-d1e9-4398-ac4b-9492685b70d0-delete_snapshot" by "delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:30:51 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-a431e66d-4f5d-45b2-b27a-28eaa8efaa05 tempest-VolumesGetTest-459511347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-8f6dbfde-dffc-40b7-b0e2-6ebb7a9422df 1073741824" returned: 0 in 0.683s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:51 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-50329a6b-6d6c-42ac-9526-44ff1287257c tempest-SnapshotsActionsTest-642613075 None] Lock "cinder-52b854a3-d1e9-4398-ac4b-9492685b70d0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:30:51 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-50329a6b-6d6c-42ac-9526-44ff1287257c tempest-SnapshotsActionsTest-642613075 None] Acquiring lock "cinder-quobyte-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943" by "delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:30:51 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-a431e66d-4f5d-45b2-b27a-28eaa8efaa05 tempest-VolumesGetTest-459511347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-8f6dbfde-dffc-40b7-b0e2-6ebb7a9422df {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:51 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-50329a6b-6d6c-42ac-9526-44ff1287257c tempest-SnapshotsActionsTest-642613075 None] Lock "cinder-quobyte-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943" acquired by "delete_snapshot" :: waited 0.039s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:30:51 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-50329a6b-6d6c-42ac-9526-44ff1287257c tempest-SnapshotsActionsTest-642613075 None] Acquiring lock "cinder-quobyte-52b854a3-d1e9-4398-ac4b-9492685b70d0" by "_delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:30:51 devstack sudo[105901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-8f6dbfde-dffc-40b7-b0e2-6ebb7a9422df Aug 26 14:30:51 devstack sudo[105901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:51 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-50329a6b-6d6c-42ac-9526-44ff1287257c tempest-SnapshotsActionsTest-642613075 None] Lock "cinder-quobyte-52b854a3-d1e9-4398-ac4b-9492685b70d0" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:30:51 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-50329a6b-6d6c-42ac-9526-44ff1287257c tempest-SnapshotsActionsTest-642613075 None] Deleting offline snapshot 52b854a3-d1e9-4398-ac4b-9492685b70d0 of volume 4fb30b4d-fd01-4922-b4e3-7bb6dfb45943 {{(pid=94394) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 14:30:51 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-50329a6b-6d6c-42ac-9526-44ff1287257c tempest-SnapshotsActionsTest-642613075 None] snapshot_file for this snap is: volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.52b854a3-d1e9-4398-ac4b-9492685b70d0 {{(pid=94394) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 14:30:51 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[87db0816-be7c-49fc-9722-8e18fd2ee8b0]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:30:51 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-50329a6b-6d6c-42ac-9526-44ff1287257c tempest-SnapshotsActionsTest-642613075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.52b854a3-d1e9-4398-ac4b-9492685b70d0 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:51 devstack sudo[105903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.52b854a3-d1e9-4398-ac4b-9492685b70d0 Aug 26 14:30:51 devstack sudo[105903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:51 devstack sudo[105901]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:51 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-a431e66d-4f5d-45b2-b27a-28eaa8efaa05 tempest-VolumesGetTest-459511347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-8f6dbfde-dffc-40b7-b0e2-6ebb7a9422df" returned: 0 in 0.298s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:51 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-a431e66d-4f5d-45b2-b27a-28eaa8efaa05 tempest-VolumesGetTest-459511347 None] <== create_volume: return (1043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:30:51 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-a431e66d-4f5d-45b2-b27a-28eaa8efaa05 tempest-VolumesGetTest-459511347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.045s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:30:51 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-22890a34-23f3-4421-bbbf-34f07704a82b tempest-VolumesListAdminTestJSON-228051891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.609s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:30:51 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-22890a34-23f3-4421-bbbf-34f07704a82b tempest-VolumesListAdminTestJSON-228051891 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:30:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-131508681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4f6f2c9-69db-4c4e-881d-ddeb0ef56424,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='953802c77bf241f288774dd88faef88e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:30:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:30:50Z,use_quota=True,user_id='e61f7ece936340c68094fc38e941abdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:30:51 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-22890a34-23f3-4421-bbbf-34f07704a82b tempest-VolumesListAdminTestJSON-228051891 None] Creating volume b4f6f2c9-69db-4c4e-881d-ddeb0ef56424 {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:30:51 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-22890a34-23f3-4421-bbbf-34f07704a82b tempest-VolumesListAdminTestJSON-228051891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:30:51 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-22890a34-23f3-4421-bbbf-34f07704a82b tempest-VolumesListAdminTestJSON-228051891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:30:51 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-22890a34-23f3-4421-bbbf-34f07704a82b tempest-VolumesListAdminTestJSON-228051891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:30:51 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-22890a34-23f3-4421-bbbf-34f07704a82b tempest-VolumesListAdminTestJSON-228051891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:30:51 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-22890a34-23f3-4421-bbbf-34f07704a82b tempest-VolumesListAdminTestJSON-228051891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:30:51 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-22890a34-23f3-4421-bbbf-34f07704a82b tempest-VolumesListAdminTestJSON-228051891 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:30:51 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-22890a34-23f3-4421-bbbf-34f07704a82b tempest-VolumesListAdminTestJSON-228051891 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:30:51 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-22890a34-23f3-4421-bbbf-34f07704a82b tempest-VolumesListAdminTestJSON-228051891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b4f6f2c9-69db-4c4e-881d-ddeb0ef56424 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:51 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-a431e66d-4f5d-45b2-b27a-28eaa8efaa05 tempest-VolumesGetTest-459511347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7432c8b1-f264-4812-8424-8adfe7bfcca5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f6dbfde-dffc-40b7-b0e2-6ebb7a9422df', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:30:51 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-a431e66d-4f5d-45b2-b27a-28eaa8efaa05 tempest-VolumesGetTest-459511347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ac259ab-6273-4dce-93d9-ab85bf739f44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:30:51 devstack sudo[105906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b4f6f2c9-69db-4c4e-881d-ddeb0ef56424 1073741824 Aug 26 14:30:51 devstack sudo[105906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:51 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-a431e66d-4f5d-45b2-b27a-28eaa8efaa05 tempest-VolumesGetTest-459511347 None] Volume volume-8f6dbfde-dffc-40b7-b0e2-6ebb7a9422df (8f6dbfde-dffc-40b7-b0e2-6ebb7a9422df): created successfully Aug 26 14:30:51 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-a431e66d-4f5d-45b2-b27a-28eaa8efaa05 tempest-VolumesGetTest-459511347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ac259ab-6273-4dce-93d9-ab85bf739f44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:30:51 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-a431e66d-4f5d-45b2-b27a-28eaa8efaa05 tempest-VolumesGetTest-459511347 None] Flow 'volume_create_manager' (162e3605-0de3-44c7-ae82-a15e016c7f69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:30:51 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-a431e66d-4f5d-45b2-b27a-28eaa8efaa05 tempest-VolumesGetTest-459511347 None] Created volume successfully. Aug 26 14:30:52 devstack sudo[105903]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:52 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-50329a6b-6d6c-42ac-9526-44ff1287257c tempest-SnapshotsActionsTest-642613075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.52b854a3-d1e9-4398-ac4b-9492685b70d0" returned: 0 in 0.428s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:52 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-50329a6b-6d6c-42ac-9526-44ff1287257c tempest-SnapshotsActionsTest-642613075 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94394) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 14:30:52 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecbf215b-9600-49f5-afa8-b80e42250fd4]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:30:52 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-50329a6b-6d6c-42ac-9526-44ff1287257c tempest-SnapshotsActionsTest-642613075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.9a2cb941-51f1-4661-b104-c9713dced550 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:52 devstack sudo[105911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.9a2cb941-51f1-4661-b104-c9713dced550 Aug 26 14:30:52 devstack sudo[105911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:52 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-34a2c5f3-9c9a-4e96-b8ad-97a94fc6ecbd tempest-VolumesActionsTest-1373378216 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:30:52 devstack sudo[105906]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:52 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-34a2c5f3-9c9a-4e96-b8ad-97a94fc6ecbd tempest-VolumesActionsTest-1373378216 None] Flow 'volume_create_manager' (f28d8a5c-478e-4555-83f0-df4b766a478c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:30:52 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-34a2c5f3-9c9a-4e96-b8ad-97a94fc6ecbd tempest-VolumesActionsTest-1373378216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e47e7c20-2fb9-465e-8ca3-a42fcfae4874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:30:52 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-28e704a0-443d-4b6b-a543-e1962d6e9493 tempest-VolumesGetTest-459511347 None] Acquiring lock "cinder-8f6dbfde-dffc-40b7-b0e2-6ebb7a9422df-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:30:52 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-22890a34-23f3-4421-bbbf-34f07704a82b tempest-VolumesListAdminTestJSON-228051891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b4f6f2c9-69db-4c4e-881d-ddeb0ef56424 1073741824" returned: 0 in 0.590s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:52 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-34a2c5f3-9c9a-4e96-b8ad-97a94fc6ecbd tempest-VolumesActionsTest-1373378216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e47e7c20-2fb9-465e-8ca3-a42fcfae4874) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:30:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-706346931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=769b1fcf-df65-43df-a84e-9624e84e9bf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a11b7a401854fb7b7a48f3a74477608',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:30:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:30:52Z,use_quota=True,user_id='0fce4e8e94ca4567a7acaf545b4f744f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:30:52 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-34a2c5f3-9c9a-4e96-b8ad-97a94fc6ecbd tempest-VolumesActionsTest-1373378216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07dc5fd5-a201-4c95-9bb7-47207721e5a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:30:52 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-34a2c5f3-9c9a-4e96-b8ad-97a94fc6ecbd tempest-VolumesActionsTest-1373378216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07dc5fd5-a201-4c95-9bb7-47207721e5a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:30:52 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-34a2c5f3-9c9a-4e96-b8ad-97a94fc6ecbd tempest-VolumesActionsTest-1373378216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72c540ba-9303-4371-b04d-0a15c266853c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:30:52 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-34a2c5f3-9c9a-4e96-b8ad-97a94fc6ecbd tempest-VolumesActionsTest-1373378216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72c540ba-9303-4371-b04d-0a15c266853c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '769b1fcf-df65-43df-a84e-9624e84e9bf1', 'volume_name': 'volume-769b1fcf-df65-43df-a84e-9624e84e9bf1', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:30:52 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-34a2c5f3-9c9a-4e96-b8ad-97a94fc6ecbd tempest-VolumesActionsTest-1373378216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bbd8081-3bde-4f74-bf7c-cab95bdb532f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:30:52 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-34a2c5f3-9c9a-4e96-b8ad-97a94fc6ecbd tempest-VolumesActionsTest-1373378216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bbd8081-3bde-4f74-bf7c-cab95bdb532f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:30:52 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-34a2c5f3-9c9a-4e96-b8ad-97a94fc6ecbd tempest-VolumesActionsTest-1373378216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b11bb3d1-aa0c-45c7-ae3e-b8355dee5d7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:30:52 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-34a2c5f3-9c9a-4e96-b8ad-97a94fc6ecbd tempest-VolumesActionsTest-1373378216 None] Volume 769b1fcf-df65-43df-a84e-9624e84e9bf1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-769b1fcf-df65-43df-a84e-9624e84e9bf1', 'volume_size': 1} Aug 26 14:30:52 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-34a2c5f3-9c9a-4e96-b8ad-97a94fc6ecbd tempest-VolumesActionsTest-1373378216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:30:52 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-28e704a0-443d-4b6b-a543-e1962d6e9493 tempest-VolumesGetTest-459511347 None] Lock "cinder-8f6dbfde-dffc-40b7-b0e2-6ebb7a9422df-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:30:52 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-22890a34-23f3-4421-bbbf-34f07704a82b tempest-VolumesListAdminTestJSON-228051891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b4f6f2c9-69db-4c4e-881d-ddeb0ef56424 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:52 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-28e704a0-443d-4b6b-a543-e1962d6e9493 tempest-VolumesGetTest-459511347 None] Acquiring lock "cinder-quobyte-8f6dbfde-dffc-40b7-b0e2-6ebb7a9422df" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:30:52 devstack sudo[105921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b4f6f2c9-69db-4c4e-881d-ddeb0ef56424 Aug 26 14:30:52 devstack sudo[105921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:52 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-28e704a0-443d-4b6b-a543-e1962d6e9493 tempest-VolumesGetTest-459511347 None] Lock "cinder-quobyte-8f6dbfde-dffc-40b7-b0e2-6ebb7a9422df" acquired by "delete_volume" :: waited 0.017s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:30:52 devstack sudo[105911]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:52 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-50329a6b-6d6c-42ac-9526-44ff1287257c tempest-SnapshotsActionsTest-642613075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.9a2cb941-51f1-4661-b104-c9713dced550" returned: 0 in 0.507s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:52 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-50329a6b-6d6c-42ac-9526-44ff1287257c tempest-SnapshotsActionsTest-642613075 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94394) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 14:30:52 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-50329a6b-6d6c-42ac-9526-44ff1287257c tempest-SnapshotsActionsTest-642613075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.52b854a3-d1e9-4398-ac4b-9492685b70d0 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:52 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cc9ac1b-fa9f-4f1e-881a-b36b469a0c34]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:30:52 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-28e704a0-443d-4b6b-a543-e1962d6e9493 tempest-VolumesGetTest-459511347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-8f6dbfde-dffc-40b7-b0e2-6ebb7a9422df {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:52 devstack sudo[105923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.52b854a3-d1e9-4398-ac4b-9492685b70d0 Aug 26 14:30:52 devstack sudo[105923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:52 devstack sudo[105924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-8f6dbfde-dffc-40b7-b0e2-6ebb7a9422df Aug 26 14:30:52 devstack sudo[105924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:52 devstack sudo[105921]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:52 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-22890a34-23f3-4421-bbbf-34f07704a82b tempest-VolumesListAdminTestJSON-228051891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b4f6f2c9-69db-4c4e-881d-ddeb0ef56424" returned: 0 in 0.283s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:52 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-22890a34-23f3-4421-bbbf-34f07704a82b tempest-VolumesListAdminTestJSON-228051891 None] <== create_volume: return (978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:30:52 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-22890a34-23f3-4421-bbbf-34f07704a82b tempest-VolumesListAdminTestJSON-228051891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.983s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:30:52 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-34a2c5f3-9c9a-4e96-b8ad-97a94fc6ecbd tempest-VolumesActionsTest-1373378216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.325s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:30:52 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-34a2c5f3-9c9a-4e96-b8ad-97a94fc6ecbd tempest-VolumesActionsTest-1373378216 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:30:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-706346931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=769b1fcf-df65-43df-a84e-9624e84e9bf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a11b7a401854fb7b7a48f3a74477608',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:30:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:30:52Z,use_quota=True,user_id='0fce4e8e94ca4567a7acaf545b4f744f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:30:52 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-34a2c5f3-9c9a-4e96-b8ad-97a94fc6ecbd tempest-VolumesActionsTest-1373378216 None] Creating volume 769b1fcf-df65-43df-a84e-9624e84e9bf1 {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:30:52 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-34a2c5f3-9c9a-4e96-b8ad-97a94fc6ecbd tempest-VolumesActionsTest-1373378216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:30:52 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-34a2c5f3-9c9a-4e96-b8ad-97a94fc6ecbd tempest-VolumesActionsTest-1373378216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:30:52 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-34a2c5f3-9c9a-4e96-b8ad-97a94fc6ecbd tempest-VolumesActionsTest-1373378216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:30:52 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-34a2c5f3-9c9a-4e96-b8ad-97a94fc6ecbd tempest-VolumesActionsTest-1373378216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:30:52 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-34a2c5f3-9c9a-4e96-b8ad-97a94fc6ecbd tempest-VolumesActionsTest-1373378216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:30:52 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-34a2c5f3-9c9a-4e96-b8ad-97a94fc6ecbd tempest-VolumesActionsTest-1373378216 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:30:52 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-34a2c5f3-9c9a-4e96-b8ad-97a94fc6ecbd tempest-VolumesActionsTest-1373378216 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:30:52 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-34a2c5f3-9c9a-4e96-b8ad-97a94fc6ecbd tempest-VolumesActionsTest-1373378216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-769b1fcf-df65-43df-a84e-9624e84e9bf1 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:52 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-22890a34-23f3-4421-bbbf-34f07704a82b tempest-VolumesListAdminTestJSON-228051891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (005570a8-4a9b-427b-a20e-5b316fec0cf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4f6f2c9-69db-4c4e-881d-ddeb0ef56424', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:30:52 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-22890a34-23f3-4421-bbbf-34f07704a82b tempest-VolumesListAdminTestJSON-228051891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92e43411-21c7-45c0-bc34-3956c1261036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:30:52 devstack sudo[105930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-769b1fcf-df65-43df-a84e-9624e84e9bf1 1073741824 Aug 26 14:30:52 devstack sudo[105930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:52 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-22890a34-23f3-4421-bbbf-34f07704a82b tempest-VolumesListAdminTestJSON-228051891 None] Volume volume-b4f6f2c9-69db-4c4e-881d-ddeb0ef56424 (b4f6f2c9-69db-4c4e-881d-ddeb0ef56424): created successfully Aug 26 14:30:52 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-22890a34-23f3-4421-bbbf-34f07704a82b tempest-VolumesListAdminTestJSON-228051891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92e43411-21c7-45c0-bc34-3956c1261036) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:30:52 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-22890a34-23f3-4421-bbbf-34f07704a82b tempest-VolumesListAdminTestJSON-228051891 None] Flow 'volume_create_manager' (b9bcc7d0-e754-4505-b03b-8c5eadbf645e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:30:52 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-22890a34-23f3-4421-bbbf-34f07704a82b tempest-VolumesListAdminTestJSON-228051891 None] Created volume successfully. Aug 26 14:30:52 devstack sudo[105923]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:52 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-50329a6b-6d6c-42ac-9526-44ff1287257c tempest-SnapshotsActionsTest-642613075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.52b854a3-d1e9-4398-ac4b-9492685b70d0" returned: 0 in 0.421s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:52 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-50329a6b-6d6c-42ac-9526-44ff1287257c tempest-SnapshotsActionsTest-642613075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.52b854a3-d1e9-4398-ac4b-9492685b70d0 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:53 devstack sudo[105924]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:53 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-28e704a0-443d-4b6b-a543-e1962d6e9493 tempest-VolumesGetTest-459511347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-8f6dbfde-dffc-40b7-b0e2-6ebb7a9422df" returned: 0 in 0.420s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:53 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-28e704a0-443d-4b6b-a543-e1962d6e9493 tempest-VolumesGetTest-459511347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-8f6dbfde-dffc-40b7-b0e2-6ebb7a9422df {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:53 devstack sudo[105937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.52b854a3-d1e9-4398-ac4b-9492685b70d0 Aug 26 14:30:53 devstack sudo[105937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:53 devstack sudo[105938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-8f6dbfde-dffc-40b7-b0e2-6ebb7a9422df Aug 26 14:30:53 devstack sudo[105938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:53 devstack sudo[105930]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:53 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-34a2c5f3-9c9a-4e96-b8ad-97a94fc6ecbd tempest-VolumesActionsTest-1373378216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-769b1fcf-df65-43df-a84e-9624e84e9bf1 1073741824" returned: 0 in 0.430s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:53 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-34a2c5f3-9c9a-4e96-b8ad-97a94fc6ecbd tempest-VolumesActionsTest-1373378216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-769b1fcf-df65-43df-a84e-9624e84e9bf1 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:53 devstack sudo[105938]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:53 devstack sudo[105947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-769b1fcf-df65-43df-a84e-9624e84e9bf1 Aug 26 14:30:53 devstack sudo[105947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:53 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-28e704a0-443d-4b6b-a543-e1962d6e9493 tempest-VolumesGetTest-459511347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-8f6dbfde-dffc-40b7-b0e2-6ebb7a9422df" returned: 0 in 0.311s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:53 devstack sudo[105937]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:53 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-50329a6b-6d6c-42ac-9526-44ff1287257c tempest-SnapshotsActionsTest-642613075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.52b854a3-d1e9-4398-ac4b-9492685b70d0" returned: 0 in 0.337s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:53 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-28e704a0-443d-4b6b-a543-e1962d6e9493 tempest-VolumesGetTest-459511347 None] Lock "cinder-quobyte-8f6dbfde-dffc-40b7-b0e2-6ebb7a9422df" released by "delete_volume" :: held 0.806s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:30:53 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-50329a6b-6d6c-42ac-9526-44ff1287257c tempest-SnapshotsActionsTest-642613075 None] Lock "cinder-quobyte-52b854a3-d1e9-4398-ac4b-9492685b70d0" released by "_delete_snapshot" :: held 1.826s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:30:53 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-50329a6b-6d6c-42ac-9526-44ff1287257c tempest-SnapshotsActionsTest-642613075 None] Lock "cinder-quobyte-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943" released by "delete_snapshot" :: held 1.859s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:30:53 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-28e704a0-443d-4b6b-a543-e1962d6e9493 tempest-VolumesGetTest-459511347 None] Created reservations ['b744c6d9-7f59-4a51-81a7-19ad71e7415f', 'ac4697cf-695e-4b39-8279-40bb0807a9ea', '75d6920b-c3e9-453a-abc3-74f8e430ad68', '228d0618-4247-4073-93b0-c19de1d8e7b2'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:30:53 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-50329a6b-6d6c-42ac-9526-44ff1287257c tempest-SnapshotsActionsTest-642613075 None] Created reservations ['acb51f72-428a-41ea-8ae8-8cd1e0914556', 'c3d8f56f-695b-418f-851f-b90df0ef4b50', 'a0af3333-8985-4e17-8872-43ff6af2e755', 'f4b6df7e-34ef-48a1-b143-0a9ab9a533a2'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:30:53 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-28e704a0-443d-4b6b-a543-e1962d6e9493 tempest-VolumesGetTest-459511347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:30:53 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-28e704a0-443d-4b6b-a543-e1962d6e9493 tempest-VolumesGetTest-459511347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:30:53 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-28e704a0-443d-4b6b-a543-e1962d6e9493 tempest-VolumesGetTest-459511347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:30:53 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-28e704a0-443d-4b6b-a543-e1962d6e9493 tempest-VolumesGetTest-459511347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:30:53 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-28e704a0-443d-4b6b-a543-e1962d6e9493 tempest-VolumesGetTest-459511347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:30:53 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-28e704a0-443d-4b6b-a543-e1962d6e9493 tempest-VolumesGetTest-459511347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:53 devstack sudo[105947]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:53 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-34a2c5f3-9c9a-4e96-b8ad-97a94fc6ecbd tempest-VolumesActionsTest-1373378216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-769b1fcf-df65-43df-a84e-9624e84e9bf1" returned: 0 in 0.296s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:53 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-34a2c5f3-9c9a-4e96-b8ad-97a94fc6ecbd tempest-VolumesActionsTest-1373378216 None] <== create_volume: return (776ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:30:53 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-34a2c5f3-9c9a-4e96-b8ad-97a94fc6ecbd tempest-VolumesActionsTest-1373378216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.779s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:30:53 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-50329a6b-6d6c-42ac-9526-44ff1287257c tempest-SnapshotsActionsTest-642613075 None] Delete snapshot completed successfully. Aug 26 14:30:53 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-34a2c5f3-9c9a-4e96-b8ad-97a94fc6ecbd tempest-VolumesActionsTest-1373378216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b11bb3d1-aa0c-45c7-ae3e-b8355dee5d7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-769b1fcf-df65-43df-a84e-9624e84e9bf1', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:30:53 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-34a2c5f3-9c9a-4e96-b8ad-97a94fc6ecbd tempest-VolumesActionsTest-1373378216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a9f127a-a6e1-44e5-9934-d97371bf71b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:30:53 devstack sudo[105950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:30:53 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-50329a6b-6d6c-42ac-9526-44ff1287257c tempest-SnapshotsActionsTest-642613075 None] Lock "cinder-52b854a3-d1e9-4398-ac4b-9492685b70d0-delete_snapshot" released by "delete_snapshot" :: held 2.133s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:30:53 devstack sudo[105950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:53 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-34a2c5f3-9c9a-4e96-b8ad-97a94fc6ecbd tempest-VolumesActionsTest-1373378216 None] Volume volume-769b1fcf-df65-43df-a84e-9624e84e9bf1 (769b1fcf-df65-43df-a84e-9624e84e9bf1): created successfully Aug 26 14:30:53 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-34a2c5f3-9c9a-4e96-b8ad-97a94fc6ecbd tempest-VolumesActionsTest-1373378216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a9f127a-a6e1-44e5-9934-d97371bf71b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:30:53 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-34a2c5f3-9c9a-4e96-b8ad-97a94fc6ecbd tempest-VolumesActionsTest-1373378216 None] Flow 'volume_create_manager' (f28d8a5c-478e-4555-83f0-df4b766a478c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:30:53 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-34a2c5f3-9c9a-4e96-b8ad-97a94fc6ecbd tempest-VolumesActionsTest-1373378216 None] Created volume successfully. Aug 26 14:30:53 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-e22783df-ecf5-473a-a178-af6076b56dd9 tempest-VolumesGetTest-459511347 None] Acquiring lock "cinder-b625232f-8f11-4d70-b523-cce355a45ca4-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:30:53 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-e22783df-ecf5-473a-a178-af6076b56dd9 tempest-VolumesGetTest-459511347 None] Lock "cinder-b625232f-8f11-4d70-b523-cce355a45ca4-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:30:53 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-e22783df-ecf5-473a-a178-af6076b56dd9 tempest-VolumesGetTest-459511347 None] Acquiring lock "cinder-quobyte-b625232f-8f11-4d70-b523-cce355a45ca4" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:30:53 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-e22783df-ecf5-473a-a178-af6076b56dd9 tempest-VolumesGetTest-459511347 None] Lock "cinder-quobyte-b625232f-8f11-4d70-b523-cce355a45ca4" acquired by "delete_volume" :: waited 0.036s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:30:53 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[c77d144b-5bbb-4462-be5b-d70c83045a53]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:30:53 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e22783df-ecf5-473a-a178-af6076b56dd9 tempest-VolumesGetTest-459511347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b625232f-8f11-4d70-b523-cce355a45ca4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:53 devstack sudo[105950]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:53 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-28e704a0-443d-4b6b-a543-e1962d6e9493 tempest-VolumesGetTest-459511347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.409s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:53 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-28e704a0-443d-4b6b-a543-e1962d6e9493 tempest-VolumesGetTest-459511347 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:30:53 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-28e704a0-443d-4b6b-a543-e1962d6e9493 tempest-VolumesGetTest-459511347 None] Deleted volume successfully. Aug 26 14:30:53 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-28e704a0-443d-4b6b-a543-e1962d6e9493 tempest-VolumesGetTest-459511347 None] Lock "cinder-8f6dbfde-dffc-40b7-b0e2-6ebb7a9422df-delete_volume" released by "delete_volume" :: held 1.512s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:30:54 devstack sudo[105953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b625232f-8f11-4d70-b523-cce355a45ca4 Aug 26 14:30:54 devstack sudo[105953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:54 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-14813430-7ffe-4197-81e5-2137d166966f tempest-VolumesListAdminTestJSON-2134514732 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:30:54 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-14813430-7ffe-4197-81e5-2137d166966f tempest-VolumesListAdminTestJSON-2134514732 None] Flow 'volume_create_manager' (7fd88b6d-1fbe-43a0-a466-e31d6cbf5687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:30:54 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-14813430-7ffe-4197-81e5-2137d166966f tempest-VolumesListAdminTestJSON-2134514732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a13d0460-bc5b-4ae7-bf9a-321ad95dff50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:30:54 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-14813430-7ffe-4197-81e5-2137d166966f tempest-VolumesListAdminTestJSON-2134514732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a13d0460-bc5b-4ae7-bf9a-321ad95dff50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:30:54Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebbf53d2-8329-42a5-93c4-446eeb3bfc44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ca97d2b56394f168c92d77d0cf96d8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:30:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:30:54Z,use_quota=True,user_id='57a324923d684a98be328f63bf0df243',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:30:54 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-14813430-7ffe-4197-81e5-2137d166966f tempest-VolumesListAdminTestJSON-2134514732 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (062fa128-d5a7-49bd-8e03-0cb0e7f04c8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:30:54 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-14813430-7ffe-4197-81e5-2137d166966f tempest-VolumesListAdminTestJSON-2134514732 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (062fa128-d5a7-49bd-8e03-0cb0e7f04c8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:30:54 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-14813430-7ffe-4197-81e5-2137d166966f tempest-VolumesListAdminTestJSON-2134514732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0f9b25f-a43d-471d-b276-bb46073b2bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:30:54 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-14813430-7ffe-4197-81e5-2137d166966f tempest-VolumesListAdminTestJSON-2134514732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0f9b25f-a43d-471d-b276-bb46073b2bc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebbf53d2-8329-42a5-93c4-446eeb3bfc44', 'volume_name': 'volume-ebbf53d2-8329-42a5-93c4-446eeb3bfc44', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:30:54 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-14813430-7ffe-4197-81e5-2137d166966f tempest-VolumesListAdminTestJSON-2134514732 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ada33af-c748-4328-bc3f-9fe2a3dbc320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:30:54 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-14813430-7ffe-4197-81e5-2137d166966f tempest-VolumesListAdminTestJSON-2134514732 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ada33af-c748-4328-bc3f-9fe2a3dbc320) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:30:54 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-14813430-7ffe-4197-81e5-2137d166966f tempest-VolumesListAdminTestJSON-2134514732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f67c5b8-4b70-455e-9435-476103baffa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:30:54 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-14813430-7ffe-4197-81e5-2137d166966f tempest-VolumesListAdminTestJSON-2134514732 None] Volume ebbf53d2-8329-42a5-93c4-446eeb3bfc44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebbf53d2-8329-42a5-93c4-446eeb3bfc44', 'volume_size': 1} Aug 26 14:30:54 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-14813430-7ffe-4197-81e5-2137d166966f tempest-VolumesListAdminTestJSON-2134514732 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:30:54 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-14813430-7ffe-4197-81e5-2137d166966f tempest-VolumesListAdminTestJSON-2134514732 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:30:54 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-14813430-7ffe-4197-81e5-2137d166966f tempest-VolumesListAdminTestJSON-2134514732 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:30:54Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebbf53d2-8329-42a5-93c4-446eeb3bfc44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ca97d2b56394f168c92d77d0cf96d8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:30:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:30:54Z,use_quota=True,user_id='57a324923d684a98be328f63bf0df243',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:30:54 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-14813430-7ffe-4197-81e5-2137d166966f tempest-VolumesListAdminTestJSON-2134514732 None] Creating volume ebbf53d2-8329-42a5-93c4-446eeb3bfc44 {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:30:54 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-14813430-7ffe-4197-81e5-2137d166966f tempest-VolumesListAdminTestJSON-2134514732 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:30:54 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-14813430-7ffe-4197-81e5-2137d166966f tempest-VolumesListAdminTestJSON-2134514732 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:30:54 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-14813430-7ffe-4197-81e5-2137d166966f tempest-VolumesListAdminTestJSON-2134514732 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:30:54 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-14813430-7ffe-4197-81e5-2137d166966f tempest-VolumesListAdminTestJSON-2134514732 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:30:54 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-14813430-7ffe-4197-81e5-2137d166966f tempest-VolumesListAdminTestJSON-2134514732 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:30:54 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-14813430-7ffe-4197-81e5-2137d166966f tempest-VolumesListAdminTestJSON-2134514732 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:30:54 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-14813430-7ffe-4197-81e5-2137d166966f tempest-VolumesListAdminTestJSON-2134514732 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:30:54 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-14813430-7ffe-4197-81e5-2137d166966f tempest-VolumesListAdminTestJSON-2134514732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ebbf53d2-8329-42a5-93c4-446eeb3bfc44 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:54 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-d2341d5f-0b6f-457e-84eb-f629bba0bc56 tempest-SnapshotsActionsTest-695899691 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:30:54 devstack sudo[105955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ebbf53d2-8329-42a5-93c4-446eeb3bfc44 1073741824 Aug 26 14:30:54 devstack sudo[105955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:54 devstack sudo[105953]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:54 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e22783df-ecf5-473a-a178-af6076b56dd9 tempest-VolumesGetTest-459511347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b625232f-8f11-4d70-b523-cce355a45ca4" returned: 0 in 0.470s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:54 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e22783df-ecf5-473a-a178-af6076b56dd9 tempest-VolumesGetTest-459511347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b625232f-8f11-4d70-b523-cce355a45ca4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:54 devstack sudo[105960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b625232f-8f11-4d70-b523-cce355a45ca4 Aug 26 14:30:54 devstack sudo[105960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:54 devstack sudo[105960]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:54 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e22783df-ecf5-473a-a178-af6076b56dd9 tempest-VolumesGetTest-459511347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b625232f-8f11-4d70-b523-cce355a45ca4" returned: 0 in 0.278s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:54 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-e22783df-ecf5-473a-a178-af6076b56dd9 tempest-VolumesGetTest-459511347 None] Lock "cinder-quobyte-b625232f-8f11-4d70-b523-cce355a45ca4" released by "delete_volume" :: held 0.809s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:30:54 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-e22783df-ecf5-473a-a178-af6076b56dd9 tempest-VolumesGetTest-459511347 None] Created reservations ['5d6093f8-1454-4e29-9137-31b4821bd8d5', '89728a6e-0079-4e1a-9d69-7239a70e06f8', '6a472610-7287-479b-954c-8674cbca710c', '12f033a5-38ff-4b25-b00d-b793b8505a1d'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:30:54 devstack sudo[105955]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:54 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-14813430-7ffe-4197-81e5-2137d166966f tempest-VolumesListAdminTestJSON-2134514732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ebbf53d2-8329-42a5-93c4-446eeb3bfc44 1073741824" returned: 0 in 0.480s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:54 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-14813430-7ffe-4197-81e5-2137d166966f tempest-VolumesListAdminTestJSON-2134514732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ebbf53d2-8329-42a5-93c4-446eeb3bfc44 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:54 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e22783df-ecf5-473a-a178-af6076b56dd9 tempest-VolumesGetTest-459511347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:30:54 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e22783df-ecf5-473a-a178-af6076b56dd9 tempest-VolumesGetTest-459511347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:30:54 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-e22783df-ecf5-473a-a178-af6076b56dd9 tempest-VolumesGetTest-459511347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:30:54 devstack sudo[105967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ebbf53d2-8329-42a5-93c4-446eeb3bfc44 Aug 26 14:30:54 devstack sudo[105967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:54 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-e22783df-ecf5-473a-a178-af6076b56dd9 tempest-VolumesGetTest-459511347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:30:54 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e22783df-ecf5-473a-a178-af6076b56dd9 tempest-VolumesGetTest-459511347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:30:54 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e22783df-ecf5-473a-a178-af6076b56dd9 tempest-VolumesGetTest-459511347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:54 devstack sudo[105969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:30:54 devstack sudo[105969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:55 devstack sudo[105967]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:55 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-14813430-7ffe-4197-81e5-2137d166966f tempest-VolumesListAdminTestJSON-2134514732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ebbf53d2-8329-42a5-93c4-446eeb3bfc44" returned: 0 in 0.297s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:55 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-14813430-7ffe-4197-81e5-2137d166966f tempest-VolumesListAdminTestJSON-2134514732 None] <== create_volume: return (828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:30:55 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-14813430-7ffe-4197-81e5-2137d166966f tempest-VolumesListAdminTestJSON-2134514732 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.831s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:30:55 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-d2341d5f-0b6f-457e-84eb-f629bba0bc56 tempest-SnapshotsActionsTest-695899691 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.803s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:30:55 devstack sudo[105969]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:55 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e22783df-ecf5-473a-a178-af6076b56dd9 tempest-VolumesGetTest-459511347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.284s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:55 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-e22783df-ecf5-473a-a178-af6076b56dd9 tempest-VolumesGetTest-459511347 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:30:55 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-14813430-7ffe-4197-81e5-2137d166966f tempest-VolumesListAdminTestJSON-2134514732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f67c5b8-4b70-455e-9435-476103baffa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebbf53d2-8329-42a5-93c4-446eeb3bfc44', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:30:55 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-14813430-7ffe-4197-81e5-2137d166966f tempest-VolumesListAdminTestJSON-2134514732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3b25dc3-f0c8-490a-b2d9-d3f5fa540e11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:30:55 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-d2341d5f-0b6f-457e-84eb-f629bba0bc56 tempest-SnapshotsActionsTest-695899691 None] Creating offline snapshot 93dc10de-eadf-41ce-86e1-2c1a0405a6dc of volume 4fb30b4d-fd01-4922-b4e3-7bb6dfb45943 {{(pid=94394) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 14:30:55 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-e22783df-ecf5-473a-a178-af6076b56dd9 tempest-VolumesGetTest-459511347 None] Deleted volume successfully. Aug 26 14:30:55 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-a27b188d-eaa2-4595-bdca-4956c6a56cd1 tempest-VolumesGetTest-459511347 None] Acquiring lock "cinder-76dd1101-ba41-492a-b48b-ee21fc5fe5aa-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:30:55 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebe66c0d-5a94-428a-9f70-630198764d13]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:30:55 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-d2341d5f-0b6f-457e-84eb-f629bba0bc56 tempest-SnapshotsActionsTest-695899691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.9a2cb941-51f1-4661-b104-c9713dced550 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:55 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-14813430-7ffe-4197-81e5-2137d166966f tempest-VolumesListAdminTestJSON-2134514732 None] Volume volume-ebbf53d2-8329-42a5-93c4-446eeb3bfc44 (ebbf53d2-8329-42a5-93c4-446eeb3bfc44): created successfully Aug 26 14:30:55 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-14813430-7ffe-4197-81e5-2137d166966f tempest-VolumesListAdminTestJSON-2134514732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3b25dc3-f0c8-490a-b2d9-d3f5fa540e11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:30:55 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-14813430-7ffe-4197-81e5-2137d166966f tempest-VolumesListAdminTestJSON-2134514732 None] Flow 'volume_create_manager' (7fd88b6d-1fbe-43a0-a466-e31d6cbf5687) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:30:55 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-a27b188d-eaa2-4595-bdca-4956c6a56cd1 tempest-VolumesGetTest-459511347 None] Lock "cinder-76dd1101-ba41-492a-b48b-ee21fc5fe5aa-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:30:55 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-14813430-7ffe-4197-81e5-2137d166966f tempest-VolumesListAdminTestJSON-2134514732 None] Created volume successfully. Aug 26 14:30:55 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-e22783df-ecf5-473a-a178-af6076b56dd9 tempest-VolumesGetTest-459511347 None] Lock "cinder-b625232f-8f11-4d70-b523-cce355a45ca4-delete_volume" released by "delete_volume" :: held 1.499s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:30:55 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-a27b188d-eaa2-4595-bdca-4956c6a56cd1 tempest-VolumesGetTest-459511347 None] Acquiring lock "cinder-quobyte-76dd1101-ba41-492a-b48b-ee21fc5fe5aa" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:30:55 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-a27b188d-eaa2-4595-bdca-4956c6a56cd1 tempest-VolumesGetTest-459511347 None] Lock "cinder-quobyte-76dd1101-ba41-492a-b48b-ee21fc5fe5aa" acquired by "delete_volume" :: waited 0.017s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:30:55 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[b781cbe8-b3ee-46c0-97a7-7d13e1e58d81]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:30:55 devstack sudo[105974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.9a2cb941-51f1-4661-b104-c9713dced550 Aug 26 14:30:55 devstack sudo[105974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:55 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-a27b188d-eaa2-4595-bdca-4956c6a56cd1 tempest-VolumesGetTest-459511347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-76dd1101-ba41-492a-b48b-ee21fc5fe5aa {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:55 devstack sudo[105978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-76dd1101-ba41-492a-b48b-ee21fc5fe5aa Aug 26 14:30:55 devstack sudo[105978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:55 devstack sudo[105974]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:55 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-d2341d5f-0b6f-457e-84eb-f629bba0bc56 tempest-SnapshotsActionsTest-695899691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.9a2cb941-51f1-4661-b104-c9713dced550" returned: 0 in 0.481s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:55 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-d2341d5f-0b6f-457e-84eb-f629bba0bc56 tempest-SnapshotsActionsTest-695899691 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94394) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 14:30:55 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-d2341d5f-0b6f-457e-84eb-f629bba0bc56 tempest-SnapshotsActionsTest-695899691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.9a2cb941-51f1-4661-b104-c9713dced550,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.93dc10de-eadf-41ce-86e1-2c1a0405a6dc 1G {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:55 devstack sudo[105983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.9a2cb941-51f1-4661-b104-c9713dced550,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.93dc10de-eadf-41ce-86e1-2c1a0405a6dc 1G Aug 26 14:30:55 devstack sudo[105983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:55 devstack sudo[105978]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:55 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-a27b188d-eaa2-4595-bdca-4956c6a56cd1 tempest-VolumesGetTest-459511347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-76dd1101-ba41-492a-b48b-ee21fc5fe5aa" returned: 0 in 0.412s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:55 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-a27b188d-eaa2-4595-bdca-4956c6a56cd1 tempest-VolumesGetTest-459511347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-76dd1101-ba41-492a-b48b-ee21fc5fe5aa {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:55 devstack sudo[105989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-76dd1101-ba41-492a-b48b-ee21fc5fe5aa Aug 26 14:30:55 devstack sudo[105989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:56 devstack sudo[105989]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:56 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-a27b188d-eaa2-4595-bdca-4956c6a56cd1 tempest-VolumesGetTest-459511347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-76dd1101-ba41-492a-b48b-ee21fc5fe5aa" returned: 0 in 0.303s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:56 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-a27b188d-eaa2-4595-bdca-4956c6a56cd1 tempest-VolumesGetTest-459511347 None] Lock "cinder-quobyte-76dd1101-ba41-492a-b48b-ee21fc5fe5aa" released by "delete_volume" :: held 0.801s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:30:56 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-a27b188d-eaa2-4595-bdca-4956c6a56cd1 tempest-VolumesGetTest-459511347 None] Created reservations ['6b312dd0-e850-49f3-9836-977c6f62c746', '9e7a8fcf-2d94-43a0-8d72-4148e2f09bdf', '9b6a8440-94c7-48da-ad51-79ecf92c4565', '2711d31f-d4f1-435a-9598-35ba95fff966'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:30:56 devstack sudo[105983]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:56 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-d2341d5f-0b6f-457e-84eb-f629bba0bc56 tempest-SnapshotsActionsTest-695899691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.9a2cb941-51f1-4661-b104-c9713dced550,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.93dc10de-eadf-41ce-86e1-2c1a0405a6dc 1G" returned: 0 in 0.555s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:56 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-d2341d5f-0b6f-457e-84eb-f629bba0bc56 tempest-SnapshotsActionsTest-695899691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.9a2cb941-51f1-4661-b104-c9713dced550 -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.93dc10de-eadf-41ce-86e1-2c1a0405a6dc {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:56 devstack sudo[105996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.9a2cb941-51f1-4661-b104-c9713dced550 -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.93dc10de-eadf-41ce-86e1-2c1a0405a6dc Aug 26 14:30:56 devstack sudo[105996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:56 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-a27b188d-eaa2-4595-bdca-4956c6a56cd1 tempest-VolumesGetTest-459511347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:30:56 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-a27b188d-eaa2-4595-bdca-4956c6a56cd1 tempest-VolumesGetTest-459511347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:30:56 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-a27b188d-eaa2-4595-bdca-4956c6a56cd1 tempest-VolumesGetTest-459511347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:30:56 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-a27b188d-eaa2-4595-bdca-4956c6a56cd1 tempest-VolumesGetTest-459511347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:30:56 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-a27b188d-eaa2-4595-bdca-4956c6a56cd1 tempest-VolumesGetTest-459511347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:30:56 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-a27b188d-eaa2-4595-bdca-4956c6a56cd1 tempest-VolumesGetTest-459511347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:56 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-4997a207-3ce0-4e7f-9721-f077612a79d8 tempest-VolumesListAdminTestJSON-2134514732 None] Acquiring lock "cinder-ebbf53d2-8329-42a5-93c4-446eeb3bfc44-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:30:56 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-4997a207-3ce0-4e7f-9721-f077612a79d8 tempest-VolumesListAdminTestJSON-2134514732 None] Lock "cinder-ebbf53d2-8329-42a5-93c4-446eeb3bfc44-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:30:56 devstack sudo[105998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:30:56 devstack sudo[105998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:56 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-4997a207-3ce0-4e7f-9721-f077612a79d8 tempest-VolumesListAdminTestJSON-2134514732 None] Acquiring lock "cinder-quobyte-ebbf53d2-8329-42a5-93c4-446eeb3bfc44" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:30:56 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-4997a207-3ce0-4e7f-9721-f077612a79d8 tempest-VolumesListAdminTestJSON-2134514732 None] Lock "cinder-quobyte-ebbf53d2-8329-42a5-93c4-446eeb3bfc44" acquired by "delete_volume" :: waited 0.026s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:30:56 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[14ddfa72-76eb-4aff-932d-33a9e78e1da7]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:30:56 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4997a207-3ce0-4e7f-9721-f077612a79d8 tempest-VolumesListAdminTestJSON-2134514732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ebbf53d2-8329-42a5-93c4-446eeb3bfc44 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:56 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-60d86657-4e09-4259-9f38-05cf52780cb0 tempest-VolumesListAdminTestJSON-228051891 None] Acquiring lock "cinder-b4f6f2c9-69db-4c4e-881d-ddeb0ef56424-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:30:56 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-60d86657-4e09-4259-9f38-05cf52780cb0 tempest-VolumesListAdminTestJSON-228051891 None] Lock "cinder-b4f6f2c9-69db-4c4e-881d-ddeb0ef56424-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:30:56 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-60d86657-4e09-4259-9f38-05cf52780cb0 tempest-VolumesListAdminTestJSON-228051891 None] Acquiring lock "cinder-quobyte-b4f6f2c9-69db-4c4e-881d-ddeb0ef56424" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:30:56 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-60d86657-4e09-4259-9f38-05cf52780cb0 tempest-VolumesListAdminTestJSON-228051891 None] Lock "cinder-quobyte-b4f6f2c9-69db-4c4e-881d-ddeb0ef56424" acquired by "delete_volume" :: waited 0.039s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:30:56 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[04c9fdb8-b985-41e1-a5d7-38bf40088531]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:30:56 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-60d86657-4e09-4259-9f38-05cf52780cb0 tempest-VolumesListAdminTestJSON-228051891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b4f6f2c9-69db-4c4e-881d-ddeb0ef56424 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:56 devstack sudo[106000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ebbf53d2-8329-42a5-93c4-446eeb3bfc44 Aug 26 14:30:56 devstack sudo[106000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:56 devstack sudo[105996]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:56 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-d2341d5f-0b6f-457e-84eb-f629bba0bc56 tempest-SnapshotsActionsTest-695899691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.9a2cb941-51f1-4661-b104-c9713dced550 -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.93dc10de-eadf-41ce-86e1-2c1a0405a6dc" returned: 0 in 0.653s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:56 devstack cinder-volume[94394]: WARNING cinder.volume.drivers.remotefs [None req-d2341d5f-0b6f-457e-84eb-f629bba0bc56 tempest-SnapshotsActionsTest-695899691 None] /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.93dc10de-eadf-41ce-86e1-2c1a0405a6dc is being set with open permissions: ugo+rw Aug 26 14:30:56 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-d2341d5f-0b6f-457e-84eb-f629bba0bc56 tempest-SnapshotsActionsTest-695899691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.93dc10de-eadf-41ce-86e1-2c1a0405a6dc {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:56 devstack sudo[105998]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:56 devstack sudo[106008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.93dc10de-eadf-41ce-86e1-2c1a0405a6dc Aug 26 14:30:56 devstack sudo[106008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:56 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-a27b188d-eaa2-4595-bdca-4956c6a56cd1 tempest-VolumesGetTest-459511347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.628s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:56 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-a27b188d-eaa2-4595-bdca-4956c6a56cd1 tempest-VolumesGetTest-459511347 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:30:56 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-a27b188d-eaa2-4595-bdca-4956c6a56cd1 tempest-VolumesGetTest-459511347 None] Deleted volume successfully. Aug 26 14:30:56 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-a27b188d-eaa2-4595-bdca-4956c6a56cd1 tempest-VolumesGetTest-459511347 None] Lock "cinder-76dd1101-ba41-492a-b48b-ee21fc5fe5aa-delete_volume" released by "delete_volume" :: held 1.781s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:30:57 devstack sudo[106005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b4f6f2c9-69db-4c4e-881d-ddeb0ef56424 Aug 26 14:30:57 devstack sudo[106005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:57 devstack sudo[106000]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:57 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4997a207-3ce0-4e7f-9721-f077612a79d8 tempest-VolumesListAdminTestJSON-2134514732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ebbf53d2-8329-42a5-93c4-446eeb3bfc44" returned: 0 in 0.719s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:57 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4997a207-3ce0-4e7f-9721-f077612a79d8 tempest-VolumesListAdminTestJSON-2134514732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ebbf53d2-8329-42a5-93c4-446eeb3bfc44 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:57 devstack sudo[106015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ebbf53d2-8329-42a5-93c4-446eeb3bfc44 Aug 26 14:30:57 devstack sudo[106015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:57 devstack sudo[106008]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:57 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-d2341d5f-0b6f-457e-84eb-f629bba0bc56 tempest-SnapshotsActionsTest-695899691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.93dc10de-eadf-41ce-86e1-2c1a0405a6dc" returned: 0 in 0.535s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:57 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-d2341d5f-0b6f-457e-84eb-f629bba0bc56 tempest-SnapshotsActionsTest-695899691 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.387s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:30:57 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-d2341d5f-0b6f-457e-84eb-f629bba0bc56 tempest-SnapshotsActionsTest-695899691 None] Create snapshot completed successfully Aug 26 14:30:57 devstack sudo[106005]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:57 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-60d86657-4e09-4259-9f38-05cf52780cb0 tempest-VolumesListAdminTestJSON-228051891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b4f6f2c9-69db-4c4e-881d-ddeb0ef56424" returned: 0 in 0.750s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:57 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-60d86657-4e09-4259-9f38-05cf52780cb0 tempest-VolumesListAdminTestJSON-228051891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b4f6f2c9-69db-4c4e-881d-ddeb0ef56424 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:57 devstack sudo[106026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b4f6f2c9-69db-4c4e-881d-ddeb0ef56424 Aug 26 14:30:57 devstack sudo[106026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:57 devstack sudo[106015]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:57 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4997a207-3ce0-4e7f-9721-f077612a79d8 tempest-VolumesListAdminTestJSON-2134514732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ebbf53d2-8329-42a5-93c4-446eeb3bfc44" returned: 0 in 0.611s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:57 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-4997a207-3ce0-4e7f-9721-f077612a79d8 tempest-VolumesListAdminTestJSON-2134514732 None] Lock "cinder-quobyte-ebbf53d2-8329-42a5-93c4-446eeb3bfc44" released by "delete_volume" :: held 1.448s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:30:58 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-4997a207-3ce0-4e7f-9721-f077612a79d8 tempest-VolumesListAdminTestJSON-2134514732 None] Created reservations ['6142a0b8-cdc5-450d-a9b5-319287d8f91c', 'bc44d5f6-3bcd-460a-89b9-ff870157504e', '641a0852-40b1-4e52-8d7f-e9dfe01d56fc', '76778658-1da5-443c-aea4-c2f1befa0128'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:30:58 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-4997a207-3ce0-4e7f-9721-f077612a79d8 tempest-VolumesListAdminTestJSON-2134514732 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:30:58 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-4997a207-3ce0-4e7f-9721-f077612a79d8 tempest-VolumesListAdminTestJSON-2134514732 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:30:58 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-4997a207-3ce0-4e7f-9721-f077612a79d8 tempest-VolumesListAdminTestJSON-2134514732 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:30:58 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-4997a207-3ce0-4e7f-9721-f077612a79d8 tempest-VolumesListAdminTestJSON-2134514732 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:30:58 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-4997a207-3ce0-4e7f-9721-f077612a79d8 tempest-VolumesListAdminTestJSON-2134514732 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:30:58 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4997a207-3ce0-4e7f-9721-f077612a79d8 tempest-VolumesListAdminTestJSON-2134514732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:58 devstack sudo[106026]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:58 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-60d86657-4e09-4259-9f38-05cf52780cb0 tempest-VolumesListAdminTestJSON-228051891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b4f6f2c9-69db-4c4e-881d-ddeb0ef56424" returned: 0 in 0.637s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:58 devstack sudo[106037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:30:58 devstack sudo[106037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:58 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-60d86657-4e09-4259-9f38-05cf52780cb0 tempest-VolumesListAdminTestJSON-228051891 None] Lock "cinder-quobyte-b4f6f2c9-69db-4c4e-881d-ddeb0ef56424" released by "delete_volume" :: held 1.478s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:30:58 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-60d86657-4e09-4259-9f38-05cf52780cb0 tempest-VolumesListAdminTestJSON-228051891 None] Created reservations ['cca42d27-80f4-47ed-ada5-451009a99ac6', '8bfac448-72b6-4e1e-978c-e0504184e711', 'e915e3b8-7e69-4d78-9652-56d4d5dfda23', '11a4a658-7d4b-4a7f-adcd-48e82a602d44'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:30:58 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-60d86657-4e09-4259-9f38-05cf52780cb0 tempest-VolumesListAdminTestJSON-228051891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:30:58 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-60d86657-4e09-4259-9f38-05cf52780cb0 tempest-VolumesListAdminTestJSON-228051891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:30:58 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-60d86657-4e09-4259-9f38-05cf52780cb0 tempest-VolumesListAdminTestJSON-228051891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:30:58 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-60d86657-4e09-4259-9f38-05cf52780cb0 tempest-VolumesListAdminTestJSON-228051891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:30:58 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-60d86657-4e09-4259-9f38-05cf52780cb0 tempest-VolumesListAdminTestJSON-228051891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:30:58 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-60d86657-4e09-4259-9f38-05cf52780cb0 tempest-VolumesListAdminTestJSON-228051891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:58 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-d46a9552-42ef-4c80-8f6c-104e3232c0f1 tempest-VolumesGetTest-459511347 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:30:58 devstack sudo[106042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:30:58 devstack sudo[106042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:58 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-d46a9552-42ef-4c80-8f6c-104e3232c0f1 tempest-VolumesGetTest-459511347 None] Flow 'volume_create_manager' (c48754b3-fdf4-41b8-91c3-4dc50c4e1347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:30:58 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-d46a9552-42ef-4c80-8f6c-104e3232c0f1 tempest-VolumesGetTest-459511347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87610994-ac04-42b1-8420-a80b9dd048b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:30:58 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-d46a9552-42ef-4c80-8f6c-104e3232c0f1 tempest-VolumesGetTest-459511347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87610994-ac04-42b1-8420-a80b9dd048b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:30:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1569891324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c99042e-c676-48ac-9418-16f26e7e0042,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='2563771eca7848979f10833a8a104f6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:30:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:30:58Z,use_quota=True,user_id='f811ce7459cc4202a99345871cc95ded',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:30:58 devstack sudo[106037]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:58 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-d46a9552-42ef-4c80-8f6c-104e3232c0f1 tempest-VolumesGetTest-459511347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b95d2376-1b90-4a7e-bd87-21775f5924e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:30:58 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-d46a9552-42ef-4c80-8f6c-104e3232c0f1 tempest-VolumesGetTest-459511347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b95d2376-1b90-4a7e-bd87-21775f5924e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:30:58 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-d46a9552-42ef-4c80-8f6c-104e3232c0f1 tempest-VolumesGetTest-459511347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e40f1c54-4cb5-4afd-8282-52b44d9f9930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:30:58 devstack cinder-volume[94394]: DEBUG cinder.image.glance [None req-d46a9552-42ef-4c80-8f6c-104e3232c0f1 tempest-VolumesGetTest-459511347 None] Creating Keystone auth plugin from conf {{(pid=94394) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 26 14:30:58 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4997a207-3ce0-4e7f-9721-f077612a79d8 tempest-VolumesListAdminTestJSON-2134514732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.354s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:58 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-4997a207-3ce0-4e7f-9721-f077612a79d8 tempest-VolumesListAdminTestJSON-2134514732 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:30:58 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-4997a207-3ce0-4e7f-9721-f077612a79d8 tempest-VolumesListAdminTestJSON-2134514732 None] Deleted volume successfully. Aug 26 14:30:58 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-4997a207-3ce0-4e7f-9721-f077612a79d8 tempest-VolumesListAdminTestJSON-2134514732 None] Lock "cinder-ebbf53d2-8329-42a5-93c4-446eeb3bfc44-delete_volume" released by "delete_volume" :: held 2.219s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:30:58 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-0a02ce97-c11e-4a78-b92d-deeca102aed1 tempest-SnapshotsActionsTest-642613075 None] Acquiring lock "cinder-93dc10de-eadf-41ce-86e1-2c1a0405a6dc-delete_snapshot" by "delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:30:58 devstack sudo[106042]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:58 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-0a02ce97-c11e-4a78-b92d-deeca102aed1 tempest-SnapshotsActionsTest-642613075 None] Lock "cinder-93dc10de-eadf-41ce-86e1-2c1a0405a6dc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:30:58 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-0a02ce97-c11e-4a78-b92d-deeca102aed1 tempest-SnapshotsActionsTest-642613075 None] Acquiring lock "cinder-quobyte-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943" by "delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:30:58 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-60d86657-4e09-4259-9f38-05cf52780cb0 tempest-VolumesListAdminTestJSON-228051891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.340s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:58 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-60d86657-4e09-4259-9f38-05cf52780cb0 tempest-VolumesListAdminTestJSON-228051891 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:30:58 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-60d86657-4e09-4259-9f38-05cf52780cb0 tempest-VolumesListAdminTestJSON-228051891 None] Deleted volume successfully. Aug 26 14:30:58 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-0a02ce97-c11e-4a78-b92d-deeca102aed1 tempest-SnapshotsActionsTest-642613075 None] Lock "cinder-quobyte-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943" acquired by "delete_snapshot" :: waited 0.026s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:30:58 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-0a02ce97-c11e-4a78-b92d-deeca102aed1 tempest-SnapshotsActionsTest-642613075 None] Acquiring lock "cinder-quobyte-93dc10de-eadf-41ce-86e1-2c1a0405a6dc" by "_delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:30:58 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-0a02ce97-c11e-4a78-b92d-deeca102aed1 tempest-SnapshotsActionsTest-642613075 None] Lock "cinder-quobyte-93dc10de-eadf-41ce-86e1-2c1a0405a6dc" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:30:58 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-0a02ce97-c11e-4a78-b92d-deeca102aed1 tempest-SnapshotsActionsTest-642613075 None] Deleting offline snapshot 93dc10de-eadf-41ce-86e1-2c1a0405a6dc of volume 4fb30b4d-fd01-4922-b4e3-7bb6dfb45943 {{(pid=94394) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 14:30:58 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-0a02ce97-c11e-4a78-b92d-deeca102aed1 tempest-SnapshotsActionsTest-642613075 None] snapshot_file for this snap is: volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.93dc10de-eadf-41ce-86e1-2c1a0405a6dc {{(pid=94394) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 14:30:58 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-60d86657-4e09-4259-9f38-05cf52780cb0 tempest-VolumesListAdminTestJSON-228051891 None] Lock "cinder-b4f6f2c9-69db-4c4e-881d-ddeb0ef56424-delete_volume" released by "delete_volume" :: held 2.220s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:30:58 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[e92c7181-369d-4fed-ba2a-bda3f87a8618]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:30:58 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-0a02ce97-c11e-4a78-b92d-deeca102aed1 tempest-SnapshotsActionsTest-642613075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.93dc10de-eadf-41ce-86e1-2c1a0405a6dc {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:58 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-d46a9552-42ef-4c80-8f6c-104e3232c0f1 tempest-VolumesGetTest-459511347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e40f1c54-4cb5-4afd-8282-52b44d9f9930) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1c99042e-c676-48ac-9418-16f26e7e0042', 'volume_name': 'volume-1c99042e-c676-48ac-9418-16f26e7e0042', 'volume_size': 1, 'image_id': '2681f5d8-1c86-4dfd-86fb-c29aaed49dc6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2681f5d8-1c86-4dfd-86fb-c29aaed49dc6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cbf977c46caa48c18e414079bf75016d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2681f5d8-1c86-4dfd-86fb-c29aaed49dc6', 'created_at': datetime.datetime(2026, 8, 26, 12, 16, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 12, 16, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2681f5d8-1c86-4dfd-86fb-c29aaed49dc6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:30:58 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-d46a9552-42ef-4c80-8f6c-104e3232c0f1 tempest-VolumesGetTest-459511347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b1b6c31-7751-42c3-a7a5-7fe1de258572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:30:58 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-d46a9552-42ef-4c80-8f6c-104e3232c0f1 tempest-VolumesGetTest-459511347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b1b6c31-7751-42c3-a7a5-7fe1de258572) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:30:58 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-d46a9552-42ef-4c80-8f6c-104e3232c0f1 tempest-VolumesGetTest-459511347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1da1712a-1c80-4e00-b242-3e21b44cbd6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:30:58 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-d46a9552-42ef-4c80-8f6c-104e3232c0f1 tempest-VolumesGetTest-459511347 None] Volume 1c99042e-c676-48ac-9418-16f26e7e0042: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1c99042e-c676-48ac-9418-16f26e7e0042', 'volume_size': 1, 'image_id': '2681f5d8-1c86-4dfd-86fb-c29aaed49dc6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2681f5d8-1c86-4dfd-86fb-c29aaed49dc6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cbf977c46caa48c18e414079bf75016d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2681f5d8-1c86-4dfd-86fb-c29aaed49dc6', 'created_at': datetime.datetime(2026, 8, 26, 12, 16, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 12, 16, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2681f5d8-1c86-4dfd-86fb-c29aaed49dc6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 26 14:30:58 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-d46a9552-42ef-4c80-8f6c-104e3232c0f1 tempest-VolumesGetTest-459511347 None] Trying to clone 1c99042e-c676-48ac-9418-16f26e7e0042 from image 2681f5d8-1c86-4dfd-86fb-c29aaed49dc6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/2681f5d8-1c86-4dfd-86fb-c29aaed49dc6', 'metadata': {}}]). {{(pid=94394) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 26 14:30:59 devstack sudo[106045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.93dc10de-eadf-41ce-86e1-2c1a0405a6dc Aug 26 14:30:59 devstack sudo[106045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:59 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-1e0798d3-b46a-48d5-a5fe-69fde939c965 tempest-VolumesListAdminTestJSON-228051891 None] Acquiring lock "cinder-8a30b94a-992b-44f8-8563-31d6603bf5be-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:30:59 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-1e0798d3-b46a-48d5-a5fe-69fde939c965 tempest-VolumesListAdminTestJSON-228051891 None] Lock "cinder-8a30b94a-992b-44f8-8563-31d6603bf5be-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:30:59 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-1e0798d3-b46a-48d5-a5fe-69fde939c965 tempest-VolumesListAdminTestJSON-228051891 None] Acquiring lock "cinder-quobyte-8a30b94a-992b-44f8-8563-31d6603bf5be" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:30:59 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-1e0798d3-b46a-48d5-a5fe-69fde939c965 tempest-VolumesListAdminTestJSON-228051891 None] Lock "cinder-quobyte-8a30b94a-992b-44f8-8563-31d6603bf5be" acquired by "delete_volume" :: waited 0.039s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:30:59 devstack sudo[106045]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:59 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-0a02ce97-c11e-4a78-b92d-deeca102aed1 tempest-SnapshotsActionsTest-642613075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.93dc10de-eadf-41ce-86e1-2c1a0405a6dc" returned: 0 in 0.548s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:59 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-0a02ce97-c11e-4a78-b92d-deeca102aed1 tempest-SnapshotsActionsTest-642613075 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94394) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 14:30:59 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6df4805-55d4-4285-986c-8ead05df6bea]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:30:59 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-1e0798d3-b46a-48d5-a5fe-69fde939c965 tempest-VolumesListAdminTestJSON-228051891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-8a30b94a-992b-44f8-8563-31d6603bf5be {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:59 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[c15d8f05-8380-46e6-a6fd-526ce66ba5d0]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:30:59 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-0a02ce97-c11e-4a78-b92d-deeca102aed1 tempest-SnapshotsActionsTest-642613075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.9a2cb941-51f1-4661-b104-c9713dced550 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:59 devstack cinder-volume[94394]: DEBUG cinder.image.image_utils [None req-d46a9552-42ef-4c80-8f6c-104e3232c0f1 tempest-VolumesGetTest-459511347 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2681f5d8-1c86-4dfd-86fb-c29aaed49dc6_d8tymx2udevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=94394) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 26 14:30:59 devstack cinder-volume[94394]: INFO cinder.image.image_utils [None req-d46a9552-42ef-4c80-8f6c-104e3232c0f1 tempest-VolumesGetTest-459511347 None] Image download 20.69 MB at 20.69 MB/s Aug 26 14:30:59 devstack sudo[106051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-8a30b94a-992b-44f8-8563-31d6603bf5be Aug 26 14:30:59 devstack sudo[106051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:59 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd1ae2c2-4f0c-4362-bea9-64cd766a8991]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:30:59 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-d46a9552-42ef-4c80-8f6c-104e3232c0f1 tempest-VolumesGetTest-459511347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2681f5d8-1c86-4dfd-86fb-c29aaed49dc6_d8tymx2udevstack@QuobyteHD {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:30:59 devstack sudo[106052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.9a2cb941-51f1-4661-b104-c9713dced550 Aug 26 14:30:59 devstack sudo[106052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:59 devstack sudo[106056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2681f5d8-1c86-4dfd-86fb-c29aaed49dc6_d8tymx2udevstack@QuobyteHD Aug 26 14:30:59 devstack sudo[106056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:30:59 devstack sudo[106051]: pam_unix(sudo:session): session closed for user root Aug 26 14:30:59 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-1e0798d3-b46a-48d5-a5fe-69fde939c965 tempest-VolumesListAdminTestJSON-228051891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-8a30b94a-992b-44f8-8563-31d6603bf5be" returned: 0 in 0.529s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:30:59 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-1e0798d3-b46a-48d5-a5fe-69fde939c965 tempest-VolumesListAdminTestJSON-228051891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-8a30b94a-992b-44f8-8563-31d6603bf5be {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:31:00 devstack sudo[106066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-8a30b94a-992b-44f8-8563-31d6603bf5be Aug 26 14:31:00 devstack sudo[106066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:31:00 devstack sudo[106052]: pam_unix(sudo:session): session closed for user root Aug 26 14:31:00 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-0a02ce97-c11e-4a78-b92d-deeca102aed1 tempest-SnapshotsActionsTest-642613075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.9a2cb941-51f1-4661-b104-c9713dced550" returned: 0 in 0.548s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:31:00 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-0a02ce97-c11e-4a78-b92d-deeca102aed1 tempest-SnapshotsActionsTest-642613075 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94394) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 14:31:00 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-0a02ce97-c11e-4a78-b92d-deeca102aed1 tempest-SnapshotsActionsTest-642613075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.93dc10de-eadf-41ce-86e1-2c1a0405a6dc {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:31:00 devstack sudo[106069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.93dc10de-eadf-41ce-86e1-2c1a0405a6dc Aug 26 14:31:00 devstack sudo[106069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:31:00 devstack sudo[106056]: pam_unix(sudo:session): session closed for user root Aug 26 14:31:00 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-d46a9552-42ef-4c80-8f6c-104e3232c0f1 tempest-VolumesGetTest-459511347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2681f5d8-1c86-4dfd-86fb-c29aaed49dc6_d8tymx2udevstack@QuobyteHD" returned: 0 in 0.407s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:31:00 devstack cinder-volume[94394]: DEBUG cinder.image.image_utils [None req-d46a9552-42ef-4c80-8f6c-104e3232c0f1 tempest-VolumesGetTest-459511347 None] Temporary image 2681f5d8-1c86-4dfd-86fb-c29aaed49dc6 is fetched for user f811ce7459cc4202a99345871cc95ded. {{(pid=94394) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 26 14:31:00 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[09383880-5c8e-40c6-8b51-e183a42ce68f]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:31:00 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-d46a9552-42ef-4c80-8f6c-104e3232c0f1 tempest-VolumesGetTest-459511347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2681f5d8-1c86-4dfd-86fb-c29aaed49dc6_d8tymx2udevstack@QuobyteHD {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:31:00 devstack sudo[106066]: pam_unix(sudo:session): session closed for user root Aug 26 14:31:00 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-1e0798d3-b46a-48d5-a5fe-69fde939c965 tempest-VolumesListAdminTestJSON-228051891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-8a30b94a-992b-44f8-8563-31d6603bf5be" returned: 0 in 0.454s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:31:00 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-1e0798d3-b46a-48d5-a5fe-69fde939c965 tempest-VolumesListAdminTestJSON-228051891 None] Lock "cinder-quobyte-8a30b94a-992b-44f8-8563-31d6603bf5be" released by "delete_volume" :: held 1.099s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:31:00 devstack sudo[106073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2681f5d8-1c86-4dfd-86fb-c29aaed49dc6_d8tymx2udevstack@QuobyteHD Aug 26 14:31:00 devstack sudo[106073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:31:00 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-1e0798d3-b46a-48d5-a5fe-69fde939c965 tempest-VolumesListAdminTestJSON-228051891 None] Created reservations ['3691fe93-fc66-4780-aaa8-b542b39d98b3', 'e708ede2-9246-4e0b-bbdb-5e2285d460d2', 'a8cab576-9ca1-402a-b986-3006b7e53d08', '7e3e88f3-edda-42b7-9092-d4a695792813'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:31:00 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-1e0798d3-b46a-48d5-a5fe-69fde939c965 tempest-VolumesListAdminTestJSON-228051891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:31:00 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-1e0798d3-b46a-48d5-a5fe-69fde939c965 tempest-VolumesListAdminTestJSON-228051891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:31:00 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-1e0798d3-b46a-48d5-a5fe-69fde939c965 tempest-VolumesListAdminTestJSON-228051891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:31:00 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-1e0798d3-b46a-48d5-a5fe-69fde939c965 tempest-VolumesListAdminTestJSON-228051891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:31:00 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-1e0798d3-b46a-48d5-a5fe-69fde939c965 tempest-VolumesListAdminTestJSON-228051891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:31:00 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-1e0798d3-b46a-48d5-a5fe-69fde939c965 tempest-VolumesListAdminTestJSON-228051891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:31:00 devstack sudo[106109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:31:00 devstack sudo[106109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:31:00 devstack sudo[106069]: pam_unix(sudo:session): session closed for user root Aug 26 14:31:00 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-0a02ce97-c11e-4a78-b92d-deeca102aed1 tempest-SnapshotsActionsTest-642613075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.93dc10de-eadf-41ce-86e1-2c1a0405a6dc" returned: 0 in 0.757s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:31:00 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-0a02ce97-c11e-4a78-b92d-deeca102aed1 tempest-SnapshotsActionsTest-642613075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.93dc10de-eadf-41ce-86e1-2c1a0405a6dc {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:31:00 devstack sudo[106113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.93dc10de-eadf-41ce-86e1-2c1a0405a6dc Aug 26 14:31:00 devstack sudo[106113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:31:01 devstack sudo[106073]: pam_unix(sudo:session): session closed for user root Aug 26 14:31:01 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-d46a9552-42ef-4c80-8f6c-104e3232c0f1 tempest-VolumesGetTest-459511347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2681f5d8-1c86-4dfd-86fb-c29aaed49dc6_d8tymx2udevstack@QuobyteHD" returned: 0 in 0.789s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:31:01 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-d46a9552-42ef-4c80-8f6c-104e3232c0f1 tempest-VolumesGetTest-459511347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:31:01 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-d46a9552-42ef-4c80-8f6c-104e3232c0f1 tempest-VolumesGetTest-459511347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.009s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:31:01 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-d46a9552-42ef-4c80-8f6c-104e3232c0f1 tempest-VolumesGetTest-459511347 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:30:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1569891324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c99042e-c676-48ac-9418-16f26e7e0042,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='2563771eca7848979f10833a8a104f6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:30:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:30:58Z,use_quota=True,user_id='f811ce7459cc4202a99345871cc95ded',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:31:01 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-d46a9552-42ef-4c80-8f6c-104e3232c0f1 tempest-VolumesGetTest-459511347 None] Creating volume 1c99042e-c676-48ac-9418-16f26e7e0042 {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:31:01 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-d46a9552-42ef-4c80-8f6c-104e3232c0f1 tempest-VolumesGetTest-459511347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:31:01 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-d46a9552-42ef-4c80-8f6c-104e3232c0f1 tempest-VolumesGetTest-459511347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:31:01 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-d46a9552-42ef-4c80-8f6c-104e3232c0f1 tempest-VolumesGetTest-459511347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:31:01 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-d46a9552-42ef-4c80-8f6c-104e3232c0f1 tempest-VolumesGetTest-459511347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:31:01 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-d46a9552-42ef-4c80-8f6c-104e3232c0f1 tempest-VolumesGetTest-459511347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:31:01 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-d46a9552-42ef-4c80-8f6c-104e3232c0f1 tempest-VolumesGetTest-459511347 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:31:01 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-d46a9552-42ef-4c80-8f6c-104e3232c0f1 tempest-VolumesGetTest-459511347 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:31:01 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-d46a9552-42ef-4c80-8f6c-104e3232c0f1 tempest-VolumesGetTest-459511347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-1c99042e-c676-48ac-9418-16f26e7e0042 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:31:01 devstack sudo[106109]: pam_unix(sudo:session): session closed for user root Aug 26 14:31:01 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-1e0798d3-b46a-48d5-a5fe-69fde939c965 tempest-VolumesListAdminTestJSON-228051891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.380s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:31:01 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-1e0798d3-b46a-48d5-a5fe-69fde939c965 tempest-VolumesListAdminTestJSON-228051891 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:31:01 devstack sudo[106127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-1c99042e-c676-48ac-9418-16f26e7e0042 1073741824 Aug 26 14:31:01 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-1e0798d3-b46a-48d5-a5fe-69fde939c965 tempest-VolumesListAdminTestJSON-228051891 None] Deleted volume successfully. Aug 26 14:31:01 devstack sudo[106127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:31:01 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-1e0798d3-b46a-48d5-a5fe-69fde939c965 tempest-VolumesListAdminTestJSON-228051891 None] Lock "cinder-8a30b94a-992b-44f8-8563-31d6603bf5be-delete_volume" released by "delete_volume" :: held 1.933s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:31:01 devstack sudo[106113]: pam_unix(sudo:session): session closed for user root Aug 26 14:31:01 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-0a02ce97-c11e-4a78-b92d-deeca102aed1 tempest-SnapshotsActionsTest-642613075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.93dc10de-eadf-41ce-86e1-2c1a0405a6dc" returned: 0 in 0.621s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:31:01 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-0a02ce97-c11e-4a78-b92d-deeca102aed1 tempest-SnapshotsActionsTest-642613075 None] Lock "cinder-quobyte-93dc10de-eadf-41ce-86e1-2c1a0405a6dc" released by "_delete_snapshot" :: held 2.663s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:31:01 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-0a02ce97-c11e-4a78-b92d-deeca102aed1 tempest-SnapshotsActionsTest-642613075 None] Lock "cinder-quobyte-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943" released by "delete_snapshot" :: held 2.705s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:31:01 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-0a02ce97-c11e-4a78-b92d-deeca102aed1 tempest-SnapshotsActionsTest-642613075 None] Created reservations ['f0971806-7bbd-459f-9cc4-3ebc13987237', '07f63147-cc62-4e66-961e-c3ec25b5fdcd', 'c649a58a-9515-49e2-b9b2-4b02dad1d7f1', 'af885409-f6e3-4dc6-9d93-24706a75033e'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:31:01 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-0a02ce97-c11e-4a78-b92d-deeca102aed1 tempest-SnapshotsActionsTest-642613075 None] Delete snapshot completed successfully. Aug 26 14:31:01 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-1f1804ca-8f18-447f-8cd8-9e7be7c641fd tempest-VolumesListAdminTestJSON-228051891 None] Acquiring lock "cinder-f82d04a8-f3a8-4fb1-ae0c-a5e529fae705-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:31:01 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-0a02ce97-c11e-4a78-b92d-deeca102aed1 tempest-SnapshotsActionsTest-642613075 None] Lock "cinder-93dc10de-eadf-41ce-86e1-2c1a0405a6dc-delete_snapshot" released by "delete_snapshot" :: held 3.025s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:31:01 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-1f1804ca-8f18-447f-8cd8-9e7be7c641fd tempest-VolumesListAdminTestJSON-228051891 None] Lock "cinder-f82d04a8-f3a8-4fb1-ae0c-a5e529fae705-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:31:01 devstack sudo[106127]: pam_unix(sudo:session): session closed for user root Aug 26 14:31:01 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-d46a9552-42ef-4c80-8f6c-104e3232c0f1 tempest-VolumesGetTest-459511347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-1c99042e-c676-48ac-9418-16f26e7e0042 1073741824" returned: 0 in 0.764s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:31:01 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-1f1804ca-8f18-447f-8cd8-9e7be7c641fd tempest-VolumesListAdminTestJSON-228051891 None] Acquiring lock "cinder-quobyte-f82d04a8-f3a8-4fb1-ae0c-a5e529fae705" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:31:01 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-d46a9552-42ef-4c80-8f6c-104e3232c0f1 tempest-VolumesGetTest-459511347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-1c99042e-c676-48ac-9418-16f26e7e0042 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:31:01 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-1f1804ca-8f18-447f-8cd8-9e7be7c641fd tempest-VolumesListAdminTestJSON-228051891 None] Lock "cinder-quobyte-f82d04a8-f3a8-4fb1-ae0c-a5e529fae705" acquired by "delete_volume" :: waited 0.051s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:31:01 devstack sudo[106156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-1c99042e-c676-48ac-9418-16f26e7e0042 Aug 26 14:31:01 devstack sudo[106156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:31:01 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ea6af82-6c65-48b7-9be3-a9bdad3cd762]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:31:01 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-1f1804ca-8f18-447f-8cd8-9e7be7c641fd tempest-VolumesListAdminTestJSON-228051891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-f82d04a8-f3a8-4fb1-ae0c-a5e529fae705 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:31:02 devstack sudo[106160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-f82d04a8-f3a8-4fb1-ae0c-a5e529fae705 Aug 26 14:31:02 devstack sudo[106160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:31:02 devstack sudo[106156]: pam_unix(sudo:session): session closed for user root Aug 26 14:31:02 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-d46a9552-42ef-4c80-8f6c-104e3232c0f1 tempest-VolumesGetTest-459511347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-1c99042e-c676-48ac-9418-16f26e7e0042" returned: 0 in 0.317s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:31:02 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-d46a9552-42ef-4c80-8f6c-104e3232c0f1 tempest-VolumesGetTest-459511347 None] <== create_volume: return (1149ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:31:02 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-d46a9552-42ef-4c80-8f6c-104e3232c0f1 tempest-VolumesGetTest-459511347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.162s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:31:02 devstack cinder-volume[94394]: DEBUG cinder.volume.volume_utils [None req-d46a9552-42ef-4c80-8f6c-104e3232c0f1 tempest-VolumesGetTest-459511347 None] Attempting download of 2681f5d8-1c86-4dfd-86fb-c29aaed49dc6 ((None, [{'url': 'file:///opt/stack/data/glance/images/2681f5d8-1c86-4dfd-86fb-c29aaed49dc6', 'metadata': {}}])) to volume 1c99042e-c676-48ac-9418-16f26e7e0042. {{(pid=94394) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 26 14:31:02 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[3450ef48-86f5-4ce2-b2bd-a780d435ee13]: (4, 'raw') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:31:02 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-d46a9552-42ef-4c80-8f6c-104e3232c0f1 tempest-VolumesGetTest-459511347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2681f5d8-1c86-4dfd-86fb-c29aaed49dc6_msv45pz_ {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:31:02 devstack sudo[106160]: pam_unix(sudo:session): session closed for user root Aug 26 14:31:02 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-1f1804ca-8f18-447f-8cd8-9e7be7c641fd tempest-VolumesListAdminTestJSON-228051891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-f82d04a8-f3a8-4fb1-ae0c-a5e529fae705" returned: 0 in 0.445s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:31:02 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-1f1804ca-8f18-447f-8cd8-9e7be7c641fd tempest-VolumesListAdminTestJSON-228051891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-f82d04a8-f3a8-4fb1-ae0c-a5e529fae705 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:31:02 devstack sudo[106185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-f82d04a8-f3a8-4fb1-ae0c-a5e529fae705 Aug 26 14:31:02 devstack sudo[106185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:31:02 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-7127ed2a-b1f2-4ab8-b012-058e07ce7e09 tempest-SnapshotsActionsTest-695899691 None] Acquiring lock "cinder-9a2cb941-51f1-4661-b104-c9713dced550-delete_snapshot" by "delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:31:02 devstack sudo[106178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2681f5d8-1c86-4dfd-86fb-c29aaed49dc6_msv45pz_ Aug 26 14:31:02 devstack sudo[106178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:31:02 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-7127ed2a-b1f2-4ab8-b012-058e07ce7e09 tempest-SnapshotsActionsTest-695899691 None] Lock "cinder-9a2cb941-51f1-4661-b104-c9713dced550-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:31:02 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-7127ed2a-b1f2-4ab8-b012-058e07ce7e09 tempest-SnapshotsActionsTest-695899691 None] Acquiring lock "cinder-quobyte-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943" by "delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:31:02 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-7127ed2a-b1f2-4ab8-b012-058e07ce7e09 tempest-SnapshotsActionsTest-695899691 None] Lock "cinder-quobyte-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943" acquired by "delete_snapshot" :: waited 0.034s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:31:02 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-7127ed2a-b1f2-4ab8-b012-058e07ce7e09 tempest-SnapshotsActionsTest-695899691 None] Acquiring lock "cinder-quobyte-9a2cb941-51f1-4661-b104-c9713dced550" by "_delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:31:02 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-7127ed2a-b1f2-4ab8-b012-058e07ce7e09 tempest-SnapshotsActionsTest-695899691 None] Lock "cinder-quobyte-9a2cb941-51f1-4661-b104-c9713dced550" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:31:02 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-7127ed2a-b1f2-4ab8-b012-058e07ce7e09 tempest-SnapshotsActionsTest-695899691 None] Deleting offline snapshot 9a2cb941-51f1-4661-b104-c9713dced550 of volume 4fb30b4d-fd01-4922-b4e3-7bb6dfb45943 {{(pid=94394) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 14:31:02 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-7127ed2a-b1f2-4ab8-b012-058e07ce7e09 tempest-SnapshotsActionsTest-695899691 None] snapshot_file for this snap is: volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.9a2cb941-51f1-4661-b104-c9713dced550 {{(pid=94394) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 14:31:02 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f4dc18e-d47b-43b2-88ae-b6b0d7050670]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:31:02 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-7127ed2a-b1f2-4ab8-b012-058e07ce7e09 tempest-SnapshotsActionsTest-695899691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.9a2cb941-51f1-4661-b104-c9713dced550 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:31:02 devstack sudo[106185]: pam_unix(sudo:session): session closed for user root Aug 26 14:31:02 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-1f1804ca-8f18-447f-8cd8-9e7be7c641fd tempest-VolumesListAdminTestJSON-228051891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-f82d04a8-f3a8-4fb1-ae0c-a5e529fae705" returned: 0 in 0.373s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:31:02 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-1f1804ca-8f18-447f-8cd8-9e7be7c641fd tempest-VolumesListAdminTestJSON-228051891 None] Lock "cinder-quobyte-f82d04a8-f3a8-4fb1-ae0c-a5e529fae705" released by "delete_volume" :: held 0.885s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:31:02 devstack sudo[106178]: pam_unix(sudo:session): session closed for user root Aug 26 14:31:02 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-d46a9552-42ef-4c80-8f6c-104e3232c0f1 tempest-VolumesGetTest-459511347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2681f5d8-1c86-4dfd-86fb-c29aaed49dc6_msv45pz_" returned: 0 in 0.549s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:31:02 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-d46a9552-42ef-4c80-8f6c-104e3232c0f1 tempest-VolumesGetTest-459511347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2681f5d8-1c86-4dfd-86fb-c29aaed49dc6_msv45pz_ {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:31:02 devstack sudo[106188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.9a2cb941-51f1-4661-b104-c9713dced550 Aug 26 14:31:02 devstack sudo[106188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:31:02 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-1f1804ca-8f18-447f-8cd8-9e7be7c641fd tempest-VolumesListAdminTestJSON-228051891 None] Created reservations ['480af7c0-8f3c-44cb-8e8a-9d7b133955df', 'e531e9a4-d151-419a-878c-a6960b14d904', 'd67689b8-b05c-4d5d-b5ad-2c1c15b3b36c', '5ab95480-c14f-4820-9352-28e05898c5ff'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:31:02 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-1f1804ca-8f18-447f-8cd8-9e7be7c641fd tempest-VolumesListAdminTestJSON-228051891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:31:02 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-1f1804ca-8f18-447f-8cd8-9e7be7c641fd tempest-VolumesListAdminTestJSON-228051891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:31:02 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-1f1804ca-8f18-447f-8cd8-9e7be7c641fd tempest-VolumesListAdminTestJSON-228051891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:31:02 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-1f1804ca-8f18-447f-8cd8-9e7be7c641fd tempest-VolumesListAdminTestJSON-228051891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:31:02 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-1f1804ca-8f18-447f-8cd8-9e7be7c641fd tempest-VolumesListAdminTestJSON-228051891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:31:02 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-1f1804ca-8f18-447f-8cd8-9e7be7c641fd tempest-VolumesListAdminTestJSON-228051891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:31:03 devstack sudo[106194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:31:03 devstack sudo[106194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:31:03 devstack sudo[106192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2681f5d8-1c86-4dfd-86fb-c29aaed49dc6_msv45pz_ Aug 26 14:31:03 devstack sudo[106192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:31:03 devstack sudo[106188]: pam_unix(sudo:session): session closed for user root Aug 26 14:31:03 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-7127ed2a-b1f2-4ab8-b012-058e07ce7e09 tempest-SnapshotsActionsTest-695899691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.9a2cb941-51f1-4661-b104-c9713dced550" returned: 0 in 0.526s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:31:03 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-7127ed2a-b1f2-4ab8-b012-058e07ce7e09 tempest-SnapshotsActionsTest-695899691 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94394) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 14:31:03 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[c93c4229-1fd9-43d9-b50f-df58089a0d5a]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:31:03 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-7127ed2a-b1f2-4ab8-b012-058e07ce7e09 tempest-SnapshotsActionsTest-695899691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:31:03 devstack sudo[106192]: pam_unix(sudo:session): session closed for user root Aug 26 14:31:03 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-d46a9552-42ef-4c80-8f6c-104e3232c0f1 tempest-VolumesGetTest-459511347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2681f5d8-1c86-4dfd-86fb-c29aaed49dc6_msv45pz_" returned: 1 in 0.432s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:31:03 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-d46a9552-42ef-4c80-8f6c-104e3232c0f1 tempest-VolumesGetTest-459511347 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2681f5d8-1c86-4dfd-86fb-c29aaed49dc6_msv45pz_' failed. Not Retrying. {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 14:31:03 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[42179314-9099-4436-a2fe-1f165245efdc]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:31:03 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-d46a9552-42ef-4c80-8f6c-104e3232c0f1 tempest-VolumesGetTest-459511347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2681f5d8-1c86-4dfd-86fb-c29aaed49dc6_d8tymx2udevstack@QuobyteHD {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:31:03 devstack sudo[106194]: pam_unix(sudo:session): session closed for user root Aug 26 14:31:03 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-1f1804ca-8f18-447f-8cd8-9e7be7c641fd tempest-VolumesListAdminTestJSON-228051891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.310s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:31:03 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-1f1804ca-8f18-447f-8cd8-9e7be7c641fd tempest-VolumesListAdminTestJSON-228051891 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:31:03 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-1f1804ca-8f18-447f-8cd8-9e7be7c641fd tempest-VolumesListAdminTestJSON-228051891 None] Deleted volume successfully. Aug 26 14:31:03 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-1f1804ca-8f18-447f-8cd8-9e7be7c641fd tempest-VolumesListAdminTestJSON-228051891 None] Lock "cinder-f82d04a8-f3a8-4fb1-ae0c-a5e529fae705-delete_volume" released by "delete_volume" :: held 1.554s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:31:03 devstack sudo[106202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943 Aug 26 14:31:03 devstack sudo[106202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:31:03 devstack sudo[106204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2681f5d8-1c86-4dfd-86fb-c29aaed49dc6_d8tymx2udevstack@QuobyteHD Aug 26 14:31:03 devstack sudo[106204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:31:03 devstack sudo[106204]: pam_unix(sudo:session): session closed for user root Aug 26 14:31:03 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-d46a9552-42ef-4c80-8f6c-104e3232c0f1 tempest-VolumesGetTest-459511347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2681f5d8-1c86-4dfd-86fb-c29aaed49dc6_d8tymx2udevstack@QuobyteHD" returned: 0 in 0.413s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:31:03 devstack cinder-volume[94394]: DEBUG cinder.image.image_utils [None req-d46a9552-42ef-4c80-8f6c-104e3232c0f1 tempest-VolumesGetTest-459511347 None] 2681f5d8-1c86-4dfd-86fb-c29aaed49dc6 was qcow2, converting to qcow2 {{(pid=94394) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 26 14:31:03 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-d46a9552-42ef-4c80-8f6c-104e3232c0f1 tempest-VolumesGetTest-459511347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2681f5d8-1c86-4dfd-86fb-c29aaed49dc6_d8tymx2udevstack@QuobyteHD /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-1c99042e-c676-48ac-9418-16f26e7e0042 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:31:03 devstack sudo[106214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2681f5d8-1c86-4dfd-86fb-c29aaed49dc6_d8tymx2udevstack@QuobyteHD /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-1c99042e-c676-48ac-9418-16f26e7e0042 Aug 26 14:31:03 devstack sudo[106214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:31:03 devstack sudo[106202]: pam_unix(sudo:session): session closed for user root Aug 26 14:31:03 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-7127ed2a-b1f2-4ab8-b012-058e07ce7e09 tempest-SnapshotsActionsTest-695899691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943" returned: 0 in 0.622s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:31:03 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-7127ed2a-b1f2-4ab8-b012-058e07ce7e09 tempest-SnapshotsActionsTest-695899691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.9a2cb941-51f1-4661-b104-c9713dced550 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:31:03 devstack sudo[106217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.9a2cb941-51f1-4661-b104-c9713dced550 Aug 26 14:31:03 devstack sudo[106217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:31:04 devstack sudo[106217]: pam_unix(sudo:session): session closed for user root Aug 26 14:31:04 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-7127ed2a-b1f2-4ab8-b012-058e07ce7e09 tempest-SnapshotsActionsTest-695899691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.9a2cb941-51f1-4661-b104-c9713dced550" returned: 0 in 0.535s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:31:04 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-7127ed2a-b1f2-4ab8-b012-058e07ce7e09 tempest-SnapshotsActionsTest-695899691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.9a2cb941-51f1-4661-b104-c9713dced550 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:31:04 devstack sudo[106228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.9a2cb941-51f1-4661-b104-c9713dced550 Aug 26 14:31:04 devstack sudo[106228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:31:04 devstack sudo[106228]: pam_unix(sudo:session): session closed for user root Aug 26 14:31:04 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-7127ed2a-b1f2-4ab8-b012-058e07ce7e09 tempest-SnapshotsActionsTest-695899691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943.9a2cb941-51f1-4661-b104-c9713dced550" returned: 0 in 0.339s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:31:04 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-7127ed2a-b1f2-4ab8-b012-058e07ce7e09 tempest-SnapshotsActionsTest-695899691 None] Lock "cinder-quobyte-9a2cb941-51f1-4661-b104-c9713dced550" released by "_delete_snapshot" :: held 2.197s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:31:04 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-7127ed2a-b1f2-4ab8-b012-058e07ce7e09 tempest-SnapshotsActionsTest-695899691 None] Lock "cinder-quobyte-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943" released by "delete_snapshot" :: held 2.252s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:31:04 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-7127ed2a-b1f2-4ab8-b012-058e07ce7e09 tempest-SnapshotsActionsTest-695899691 None] Created reservations ['72ed97fd-a881-471e-9190-4bafbb52983a', '09e593d4-679b-4090-aa6f-5ad48ced68cc', '37810429-dedf-4911-9c6b-3981483a9e75', 'eac2c55e-189c-4226-adea-bb41be0420e2'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:31:04 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-7127ed2a-b1f2-4ab8-b012-058e07ce7e09 tempest-SnapshotsActionsTest-695899691 None] Delete snapshot completed successfully. Aug 26 14:31:05 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-7127ed2a-b1f2-4ab8-b012-058e07ce7e09 tempest-SnapshotsActionsTest-695899691 None] Lock "cinder-9a2cb941-51f1-4661-b104-c9713dced550-delete_snapshot" released by "delete_snapshot" :: held 2.478s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:31:05 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-9c13e6f4-e8a6-4016-9239-80cdfb9f5bc5 tempest-VolumesActionsTest-1373378216 None] Acquiring lock "cinder-769b1fcf-df65-43df-a84e-9624e84e9bf1" by "attach_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:31:05 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-9c13e6f4-e8a6-4016-9239-80cdfb9f5bc5 tempest-VolumesActionsTest-1373378216 None] Lock "cinder-769b1fcf-df65-43df-a84e-9624e84e9bf1" acquired by "attach_volume" :: waited 0.028s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:31:05 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-9c13e6f4-e8a6-4016-9239-80cdfb9f5bc5 tempest-VolumesActionsTest-1373378216 None] Attaching volume 769b1fcf-df65-43df-a84e-9624e84e9bf1 to instance bc482a11-bbcb-4b2b-9b45-997a515ac0b5 at mountpoint /dev/vdb on host None. Aug 26 14:31:05 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-9c13e6f4-e8a6-4016-9239-80cdfb9f5bc5 tempest-VolumesActionsTest-1373378216 None] Attach volume completed successfully. Aug 26 14:31:05 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-9c13e6f4-e8a6-4016-9239-80cdfb9f5bc5 tempest-VolumesActionsTest-1373378216 None] Lock "cinder-769b1fcf-df65-43df-a84e-9624e84e9bf1" released by "attach_volume" :: held 0.143s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:31:05 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-122a8c8f-0ab3-4650-b287-569ac4b19093 tempest-SnapshotsActionsTest-695899691 None] Acquiring lock "cinder-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:31:06 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-122a8c8f-0ab3-4650-b287-569ac4b19093 tempest-SnapshotsActionsTest-695899691 None] Lock "cinder-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:31:06 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-122a8c8f-0ab3-4650-b287-569ac4b19093 tempest-SnapshotsActionsTest-695899691 None] Acquiring lock "cinder-quobyte-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:31:06 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-122a8c8f-0ab3-4650-b287-569ac4b19093 tempest-SnapshotsActionsTest-695899691 None] Lock "cinder-quobyte-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943" acquired by "delete_volume" :: waited 0.030s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:31:06 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-4401c12d-75ba-4437-aefb-84d152cb2ade tempest-VolumesActionsTest-1373378216 None] Acquiring lock "cinder-769b1fcf-df65-43df-a84e-9624e84e9bf1-detach_volume" by "detach_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:31:06 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[39e50970-356f-4371-a55c-d02a42cb3db2]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:31:06 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-122a8c8f-0ab3-4650-b287-569ac4b19093 tempest-SnapshotsActionsTest-695899691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:31:06 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-4401c12d-75ba-4437-aefb-84d152cb2ade tempest-VolumesActionsTest-1373378216 None] Lock "cinder-769b1fcf-df65-43df-a84e-9624e84e9bf1-detach_volume" acquired by "detach_volume" :: waited 0.060s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:31:06 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-4401c12d-75ba-4437-aefb-84d152cb2ade tempest-VolumesActionsTest-1373378216 None] Detaching volume 769b1fcf-df65-43df-a84e-9624e84e9bf1 from instance bc482a11-bbcb-4b2b-9b45-997a515ac0b5. Aug 26 14:31:06 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-4401c12d-75ba-4437-aefb-84d152cb2ade tempest-VolumesActionsTest-1373378216 None] Detach volume completed successfully. Aug 26 14:31:06 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-4401c12d-75ba-4437-aefb-84d152cb2ade tempest-VolumesActionsTest-1373378216 None] Lock "cinder-769b1fcf-df65-43df-a84e-9624e84e9bf1-detach_volume" released by "detach_volume" :: held 0.132s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:31:06 devstack sudo[106232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943 Aug 26 14:31:06 devstack sudo[106232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:31:06 devstack sudo[106214]: pam_unix(sudo:session): session closed for user root Aug 26 14:31:06 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-d46a9552-42ef-4c80-8f6c-104e3232c0f1 tempest-VolumesGetTest-459511347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2681f5d8-1c86-4dfd-86fb-c29aaed49dc6_d8tymx2udevstack@QuobyteHD /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-1c99042e-c676-48ac-9418-16f26e7e0042" returned: 0 in 2.830s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:31:06 devstack cinder-volume[94394]: DEBUG cinder.image.image_utils [None req-d46a9552-42ef-4c80-8f6c-104e3232c0f1 tempest-VolumesGetTest-459511347 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2681f5d8-1c86-4dfd-86fb-c29aaed49dc6_d8tymx2udevstack@QuobyteHD, size 112.00 MB, duration 2.83 sec, destination /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-1c99042e-c676-48ac-9418-16f26e7e0042 {{(pid=94394) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 14:31:06 devstack cinder-volume[94394]: INFO cinder.image.image_utils [None req-d46a9552-42ef-4c80-8f6c-104e3232c0f1 tempest-VolumesGetTest-459511347 None] Converted 112.00 MB image at 39.51 MB/s Aug 26 14:31:06 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-d46a9552-42ef-4c80-8f6c-104e3232c0f1 tempest-VolumesGetTest-459511347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-1c99042e-c676-48ac-9418-16f26e7e0042 1G {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:31:06 devstack sudo[106234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-1c99042e-c676-48ac-9418-16f26e7e0042 1G Aug 26 14:31:06 devstack sudo[106234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:31:06 devstack sudo[106232]: pam_unix(sudo:session): session closed for user root Aug 26 14:31:06 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-122a8c8f-0ab3-4650-b287-569ac4b19093 tempest-SnapshotsActionsTest-695899691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943" returned: 0 in 0.673s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:31:06 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-122a8c8f-0ab3-4650-b287-569ac4b19093 tempest-SnapshotsActionsTest-695899691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:31:06 devstack sudo[106242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943 Aug 26 14:31:06 devstack sudo[106242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:31:07 devstack sudo[106234]: pam_unix(sudo:session): session closed for user root Aug 26 14:31:07 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-d46a9552-42ef-4c80-8f6c-104e3232c0f1 tempest-VolumesGetTest-459511347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-1c99042e-c676-48ac-9418-16f26e7e0042 1G" returned: 0 in 0.515s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:31:07 devstack cinder-volume[94394]: DEBUG cinder.volume.volume_utils [None req-d46a9552-42ef-4c80-8f6c-104e3232c0f1 tempest-VolumesGetTest-459511347 None] Downloaded image 2681f5d8-1c86-4dfd-86fb-c29aaed49dc6 ((None, [{'url': 'file:///opt/stack/data/glance/images/2681f5d8-1c86-4dfd-86fb-c29aaed49dc6', 'metadata': {}}])) to volume 1c99042e-c676-48ac-9418-16f26e7e0042 successfully. {{(pid=94394) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 26 14:31:07 devstack cinder-volume[94394]: DEBUG cinder.image.image_utils [None req-d46a9552-42ef-4c80-8f6c-104e3232c0f1 tempest-VolumesGetTest-459511347 None] Temporary image 2681f5d8-1c86-4dfd-86fb-c29aaed49dc6 for user f811ce7459cc4202a99345871cc95ded is deleted. {{(pid=94394) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 26 14:31:07 devstack cinder-volume[94394]: DEBUG cinder.volume.volume_utils [None req-d46a9552-42ef-4c80-8f6c-104e3232c0f1 tempest-VolumesGetTest-459511347 None] Marking volume 1c99042e-c676-48ac-9418-16f26e7e0042 as bootable. {{(pid=94394) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 26 14:31:07 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-d46a9552-42ef-4c80-8f6c-104e3232c0f1 tempest-VolumesGetTest-459511347 None] Copying metadata from image 2681f5d8-1c86-4dfd-86fb-c29aaed49dc6 to 1c99042e-c676-48ac-9418-16f26e7e0042. {{(pid=94394) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 26 14:31:07 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-d46a9552-42ef-4c80-8f6c-104e3232c0f1 tempest-VolumesGetTest-459511347 None] Creating volume glance metadata for volume 1c99042e-c676-48ac-9418-16f26e7e0042 backed by image 2681f5d8-1c86-4dfd-86fb-c29aaed49dc6 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '2681f5d8-1c86-4dfd-86fb-c29aaed49dc6', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=94394) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 26 14:31:07 devstack sudo[106242]: pam_unix(sudo:session): session closed for user root Aug 26 14:31:07 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-d46a9552-42ef-4c80-8f6c-104e3232c0f1 tempest-VolumesGetTest-459511347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1da1712a-1c80-4e00-b242-3e21b44cbd6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c99042e-c676-48ac-9418-16f26e7e0042', 'volume_size': 1, 'image_id': '2681f5d8-1c86-4dfd-86fb-c29aaed49dc6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2681f5d8-1c86-4dfd-86fb-c29aaed49dc6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cbf977c46caa48c18e414079bf75016d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2681f5d8-1c86-4dfd-86fb-c29aaed49dc6', 'created_at': datetime.datetime(2026, 8, 26, 12, 16, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 12, 16, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2681f5d8-1c86-4dfd-86fb-c29aaed49dc6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:31:07 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-d46a9552-42ef-4c80-8f6c-104e3232c0f1 tempest-VolumesGetTest-459511347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (607b07ad-fc26-48a0-87d6-9ad17f9d7800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:31:07 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-122a8c8f-0ab3-4650-b287-569ac4b19093 tempest-SnapshotsActionsTest-695899691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943" returned: 0 in 0.389s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:31:07 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-122a8c8f-0ab3-4650-b287-569ac4b19093 tempest-SnapshotsActionsTest-695899691 None] Lock "cinder-quobyte-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943" released by "delete_volume" :: held 1.193s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:31:07 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-d46a9552-42ef-4c80-8f6c-104e3232c0f1 tempest-VolumesGetTest-459511347 None] Volume volume-1c99042e-c676-48ac-9418-16f26e7e0042 (1c99042e-c676-48ac-9418-16f26e7e0042): created successfully Aug 26 14:31:07 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-d46a9552-42ef-4c80-8f6c-104e3232c0f1 tempest-VolumesGetTest-459511347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (607b07ad-fc26-48a0-87d6-9ad17f9d7800) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:31:07 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-d46a9552-42ef-4c80-8f6c-104e3232c0f1 tempest-VolumesGetTest-459511347 None] Flow 'volume_create_manager' (c48754b3-fdf4-41b8-91c3-4dc50c4e1347) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:31:07 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-d46a9552-42ef-4c80-8f6c-104e3232c0f1 tempest-VolumesGetTest-459511347 None] Created volume successfully. Aug 26 14:31:07 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-122a8c8f-0ab3-4650-b287-569ac4b19093 tempest-SnapshotsActionsTest-695899691 None] Created reservations ['f3479a15-d886-4ddb-b5cc-1eda6f792f23', 'a84a3e0a-d1c4-4eb4-86d8-f9ea91d21a02', 'a8ce0840-0e78-48fe-9d8c-ca694987ede1', '4a142cd6-1e0e-4fa8-a809-4a9d2a156825'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:31:07 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-122a8c8f-0ab3-4650-b287-569ac4b19093 tempest-SnapshotsActionsTest-695899691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:31:07 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-122a8c8f-0ab3-4650-b287-569ac4b19093 tempest-SnapshotsActionsTest-695899691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:31:07 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-122a8c8f-0ab3-4650-b287-569ac4b19093 tempest-SnapshotsActionsTest-695899691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:31:07 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-122a8c8f-0ab3-4650-b287-569ac4b19093 tempest-SnapshotsActionsTest-695899691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:31:07 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-122a8c8f-0ab3-4650-b287-569ac4b19093 tempest-SnapshotsActionsTest-695899691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:31:07 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-122a8c8f-0ab3-4650-b287-569ac4b19093 tempest-SnapshotsActionsTest-695899691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:31:07 devstack sudo[106268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:31:07 devstack sudo[106268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:31:07 devstack sudo[106268]: pam_unix(sudo:session): session closed for user root Aug 26 14:31:07 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-122a8c8f-0ab3-4650-b287-569ac4b19093 tempest-SnapshotsActionsTest-695899691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.269s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:31:07 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-122a8c8f-0ab3-4650-b287-569ac4b19093 tempest-SnapshotsActionsTest-695899691 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:31:07 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-122a8c8f-0ab3-4650-b287-569ac4b19093 tempest-SnapshotsActionsTest-695899691 None] Deleted volume successfully. Aug 26 14:31:07 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-122a8c8f-0ab3-4650-b287-569ac4b19093 tempest-SnapshotsActionsTest-695899691 None] Lock "cinder-4fb30b4d-fd01-4922-b4e3-7bb6dfb45943-delete_volume" released by "delete_volume" :: held 1.899s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:31:09 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fffc4fa-b605-464b-8d39-498d1a119169 tempest-VolumesGetTest-459511347 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:31:09 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-4fffc4fa-b605-464b-8d39-498d1a119169 tempest-VolumesGetTest-459511347 None] Flow 'volume_create_manager' (11ecd2c8-b0de-4941-bf25-1c2cd8f34d1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:31:09 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-4fffc4fa-b605-464b-8d39-498d1a119169 tempest-VolumesGetTest-459511347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d10a303d-051e-4b67-9558-a0f18a268350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:31:09 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-4fffc4fa-b605-464b-8d39-498d1a119169 tempest-VolumesGetTest-459511347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d10a303d-051e-4b67-9558-a0f18a268350) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:31:09Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1263468846',display_name='tempest-VolumesGetTest-Volume-48835565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cbe21bd-c39e-4564-97a6-7185c6d10d88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2563771eca7848979f10833a8a104f6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:31:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:31:09Z,use_quota=True,user_id='f811ce7459cc4202a99345871cc95ded',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:31:09 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-4fffc4fa-b605-464b-8d39-498d1a119169 tempest-VolumesGetTest-459511347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1597f3c4-9234-4e2c-ab4f-f931f7dbf20e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:31:09 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-4fffc4fa-b605-464b-8d39-498d1a119169 tempest-VolumesGetTest-459511347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1597f3c4-9234-4e2c-ab4f-f931f7dbf20e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:31:09 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-4fffc4fa-b605-464b-8d39-498d1a119169 tempest-VolumesGetTest-459511347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61f715cf-ec4d-4809-b6d1-04a9f734d1d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:31:09 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-4fffc4fa-b605-464b-8d39-498d1a119169 tempest-VolumesGetTest-459511347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61f715cf-ec4d-4809-b6d1-04a9f734d1d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7cbe21bd-c39e-4564-97a6-7185c6d10d88', 'volume_name': 'volume-7cbe21bd-c39e-4564-97a6-7185c6d10d88', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:31:09 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-4fffc4fa-b605-464b-8d39-498d1a119169 tempest-VolumesGetTest-459511347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4ad3021-4883-4406-b50e-531faaab439e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:31:09 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-4fffc4fa-b605-464b-8d39-498d1a119169 tempest-VolumesGetTest-459511347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4ad3021-4883-4406-b50e-531faaab439e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:31:09 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-4fffc4fa-b605-464b-8d39-498d1a119169 tempest-VolumesGetTest-459511347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a124741-4af1-4be7-9907-729db893535f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:31:09 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-4fffc4fa-b605-464b-8d39-498d1a119169 tempest-VolumesGetTest-459511347 None] Volume 7cbe21bd-c39e-4564-97a6-7185c6d10d88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7cbe21bd-c39e-4564-97a6-7185c6d10d88', 'volume_size': 1} Aug 26 14:31:09 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-4fffc4fa-b605-464b-8d39-498d1a119169 tempest-VolumesGetTest-459511347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:31:09 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-4fffc4fa-b605-464b-8d39-498d1a119169 tempest-VolumesGetTest-459511347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:31:09 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-4fffc4fa-b605-464b-8d39-498d1a119169 tempest-VolumesGetTest-459511347 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:31:09Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1263468846',display_name='tempest-VolumesGetTest-Volume-48835565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cbe21bd-c39e-4564-97a6-7185c6d10d88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2563771eca7848979f10833a8a104f6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:31:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:31:09Z,use_quota=True,user_id='f811ce7459cc4202a99345871cc95ded',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:31:09 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-4fffc4fa-b605-464b-8d39-498d1a119169 tempest-VolumesGetTest-459511347 None] Creating volume 7cbe21bd-c39e-4564-97a6-7185c6d10d88 {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:31:09 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-4fffc4fa-b605-464b-8d39-498d1a119169 tempest-VolumesGetTest-459511347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:31:09 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-4fffc4fa-b605-464b-8d39-498d1a119169 tempest-VolumesGetTest-459511347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:31:09 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-4fffc4fa-b605-464b-8d39-498d1a119169 tempest-VolumesGetTest-459511347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:31:09 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-4fffc4fa-b605-464b-8d39-498d1a119169 tempest-VolumesGetTest-459511347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:31:09 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-4fffc4fa-b605-464b-8d39-498d1a119169 tempest-VolumesGetTest-459511347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:31:09 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-4fffc4fa-b605-464b-8d39-498d1a119169 tempest-VolumesGetTest-459511347 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:31:09 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-4fffc4fa-b605-464b-8d39-498d1a119169 tempest-VolumesGetTest-459511347 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:31:09 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4fffc4fa-b605-464b-8d39-498d1a119169 tempest-VolumesGetTest-459511347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-7cbe21bd-c39e-4564-97a6-7185c6d10d88 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:31:09 devstack sudo[106274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-7cbe21bd-c39e-4564-97a6-7185c6d10d88 1073741824 Aug 26 14:31:09 devstack sudo[106274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:31:10 devstack sudo[106274]: pam_unix(sudo:session): session closed for user root Aug 26 14:31:10 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4fffc4fa-b605-464b-8d39-498d1a119169 tempest-VolumesGetTest-459511347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-7cbe21bd-c39e-4564-97a6-7185c6d10d88 1073741824" returned: 0 in 0.692s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:31:10 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4fffc4fa-b605-464b-8d39-498d1a119169 tempest-VolumesGetTest-459511347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-7cbe21bd-c39e-4564-97a6-7185c6d10d88 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:31:10 devstack sudo[106281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-7cbe21bd-c39e-4564-97a6-7185c6d10d88 Aug 26 14:31:10 devstack sudo[106281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:31:10 devstack sudo[106281]: pam_unix(sudo:session): session closed for user root Aug 26 14:31:10 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4fffc4fa-b605-464b-8d39-498d1a119169 tempest-VolumesGetTest-459511347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-7cbe21bd-c39e-4564-97a6-7185c6d10d88" returned: 0 in 0.336s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:31:10 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-4fffc4fa-b605-464b-8d39-498d1a119169 tempest-VolumesGetTest-459511347 None] <== create_volume: return (1083ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:31:10 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-4fffc4fa-b605-464b-8d39-498d1a119169 tempest-VolumesGetTest-459511347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.086s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:31:10 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-4fffc4fa-b605-464b-8d39-498d1a119169 tempest-VolumesGetTest-459511347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a124741-4af1-4be7-9907-729db893535f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7cbe21bd-c39e-4564-97a6-7185c6d10d88', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:31:10 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-4fffc4fa-b605-464b-8d39-498d1a119169 tempest-VolumesGetTest-459511347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e220ff08-5095-4140-9602-e91cae8204ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:31:10 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-4fffc4fa-b605-464b-8d39-498d1a119169 tempest-VolumesGetTest-459511347 None] Volume volume-7cbe21bd-c39e-4564-97a6-7185c6d10d88 (7cbe21bd-c39e-4564-97a6-7185c6d10d88): created successfully Aug 26 14:31:10 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-4fffc4fa-b605-464b-8d39-498d1a119169 tempest-VolumesGetTest-459511347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e220ff08-5095-4140-9602-e91cae8204ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:31:10 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-4fffc4fa-b605-464b-8d39-498d1a119169 tempest-VolumesGetTest-459511347 None] Flow 'volume_create_manager' (11ecd2c8-b0de-4941-bf25-1c2cd8f34d1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:31:10 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-4fffc4fa-b605-464b-8d39-498d1a119169 tempest-VolumesGetTest-459511347 None] Created volume successfully. Aug 26 14:31:11 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-5358f26a-89bd-47aa-b266-bb9ec9844d73 tempest-VolumesGetTest-459511347 None] Acquiring lock "cinder-7cbe21bd-c39e-4564-97a6-7185c6d10d88-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:31:11 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-5358f26a-89bd-47aa-b266-bb9ec9844d73 tempest-VolumesGetTest-459511347 None] Lock "cinder-7cbe21bd-c39e-4564-97a6-7185c6d10d88-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:31:11 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-5358f26a-89bd-47aa-b266-bb9ec9844d73 tempest-VolumesGetTest-459511347 None] Acquiring lock "cinder-quobyte-7cbe21bd-c39e-4564-97a6-7185c6d10d88" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:31:11 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-5358f26a-89bd-47aa-b266-bb9ec9844d73 tempest-VolumesGetTest-459511347 None] Lock "cinder-quobyte-7cbe21bd-c39e-4564-97a6-7185c6d10d88" acquired by "delete_volume" :: waited 0.042s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:31:11 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[922ff04c-2f97-427f-b322-287561123df7]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:31:11 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-5358f26a-89bd-47aa-b266-bb9ec9844d73 tempest-VolumesGetTest-459511347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-7cbe21bd-c39e-4564-97a6-7185c6d10d88 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:31:11 devstack sudo[106284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-7cbe21bd-c39e-4564-97a6-7185c6d10d88 Aug 26 14:31:11 devstack sudo[106284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:31:12 devstack sudo[106284]: pam_unix(sudo:session): session closed for user root Aug 26 14:31:12 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-5358f26a-89bd-47aa-b266-bb9ec9844d73 tempest-VolumesGetTest-459511347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-7cbe21bd-c39e-4564-97a6-7185c6d10d88" returned: 0 in 0.464s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:31:12 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-5358f26a-89bd-47aa-b266-bb9ec9844d73 tempest-VolumesGetTest-459511347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-7cbe21bd-c39e-4564-97a6-7185c6d10d88 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:31:12 devstack sudo[106289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-7cbe21bd-c39e-4564-97a6-7185c6d10d88 Aug 26 14:31:12 devstack sudo[106289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:31:12 devstack sudo[106289]: pam_unix(sudo:session): session closed for user root Aug 26 14:31:12 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-5358f26a-89bd-47aa-b266-bb9ec9844d73 tempest-VolumesGetTest-459511347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-7cbe21bd-c39e-4564-97a6-7185c6d10d88" returned: 0 in 0.318s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:31:12 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-5358f26a-89bd-47aa-b266-bb9ec9844d73 tempest-VolumesGetTest-459511347 None] Lock "cinder-quobyte-7cbe21bd-c39e-4564-97a6-7185c6d10d88" released by "delete_volume" :: held 0.857s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:31:12 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-5358f26a-89bd-47aa-b266-bb9ec9844d73 tempest-VolumesGetTest-459511347 None] Created reservations ['f96febd4-3e3d-4904-bfc3-aef8fe1441ac', 'ee4dfbdb-efc9-4415-ac58-6fffc71df1a3', 'ce81b011-0471-4e03-870d-69adbdadfae4', '0c5217f4-4e7f-446e-b05b-65114a57d80d'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:31:12 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-5358f26a-89bd-47aa-b266-bb9ec9844d73 tempest-VolumesGetTest-459511347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:31:12 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-5358f26a-89bd-47aa-b266-bb9ec9844d73 tempest-VolumesGetTest-459511347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:31:12 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-5358f26a-89bd-47aa-b266-bb9ec9844d73 tempest-VolumesGetTest-459511347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:31:12 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-5358f26a-89bd-47aa-b266-bb9ec9844d73 tempest-VolumesGetTest-459511347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:31:12 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-5358f26a-89bd-47aa-b266-bb9ec9844d73 tempest-VolumesGetTest-459511347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:31:12 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-5358f26a-89bd-47aa-b266-bb9ec9844d73 tempest-VolumesGetTest-459511347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:31:12 devstack sudo[106295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:31:12 devstack sudo[106295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:31:13 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-e4b2248f-b2f4-42be-a8ef-383d0904ecf5 tempest-VolumesGetTest-459511347 None] Acquiring lock "cinder-1c99042e-c676-48ac-9418-16f26e7e0042-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:31:13 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-e4b2248f-b2f4-42be-a8ef-383d0904ecf5 tempest-VolumesGetTest-459511347 None] Lock "cinder-1c99042e-c676-48ac-9418-16f26e7e0042-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:31:13 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-e4b2248f-b2f4-42be-a8ef-383d0904ecf5 tempest-VolumesGetTest-459511347 None] Acquiring lock "cinder-quobyte-1c99042e-c676-48ac-9418-16f26e7e0042" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:31:13 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-e4b2248f-b2f4-42be-a8ef-383d0904ecf5 tempest-VolumesGetTest-459511347 None] Lock "cinder-quobyte-1c99042e-c676-48ac-9418-16f26e7e0042" acquired by "delete_volume" :: waited 0.023s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:31:13 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[195cabfb-75dc-4a8e-bf09-1555e36874c0]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:31:13 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e4b2248f-b2f4-42be-a8ef-383d0904ecf5 tempest-VolumesGetTest-459511347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-1c99042e-c676-48ac-9418-16f26e7e0042 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:31:13 devstack sudo[106295]: pam_unix(sudo:session): session closed for user root Aug 26 14:31:13 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-5358f26a-89bd-47aa-b266-bb9ec9844d73 tempest-VolumesGetTest-459511347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.419s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:31:13 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-5358f26a-89bd-47aa-b266-bb9ec9844d73 tempest-VolumesGetTest-459511347 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:31:13 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-5358f26a-89bd-47aa-b266-bb9ec9844d73 tempest-VolumesGetTest-459511347 None] Deleted volume successfully. Aug 26 14:31:13 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-5358f26a-89bd-47aa-b266-bb9ec9844d73 tempest-VolumesGetTest-459511347 None] Lock "cinder-7cbe21bd-c39e-4564-97a6-7185c6d10d88-delete_volume" released by "delete_volume" :: held 1.605s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:31:13 devstack sudo[106297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-1c99042e-c676-48ac-9418-16f26e7e0042 Aug 26 14:31:13 devstack sudo[106297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:31:13 devstack sudo[106297]: pam_unix(sudo:session): session closed for user root Aug 26 14:31:13 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e4b2248f-b2f4-42be-a8ef-383d0904ecf5 tempest-VolumesGetTest-459511347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-1c99042e-c676-48ac-9418-16f26e7e0042" returned: 0 in 0.593s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:31:13 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e4b2248f-b2f4-42be-a8ef-383d0904ecf5 tempest-VolumesGetTest-459511347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-1c99042e-c676-48ac-9418-16f26e7e0042 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:31:13 devstack sudo[106304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-1c99042e-c676-48ac-9418-16f26e7e0042 Aug 26 14:31:13 devstack sudo[106304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:31:14 devstack sudo[106304]: pam_unix(sudo:session): session closed for user root Aug 26 14:31:14 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e4b2248f-b2f4-42be-a8ef-383d0904ecf5 tempest-VolumesGetTest-459511347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-1c99042e-c676-48ac-9418-16f26e7e0042" returned: 0 in 0.402s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:31:14 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-e4b2248f-b2f4-42be-a8ef-383d0904ecf5 tempest-VolumesGetTest-459511347 None] Lock "cinder-quobyte-1c99042e-c676-48ac-9418-16f26e7e0042" released by "delete_volume" :: held 1.067s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:31:14 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-e4b2248f-b2f4-42be-a8ef-383d0904ecf5 tempest-VolumesGetTest-459511347 None] Created reservations ['3a7c2fb6-088a-4b57-bbc6-a6b769a610d6', '1764bcec-469c-43c8-a25e-18347391a63e', '599a669c-50c3-437b-a6c7-cf23b0862345', 'eab53861-9ac2-4836-87d2-4d295344e224'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:31:14 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e4b2248f-b2f4-42be-a8ef-383d0904ecf5 tempest-VolumesGetTest-459511347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:31:14 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e4b2248f-b2f4-42be-a8ef-383d0904ecf5 tempest-VolumesGetTest-459511347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:31:14 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-e4b2248f-b2f4-42be-a8ef-383d0904ecf5 tempest-VolumesGetTest-459511347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:31:14 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-e4b2248f-b2f4-42be-a8ef-383d0904ecf5 tempest-VolumesGetTest-459511347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:31:14 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e4b2248f-b2f4-42be-a8ef-383d0904ecf5 tempest-VolumesGetTest-459511347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:31:14 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e4b2248f-b2f4-42be-a8ef-383d0904ecf5 tempest-VolumesGetTest-459511347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:31:14 devstack sudo[106307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:31:14 devstack sudo[106307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:31:14 devstack sudo[106307]: pam_unix(sudo:session): session closed for user root Aug 26 14:31:14 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e4b2248f-b2f4-42be-a8ef-383d0904ecf5 tempest-VolumesGetTest-459511347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.424s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:31:14 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-e4b2248f-b2f4-42be-a8ef-383d0904ecf5 tempest-VolumesGetTest-459511347 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:31:14 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-e4b2248f-b2f4-42be-a8ef-383d0904ecf5 tempest-VolumesGetTest-459511347 None] Deleted volume successfully. Aug 26 14:31:14 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-e4b2248f-b2f4-42be-a8ef-383d0904ecf5 tempest-VolumesGetTest-459511347 None] Lock "cinder-1c99042e-c676-48ac-9418-16f26e7e0042-delete_volume" released by "delete_volume" :: held 1.846s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:31:17 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-3069ec43-0fb1-40b5-8568-c161426ad16b tempest-VolumesTransfersV357Test-78423730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:31:17 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-3069ec43-0fb1-40b5-8568-c161426ad16b tempest-VolumesTransfersV357Test-78423730 None] Flow 'volume_create_manager' (025b0760-2cc3-4782-ad5a-97daeeb76fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:31:17 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-3069ec43-0fb1-40b5-8568-c161426ad16b tempest-VolumesTransfersV357Test-78423730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20c004f1-e0f2-42aa-9029-da063283ea58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:31:17 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-3069ec43-0fb1-40b5-8568-c161426ad16b tempest-VolumesTransfersV357Test-78423730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20c004f1-e0f2-42aa-9029-da063283ea58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:31:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-438682913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c49fbc6-992c-4ead-8cb8-f97e50d7c3c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f9047259c8c451a834db637f15e9311',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:31:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:31:17Z,use_quota=True,user_id='552371934ae54b569ff48395f533031d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:31:17 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-3069ec43-0fb1-40b5-8568-c161426ad16b tempest-VolumesTransfersV357Test-78423730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4045fb0a-1517-45c6-a81f-676d1c10ab13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:31:17 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-3069ec43-0fb1-40b5-8568-c161426ad16b tempest-VolumesTransfersV357Test-78423730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4045fb0a-1517-45c6-a81f-676d1c10ab13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:31:17 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-3069ec43-0fb1-40b5-8568-c161426ad16b tempest-VolumesTransfersV357Test-78423730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43466eb2-17a4-4ab9-8477-61512c579dfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:31:17 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-3069ec43-0fb1-40b5-8568-c161426ad16b tempest-VolumesTransfersV357Test-78423730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43466eb2-17a4-4ab9-8477-61512c579dfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c49fbc6-992c-4ead-8cb8-f97e50d7c3c5', 'volume_name': 'volume-5c49fbc6-992c-4ead-8cb8-f97e50d7c3c5', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:31:17 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-3069ec43-0fb1-40b5-8568-c161426ad16b tempest-VolumesTransfersV357Test-78423730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2142719b-0e00-4999-8d9e-845e9575fece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:31:17 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-3069ec43-0fb1-40b5-8568-c161426ad16b tempest-VolumesTransfersV357Test-78423730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2142719b-0e00-4999-8d9e-845e9575fece) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:31:17 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-3069ec43-0fb1-40b5-8568-c161426ad16b tempest-VolumesTransfersV357Test-78423730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7629157-88ca-400f-a385-a0b8a9b1f8bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:31:17 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-3069ec43-0fb1-40b5-8568-c161426ad16b tempest-VolumesTransfersV357Test-78423730 None] Volume 5c49fbc6-992c-4ead-8cb8-f97e50d7c3c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c49fbc6-992c-4ead-8cb8-f97e50d7c3c5', 'volume_size': 1} Aug 26 14:31:17 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-3069ec43-0fb1-40b5-8568-c161426ad16b tempest-VolumesTransfersV357Test-78423730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:31:17 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-3069ec43-0fb1-40b5-8568-c161426ad16b tempest-VolumesTransfersV357Test-78423730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:31:17 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-3069ec43-0fb1-40b5-8568-c161426ad16b tempest-VolumesTransfersV357Test-78423730 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:31:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-438682913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c49fbc6-992c-4ead-8cb8-f97e50d7c3c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f9047259c8c451a834db637f15e9311',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:31:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:31:17Z,use_quota=True,user_id='552371934ae54b569ff48395f533031d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:31:17 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-3069ec43-0fb1-40b5-8568-c161426ad16b tempest-VolumesTransfersV357Test-78423730 None] Creating volume 5c49fbc6-992c-4ead-8cb8-f97e50d7c3c5 {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:31:17 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-3069ec43-0fb1-40b5-8568-c161426ad16b tempest-VolumesTransfersV357Test-78423730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:31:17 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-3069ec43-0fb1-40b5-8568-c161426ad16b tempest-VolumesTransfersV357Test-78423730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:31:17 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-3069ec43-0fb1-40b5-8568-c161426ad16b tempest-VolumesTransfersV357Test-78423730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:31:17 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-3069ec43-0fb1-40b5-8568-c161426ad16b tempest-VolumesTransfersV357Test-78423730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:31:17 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-3069ec43-0fb1-40b5-8568-c161426ad16b tempest-VolumesTransfersV357Test-78423730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:31:17 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-3069ec43-0fb1-40b5-8568-c161426ad16b tempest-VolumesTransfersV357Test-78423730 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:31:17 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-3069ec43-0fb1-40b5-8568-c161426ad16b tempest-VolumesTransfersV357Test-78423730 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:31:17 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-3069ec43-0fb1-40b5-8568-c161426ad16b tempest-VolumesTransfersV357Test-78423730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5c49fbc6-992c-4ead-8cb8-f97e50d7c3c5 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:31:17 devstack sudo[106328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5c49fbc6-992c-4ead-8cb8-f97e50d7c3c5 1073741824 Aug 26 14:31:17 devstack sudo[106328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:31:18 devstack sudo[106328]: pam_unix(sudo:session): session closed for user root Aug 26 14:31:18 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-3069ec43-0fb1-40b5-8568-c161426ad16b tempest-VolumesTransfersV357Test-78423730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5c49fbc6-992c-4ead-8cb8-f97e50d7c3c5 1073741824" returned: 0 in 0.971s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:31:18 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-3069ec43-0fb1-40b5-8568-c161426ad16b tempest-VolumesTransfersV357Test-78423730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5c49fbc6-992c-4ead-8cb8-f97e50d7c3c5 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:31:18 devstack sudo[106380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5c49fbc6-992c-4ead-8cb8-f97e50d7c3c5 Aug 26 14:31:18 devstack sudo[106380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:31:18 devstack sudo[106380]: pam_unix(sudo:session): session closed for user root Aug 26 14:31:18 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-3069ec43-0fb1-40b5-8568-c161426ad16b tempest-VolumesTransfersV357Test-78423730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5c49fbc6-992c-4ead-8cb8-f97e50d7c3c5" returned: 0 in 0.460s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:31:18 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-3069ec43-0fb1-40b5-8568-c161426ad16b tempest-VolumesTransfersV357Test-78423730 None] <== create_volume: return (1504ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:31:18 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-3069ec43-0fb1-40b5-8568-c161426ad16b tempest-VolumesTransfersV357Test-78423730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.510s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:31:18 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-3069ec43-0fb1-40b5-8568-c161426ad16b tempest-VolumesTransfersV357Test-78423730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7629157-88ca-400f-a385-a0b8a9b1f8bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c49fbc6-992c-4ead-8cb8-f97e50d7c3c5', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:31:18 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-3069ec43-0fb1-40b5-8568-c161426ad16b tempest-VolumesTransfersV357Test-78423730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a42019f2-203d-45db-9fe7-7138e1b610f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:31:19 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-3069ec43-0fb1-40b5-8568-c161426ad16b tempest-VolumesTransfersV357Test-78423730 None] Volume volume-5c49fbc6-992c-4ead-8cb8-f97e50d7c3c5 (5c49fbc6-992c-4ead-8cb8-f97e50d7c3c5): created successfully Aug 26 14:31:19 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-3069ec43-0fb1-40b5-8568-c161426ad16b tempest-VolumesTransfersV357Test-78423730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a42019f2-203d-45db-9fe7-7138e1b610f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:31:19 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-3069ec43-0fb1-40b5-8568-c161426ad16b tempest-VolumesTransfersV357Test-78423730 None] Flow 'volume_create_manager' (025b0760-2cc3-4782-ad5a-97daeeb76fc0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:31:19 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-3069ec43-0fb1-40b5-8568-c161426ad16b tempest-VolumesTransfersV357Test-78423730 None] Created volume successfully. Aug 26 14:31:20 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-ae2d9351-873c-4858-9636-50ac5b83a750 tempest-VolumesTransfersV357Test-1252408549 None] Transfer volume completed successfully. Aug 26 14:31:20 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-13683ca2-c3d6-401a-950c-3b2a9b197aa0 tempest-VolumesNegativeTest-859833229 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:31:20 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-13683ca2-c3d6-401a-950c-3b2a9b197aa0 tempest-VolumesNegativeTest-859833229 None] Flow 'volume_create_manager' (3d3d9b61-6011-4af8-8869-943f92635208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:31:20 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-13683ca2-c3d6-401a-950c-3b2a9b197aa0 tempest-VolumesNegativeTest-859833229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8caff0be-fc27-4f6b-b4b2-6ac92ab3b0a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:31:20 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-13683ca2-c3d6-401a-950c-3b2a9b197aa0 tempest-VolumesNegativeTest-859833229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8caff0be-fc27-4f6b-b4b2-6ac92ab3b0a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:31:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-222555910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05e690cf-785a-460d-82b6-ef017e54e6c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e74b002fdb024e10a9f1a300bc51bcc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:31:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:31:20Z,use_quota=True,user_id='2af174283f784ebab43ea78cc5c49d48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:31:20 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-13683ca2-c3d6-401a-950c-3b2a9b197aa0 tempest-VolumesNegativeTest-859833229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1fe86ef-1e7d-4871-8c49-3b366cf8e5c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:31:20 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-13683ca2-c3d6-401a-950c-3b2a9b197aa0 tempest-VolumesNegativeTest-859833229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1fe86ef-1e7d-4871-8c49-3b366cf8e5c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:31:20 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-13683ca2-c3d6-401a-950c-3b2a9b197aa0 tempest-VolumesNegativeTest-859833229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb39f47c-6c85-49e2-bed8-e681af68e7f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:31:20 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-13683ca2-c3d6-401a-950c-3b2a9b197aa0 tempest-VolumesNegativeTest-859833229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb39f47c-6c85-49e2-bed8-e681af68e7f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05e690cf-785a-460d-82b6-ef017e54e6c1', 'volume_name': 'volume-05e690cf-785a-460d-82b6-ef017e54e6c1', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:31:20 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-13683ca2-c3d6-401a-950c-3b2a9b197aa0 tempest-VolumesNegativeTest-859833229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5f8397b-38de-4876-b5a6-2607282685f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:31:20 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-13683ca2-c3d6-401a-950c-3b2a9b197aa0 tempest-VolumesNegativeTest-859833229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5f8397b-38de-4876-b5a6-2607282685f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:31:20 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-13683ca2-c3d6-401a-950c-3b2a9b197aa0 tempest-VolumesNegativeTest-859833229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50c0dc9f-7b63-4b14-a6fc-15f871a0fbdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:31:20 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-13683ca2-c3d6-401a-950c-3b2a9b197aa0 tempest-VolumesNegativeTest-859833229 None] Volume 05e690cf-785a-460d-82b6-ef017e54e6c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05e690cf-785a-460d-82b6-ef017e54e6c1', 'volume_size': 1} Aug 26 14:31:20 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-13683ca2-c3d6-401a-950c-3b2a9b197aa0 tempest-VolumesNegativeTest-859833229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:31:20 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-13683ca2-c3d6-401a-950c-3b2a9b197aa0 tempest-VolumesNegativeTest-859833229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:31:20 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-13683ca2-c3d6-401a-950c-3b2a9b197aa0 tempest-VolumesNegativeTest-859833229 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:31:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-222555910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05e690cf-785a-460d-82b6-ef017e54e6c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e74b002fdb024e10a9f1a300bc51bcc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:31:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:31:20Z,use_quota=True,user_id='2af174283f784ebab43ea78cc5c49d48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:31:20 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-13683ca2-c3d6-401a-950c-3b2a9b197aa0 tempest-VolumesNegativeTest-859833229 None] Creating volume 05e690cf-785a-460d-82b6-ef017e54e6c1 {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:31:20 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-13683ca2-c3d6-401a-950c-3b2a9b197aa0 tempest-VolumesNegativeTest-859833229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:31:20 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-13683ca2-c3d6-401a-950c-3b2a9b197aa0 tempest-VolumesNegativeTest-859833229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:31:20 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-13683ca2-c3d6-401a-950c-3b2a9b197aa0 tempest-VolumesNegativeTest-859833229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:31:20 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-13683ca2-c3d6-401a-950c-3b2a9b197aa0 tempest-VolumesNegativeTest-859833229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:31:20 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-13683ca2-c3d6-401a-950c-3b2a9b197aa0 tempest-VolumesNegativeTest-859833229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:31:20 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-13683ca2-c3d6-401a-950c-3b2a9b197aa0 tempest-VolumesNegativeTest-859833229 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:31:20 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-13683ca2-c3d6-401a-950c-3b2a9b197aa0 tempest-VolumesNegativeTest-859833229 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:31:20 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-13683ca2-c3d6-401a-950c-3b2a9b197aa0 tempest-VolumesNegativeTest-859833229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-05e690cf-785a-460d-82b6-ef017e54e6c1 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:31:20 devstack sudo[106422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-05e690cf-785a-460d-82b6-ef017e54e6c1 1073741824 Aug 26 14:31:20 devstack sudo[106422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:31:21 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-578a7eb9-d9ec-466c-be52-326e578ffc69 tempest-VolumesTransfersV357Test-1981712435 None] Acquiring lock "cinder-5c49fbc6-992c-4ead-8cb8-f97e50d7c3c5-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:31:21 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-578a7eb9-d9ec-466c-be52-326e578ffc69 tempest-VolumesTransfersV357Test-1981712435 None] Lock "cinder-5c49fbc6-992c-4ead-8cb8-f97e50d7c3c5-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:31:21 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-578a7eb9-d9ec-466c-be52-326e578ffc69 tempest-VolumesTransfersV357Test-1981712435 None] Acquiring lock "cinder-quobyte-5c49fbc6-992c-4ead-8cb8-f97e50d7c3c5" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:31:21 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-578a7eb9-d9ec-466c-be52-326e578ffc69 tempest-VolumesTransfersV357Test-1981712435 None] Lock "cinder-quobyte-5c49fbc6-992c-4ead-8cb8-f97e50d7c3c5" acquired by "delete_volume" :: waited 0.029s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:31:21 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cbe9fa4-94dd-40d8-aa5b-ac998eb3859d]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:31:21 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-578a7eb9-d9ec-466c-be52-326e578ffc69 tempest-VolumesTransfersV357Test-1981712435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5c49fbc6-992c-4ead-8cb8-f97e50d7c3c5 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:31:21 devstack sudo[106422]: pam_unix(sudo:session): session closed for user root Aug 26 14:31:21 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-13683ca2-c3d6-401a-950c-3b2a9b197aa0 tempest-VolumesNegativeTest-859833229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-05e690cf-785a-460d-82b6-ef017e54e6c1 1073741824" returned: 0 in 1.030s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:31:21 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-13683ca2-c3d6-401a-950c-3b2a9b197aa0 tempest-VolumesNegativeTest-859833229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-05e690cf-785a-460d-82b6-ef017e54e6c1 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:31:21 devstack sudo[106430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-05e690cf-785a-460d-82b6-ef017e54e6c1 Aug 26 14:31:21 devstack sudo[106430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:31:21 devstack sudo[106429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5c49fbc6-992c-4ead-8cb8-f97e50d7c3c5 Aug 26 14:31:21 devstack sudo[106429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:31:21 devstack sudo[106430]: pam_unix(sudo:session): session closed for user root Aug 26 14:31:21 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-13683ca2-c3d6-401a-950c-3b2a9b197aa0 tempest-VolumesNegativeTest-859833229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-05e690cf-785a-460d-82b6-ef017e54e6c1" returned: 0 in 0.309s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:31:21 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-13683ca2-c3d6-401a-950c-3b2a9b197aa0 tempest-VolumesNegativeTest-859833229 None] <== create_volume: return (1414ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:31:21 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-13683ca2-c3d6-401a-950c-3b2a9b197aa0 tempest-VolumesNegativeTest-859833229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.419s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:31:21 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-13683ca2-c3d6-401a-950c-3b2a9b197aa0 tempest-VolumesNegativeTest-859833229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50c0dc9f-7b63-4b14-a6fc-15f871a0fbdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05e690cf-785a-460d-82b6-ef017e54e6c1', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:31:21 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-13683ca2-c3d6-401a-950c-3b2a9b197aa0 tempest-VolumesNegativeTest-859833229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ccc19e5-6564-4047-992b-15b6164da4dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:31:21 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-13683ca2-c3d6-401a-950c-3b2a9b197aa0 tempest-VolumesNegativeTest-859833229 None] Volume volume-05e690cf-785a-460d-82b6-ef017e54e6c1 (05e690cf-785a-460d-82b6-ef017e54e6c1): created successfully Aug 26 14:31:21 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-13683ca2-c3d6-401a-950c-3b2a9b197aa0 tempest-VolumesNegativeTest-859833229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ccc19e5-6564-4047-992b-15b6164da4dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:31:21 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-13683ca2-c3d6-401a-950c-3b2a9b197aa0 tempest-VolumesNegativeTest-859833229 None] Flow 'volume_create_manager' (3d3d9b61-6011-4af8-8869-943f92635208) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:31:21 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-13683ca2-c3d6-401a-950c-3b2a9b197aa0 tempest-VolumesNegativeTest-859833229 None] Created volume successfully. Aug 26 14:31:21 devstack sudo[106429]: pam_unix(sudo:session): session closed for user root Aug 26 14:31:21 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-578a7eb9-d9ec-466c-be52-326e578ffc69 tempest-VolumesTransfersV357Test-1981712435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5c49fbc6-992c-4ead-8cb8-f97e50d7c3c5" returned: 0 in 0.546s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:31:21 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-578a7eb9-d9ec-466c-be52-326e578ffc69 tempest-VolumesTransfersV357Test-1981712435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5c49fbc6-992c-4ead-8cb8-f97e50d7c3c5 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:31:22 devstack sudo[106438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5c49fbc6-992c-4ead-8cb8-f97e50d7c3c5 Aug 26 14:31:22 devstack sudo[106438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:31:22 devstack sudo[106438]: pam_unix(sudo:session): session closed for user root Aug 26 14:31:22 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-578a7eb9-d9ec-466c-be52-326e578ffc69 tempest-VolumesTransfersV357Test-1981712435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5c49fbc6-992c-4ead-8cb8-f97e50d7c3c5" returned: 0 in 0.300s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:31:22 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-578a7eb9-d9ec-466c-be52-326e578ffc69 tempest-VolumesTransfersV357Test-1981712435 None] Lock "cinder-quobyte-5c49fbc6-992c-4ead-8cb8-f97e50d7c3c5" released by "delete_volume" :: held 0.928s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:31:22 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-578a7eb9-d9ec-466c-be52-326e578ffc69 tempest-VolumesTransfersV357Test-1981712435 None] Created reservations ['586d7542-0026-45ea-8e94-325cc58445c0', '150ffad1-e2ca-49bb-8686-35115a07e33e', '3722474f-8d10-42ae-84a9-dd746258761b', '3ea2f8ec-cc32-4d82-bb1a-30648e0b583e'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:31:22 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-578a7eb9-d9ec-466c-be52-326e578ffc69 tempest-VolumesTransfersV357Test-1981712435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:31:22 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-578a7eb9-d9ec-466c-be52-326e578ffc69 tempest-VolumesTransfersV357Test-1981712435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:31:22 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-578a7eb9-d9ec-466c-be52-326e578ffc69 tempest-VolumesTransfersV357Test-1981712435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:31:22 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-578a7eb9-d9ec-466c-be52-326e578ffc69 tempest-VolumesTransfersV357Test-1981712435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:31:22 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-578a7eb9-d9ec-466c-be52-326e578ffc69 tempest-VolumesTransfersV357Test-1981712435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:31:22 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-578a7eb9-d9ec-466c-be52-326e578ffc69 tempest-VolumesTransfersV357Test-1981712435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:31:22 devstack sudo[106441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:31:22 devstack sudo[106441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:31:22 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-6c591853-ed6b-44b5-8941-45e429504f69 tempest-VolumesActionsTest-1373378216 None] Acquiring lock "cinder-769b1fcf-df65-43df-a84e-9624e84e9bf1" by "attach_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:31:22 devstack sudo[106441]: pam_unix(sudo:session): session closed for user root Aug 26 14:31:22 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-578a7eb9-d9ec-466c-be52-326e578ffc69 tempest-VolumesTransfersV357Test-1981712435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.381s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:31:22 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-578a7eb9-d9ec-466c-be52-326e578ffc69 tempest-VolumesTransfersV357Test-1981712435 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:31:22 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-6c591853-ed6b-44b5-8941-45e429504f69 tempest-VolumesActionsTest-1373378216 None] Lock "cinder-769b1fcf-df65-43df-a84e-9624e84e9bf1" acquired by "attach_volume" :: waited 0.026s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:31:22 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-578a7eb9-d9ec-466c-be52-326e578ffc69 tempest-VolumesTransfersV357Test-1981712435 None] Deleted volume successfully. Aug 26 14:31:22 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-578a7eb9-d9ec-466c-be52-326e578ffc69 tempest-VolumesTransfersV357Test-1981712435 None] Lock "cinder-5c49fbc6-992c-4ead-8cb8-f97e50d7c3c5-delete_volume" released by "delete_volume" :: held 1.752s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:31:23 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-6c591853-ed6b-44b5-8941-45e429504f69 tempest-VolumesActionsTest-1373378216 None] Attaching volume 769b1fcf-df65-43df-a84e-9624e84e9bf1 to instance 8df86667-f01d-4083-9f9a-56ec0257176c at mountpoint /dev/vdb on host None. Aug 26 14:31:23 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-6c591853-ed6b-44b5-8941-45e429504f69 tempest-VolumesActionsTest-1373378216 None] Attach volume completed successfully. Aug 26 14:31:23 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-6c591853-ed6b-44b5-8941-45e429504f69 tempest-VolumesActionsTest-1373378216 None] Lock "cinder-769b1fcf-df65-43df-a84e-9624e84e9bf1" released by "attach_volume" :: held 0.121s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:31:23 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-9f6d74ce-d973-4afa-a242-e2153946ad53 tempest-VolumesActionsTest-1373378216 None] Acquiring lock "cinder-769b1fcf-df65-43df-a84e-9624e84e9bf1-detach_volume" by "detach_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:31:23 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-9f6d74ce-d973-4afa-a242-e2153946ad53 tempest-VolumesActionsTest-1373378216 None] Lock "cinder-769b1fcf-df65-43df-a84e-9624e84e9bf1-detach_volume" acquired by "detach_volume" :: waited 0.025s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:31:23 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-9f6d74ce-d973-4afa-a242-e2153946ad53 tempest-VolumesActionsTest-1373378216 None] Detaching volume 769b1fcf-df65-43df-a84e-9624e84e9bf1 from instance 8df86667-f01d-4083-9f9a-56ec0257176c. Aug 26 14:31:23 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-9f6d74ce-d973-4afa-a242-e2153946ad53 tempest-VolumesActionsTest-1373378216 None] Detach volume completed successfully. Aug 26 14:31:23 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-9f6d74ce-d973-4afa-a242-e2153946ad53 tempest-VolumesActionsTest-1373378216 None] Lock "cinder-769b1fcf-df65-43df-a84e-9624e84e9bf1-detach_volume" released by "detach_volume" :: held 0.109s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:31:24 devstack cinder-volume[94394]: DEBUG dbcounter [-] [94394] Writing DB stats cinder:UPDATE=195,cinder:SELECT=173,cinder:INSERT=58,cinder:DELETE=10 {{(pid=94394) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 14:31:24 devstack cinder-volume[94394]: DEBUG dbcounter [-] [94394] Writing DB stats cinder:UPDATE=202,cinder:DELETE=24,cinder:SELECT=161,cinder:INSERT=65 {{(pid=94394) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 14:31:24 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-63e62bda-a50f-4fdb-abf6-e4c7388da580 tempest-VolumesTransfersV357Test-78423730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:31:24 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-63e62bda-a50f-4fdb-abf6-e4c7388da580 tempest-VolumesTransfersV357Test-78423730 None] Flow 'volume_create_manager' (60f18dae-b218-414b-96fb-1de3307ad256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:31:24 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-63e62bda-a50f-4fdb-abf6-e4c7388da580 tempest-VolumesTransfersV357Test-78423730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (015bc91d-390b-47a4-90df-b29e2674225e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:31:24 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-63e62bda-a50f-4fdb-abf6-e4c7388da580 tempest-VolumesTransfersV357Test-78423730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (015bc91d-390b-47a4-90df-b29e2674225e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:31:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1680114437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45e0db49-aad0-4a9f-8a0d-7f16a4e0c961,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f9047259c8c451a834db637f15e9311',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:31:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:31:25Z,use_quota=True,user_id='552371934ae54b569ff48395f533031d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:31:24 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-63e62bda-a50f-4fdb-abf6-e4c7388da580 tempest-VolumesTransfersV357Test-78423730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (922e095d-0823-4c02-b727-29c2d665e5f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:31:24 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-63e62bda-a50f-4fdb-abf6-e4c7388da580 tempest-VolumesTransfersV357Test-78423730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (922e095d-0823-4c02-b727-29c2d665e5f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:31:24 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-63e62bda-a50f-4fdb-abf6-e4c7388da580 tempest-VolumesTransfersV357Test-78423730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ea3aa48-f316-4ec9-8818-c574ed994840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:31:24 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-63e62bda-a50f-4fdb-abf6-e4c7388da580 tempest-VolumesTransfersV357Test-78423730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ea3aa48-f316-4ec9-8818-c574ed994840) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45e0db49-aad0-4a9f-8a0d-7f16a4e0c961', 'volume_name': 'volume-45e0db49-aad0-4a9f-8a0d-7f16a4e0c961', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:31:24 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-63e62bda-a50f-4fdb-abf6-e4c7388da580 tempest-VolumesTransfersV357Test-78423730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b829534-d851-4dad-94e7-5674187d02f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:31:24 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-63e62bda-a50f-4fdb-abf6-e4c7388da580 tempest-VolumesTransfersV357Test-78423730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b829534-d851-4dad-94e7-5674187d02f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:31:24 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-63e62bda-a50f-4fdb-abf6-e4c7388da580 tempest-VolumesTransfersV357Test-78423730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7eae07d-108a-49e2-902e-7762752c3464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:31:24 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-63e62bda-a50f-4fdb-abf6-e4c7388da580 tempest-VolumesTransfersV357Test-78423730 None] Volume 45e0db49-aad0-4a9f-8a0d-7f16a4e0c961: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45e0db49-aad0-4a9f-8a0d-7f16a4e0c961', 'volume_size': 1} Aug 26 14:31:24 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-63e62bda-a50f-4fdb-abf6-e4c7388da580 tempest-VolumesTransfersV357Test-78423730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:31:24 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-63e62bda-a50f-4fdb-abf6-e4c7388da580 tempest-VolumesTransfersV357Test-78423730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:31:24 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-63e62bda-a50f-4fdb-abf6-e4c7388da580 tempest-VolumesTransfersV357Test-78423730 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:31:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1680114437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45e0db49-aad0-4a9f-8a0d-7f16a4e0c961,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f9047259c8c451a834db637f15e9311',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:31:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:31:25Z,use_quota=True,user_id='552371934ae54b569ff48395f533031d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:31:24 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-63e62bda-a50f-4fdb-abf6-e4c7388da580 tempest-VolumesTransfersV357Test-78423730 None] Creating volume 45e0db49-aad0-4a9f-8a0d-7f16a4e0c961 {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:31:24 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-63e62bda-a50f-4fdb-abf6-e4c7388da580 tempest-VolumesTransfersV357Test-78423730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:31:24 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-63e62bda-a50f-4fdb-abf6-e4c7388da580 tempest-VolumesTransfersV357Test-78423730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:31:24 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-63e62bda-a50f-4fdb-abf6-e4c7388da580 tempest-VolumesTransfersV357Test-78423730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:31:24 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-63e62bda-a50f-4fdb-abf6-e4c7388da580 tempest-VolumesTransfersV357Test-78423730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:31:24 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-63e62bda-a50f-4fdb-abf6-e4c7388da580 tempest-VolumesTransfersV357Test-78423730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:31:24 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-63e62bda-a50f-4fdb-abf6-e4c7388da580 tempest-VolumesTransfersV357Test-78423730 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:31:24 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-63e62bda-a50f-4fdb-abf6-e4c7388da580 tempest-VolumesTransfersV357Test-78423730 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:31:24 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-63e62bda-a50f-4fdb-abf6-e4c7388da580 tempest-VolumesTransfersV357Test-78423730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-45e0db49-aad0-4a9f-8a0d-7f16a4e0c961 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:31:25 devstack sudo[106470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-45e0db49-aad0-4a9f-8a0d-7f16a4e0c961 1073741824 Aug 26 14:31:25 devstack sudo[106470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:31:25 devstack sudo[106470]: pam_unix(sudo:session): session closed for user root Aug 26 14:31:25 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-63e62bda-a50f-4fdb-abf6-e4c7388da580 tempest-VolumesTransfersV357Test-78423730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-45e0db49-aad0-4a9f-8a0d-7f16a4e0c961 1073741824" returned: 0 in 0.768s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:31:25 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-63e62bda-a50f-4fdb-abf6-e4c7388da580 tempest-VolumesTransfersV357Test-78423730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-45e0db49-aad0-4a9f-8a0d-7f16a4e0c961 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:31:25 devstack sudo[106478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-45e0db49-aad0-4a9f-8a0d-7f16a4e0c961 Aug 26 14:31:25 devstack sudo[106478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:31:26 devstack sudo[106478]: pam_unix(sudo:session): session closed for user root Aug 26 14:31:26 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-63e62bda-a50f-4fdb-abf6-e4c7388da580 tempest-VolumesTransfersV357Test-78423730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-45e0db49-aad0-4a9f-8a0d-7f16a4e0c961" returned: 0 in 0.452s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:31:26 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-63e62bda-a50f-4fdb-abf6-e4c7388da580 tempest-VolumesTransfersV357Test-78423730 None] <== create_volume: return (1302ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:31:26 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-63e62bda-a50f-4fdb-abf6-e4c7388da580 tempest-VolumesTransfersV357Test-78423730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.310s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:31:26 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-63e62bda-a50f-4fdb-abf6-e4c7388da580 tempest-VolumesTransfersV357Test-78423730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7eae07d-108a-49e2-902e-7762752c3464) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45e0db49-aad0-4a9f-8a0d-7f16a4e0c961', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:31:26 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-63e62bda-a50f-4fdb-abf6-e4c7388da580 tempest-VolumesTransfersV357Test-78423730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9da9461-1dc5-4a0d-b07d-d453d8a8d352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:31:26 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-63e62bda-a50f-4fdb-abf6-e4c7388da580 tempest-VolumesTransfersV357Test-78423730 None] Volume volume-45e0db49-aad0-4a9f-8a0d-7f16a4e0c961 (45e0db49-aad0-4a9f-8a0d-7f16a4e0c961): created successfully Aug 26 14:31:26 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-63e62bda-a50f-4fdb-abf6-e4c7388da580 tempest-VolumesTransfersV357Test-78423730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9da9461-1dc5-4a0d-b07d-d453d8a8d352) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:31:26 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-63e62bda-a50f-4fdb-abf6-e4c7388da580 tempest-VolumesTransfersV357Test-78423730 None] Flow 'volume_create_manager' (60f18dae-b218-414b-96fb-1de3307ad256) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:31:26 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-63e62bda-a50f-4fdb-abf6-e4c7388da580 tempest-VolumesTransfersV357Test-78423730 None] Created volume successfully. Aug 26 14:31:27 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-5aaaaa6e-709c-42c8-b45f-49896d28cdd8 tempest-VolumesTransfersV357Test-1981712435 None] Acquiring lock "cinder-45e0db49-aad0-4a9f-8a0d-7f16a4e0c961-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:31:27 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-5aaaaa6e-709c-42c8-b45f-49896d28cdd8 tempest-VolumesTransfersV357Test-1981712435 None] Lock "cinder-45e0db49-aad0-4a9f-8a0d-7f16a4e0c961-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:31:27 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-5aaaaa6e-709c-42c8-b45f-49896d28cdd8 tempest-VolumesTransfersV357Test-1981712435 None] Acquiring lock "cinder-quobyte-45e0db49-aad0-4a9f-8a0d-7f16a4e0c961" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:31:27 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-5aaaaa6e-709c-42c8-b45f-49896d28cdd8 tempest-VolumesTransfersV357Test-1981712435 None] Lock "cinder-quobyte-45e0db49-aad0-4a9f-8a0d-7f16a4e0c961" acquired by "delete_volume" :: waited 0.019s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:31:27 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f137ae1-6031-4d66-9f37-9a0c3b876bec]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:31:27 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-5aaaaa6e-709c-42c8-b45f-49896d28cdd8 tempest-VolumesTransfersV357Test-1981712435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-45e0db49-aad0-4a9f-8a0d-7f16a4e0c961 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:31:27 devstack sudo[106534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-45e0db49-aad0-4a9f-8a0d-7f16a4e0c961 Aug 26 14:31:27 devstack sudo[106534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:31:27 devstack sudo[106534]: pam_unix(sudo:session): session closed for user root Aug 26 14:31:27 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-5aaaaa6e-709c-42c8-b45f-49896d28cdd8 tempest-VolumesTransfersV357Test-1981712435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-45e0db49-aad0-4a9f-8a0d-7f16a4e0c961" returned: 0 in 0.496s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:31:27 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-5aaaaa6e-709c-42c8-b45f-49896d28cdd8 tempest-VolumesTransfersV357Test-1981712435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-45e0db49-aad0-4a9f-8a0d-7f16a4e0c961 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:31:27 devstack sudo[106541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-45e0db49-aad0-4a9f-8a0d-7f16a4e0c961 Aug 26 14:31:27 devstack sudo[106541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:31:28 devstack sudo[106541]: pam_unix(sudo:session): session closed for user root Aug 26 14:31:28 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-5aaaaa6e-709c-42c8-b45f-49896d28cdd8 tempest-VolumesTransfersV357Test-1981712435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-45e0db49-aad0-4a9f-8a0d-7f16a4e0c961" returned: 0 in 0.279s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:31:28 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-5aaaaa6e-709c-42c8-b45f-49896d28cdd8 tempest-VolumesTransfersV357Test-1981712435 None] Lock "cinder-quobyte-45e0db49-aad0-4a9f-8a0d-7f16a4e0c961" released by "delete_volume" :: held 0.827s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:31:28 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-5aaaaa6e-709c-42c8-b45f-49896d28cdd8 tempest-VolumesTransfersV357Test-1981712435 None] Created reservations ['c040e2d0-674a-4856-8739-93168b253559', '14eb16db-383a-4689-9306-b5f2670cd2e3', '75a573ac-f2d8-4e72-8193-8261a21c6452', '74f4e10c-3e0b-4310-80b2-8732df4668e2'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:31:28 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-5aaaaa6e-709c-42c8-b45f-49896d28cdd8 tempest-VolumesTransfersV357Test-1981712435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:31:28 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-5aaaaa6e-709c-42c8-b45f-49896d28cdd8 tempest-VolumesTransfersV357Test-1981712435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:31:28 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-5aaaaa6e-709c-42c8-b45f-49896d28cdd8 tempest-VolumesTransfersV357Test-1981712435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:31:28 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-5aaaaa6e-709c-42c8-b45f-49896d28cdd8 tempest-VolumesTransfersV357Test-1981712435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:31:28 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-5aaaaa6e-709c-42c8-b45f-49896d28cdd8 tempest-VolumesTransfersV357Test-1981712435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:31:28 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-5aaaaa6e-709c-42c8-b45f-49896d28cdd8 tempest-VolumesTransfersV357Test-1981712435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:31:28 devstack sudo[106544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:31:28 devstack sudo[106544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:31:28 devstack sudo[106544]: pam_unix(sudo:session): session closed for user root Aug 26 14:31:28 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-5aaaaa6e-709c-42c8-b45f-49896d28cdd8 tempest-VolumesTransfersV357Test-1981712435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.351s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:31:28 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-5aaaaa6e-709c-42c8-b45f-49896d28cdd8 tempest-VolumesTransfersV357Test-1981712435 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:31:28 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-5aaaaa6e-709c-42c8-b45f-49896d28cdd8 tempest-VolumesTransfersV357Test-1981712435 None] Deleted volume successfully. Aug 26 14:31:28 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-5aaaaa6e-709c-42c8-b45f-49896d28cdd8 tempest-VolumesTransfersV357Test-1981712435 None] Lock "cinder-45e0db49-aad0-4a9f-8a0d-7f16a4e0c961-delete_volume" released by "delete_volume" :: held 1.442s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:31:31 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-fe2e0fbe-462a-4fdc-badb-50c9458cef6e tempest-VolumesActionsTest-1373378216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:31:31 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-fe2e0fbe-462a-4fdc-badb-50c9458cef6e tempest-VolumesActionsTest-1373378216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:31:31 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[771c4008-391c-4f01-b70e-088f73e283aa]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:31:31 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-fe2e0fbe-462a-4fdc-badb-50c9458cef6e tempest-VolumesActionsTest-1373378216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-769b1fcf-df65-43df-a84e-9624e84e9bf1 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:31:31 devstack sudo[106549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-769b1fcf-df65-43df-a84e-9624e84e9bf1 Aug 26 14:31:31 devstack sudo[106549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:31:31 devstack sudo[106549]: pam_unix(sudo:session): session closed for user root Aug 26 14:31:31 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-fe2e0fbe-462a-4fdc-badb-50c9458cef6e tempest-VolumesActionsTest-1373378216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-769b1fcf-df65-43df-a84e-9624e84e9bf1" returned: 0 in 0.687s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:31:31 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eb48200-8bdc-49f5-b460-b62875a4a436]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:31:31 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-fe2e0fbe-462a-4fdc-badb-50c9458cef6e tempest-VolumesActionsTest-1373378216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-769b1fcf-df65-43df-a84e-9624e84e9bf1 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:31:32 devstack sudo[106570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-769b1fcf-df65-43df-a84e-9624e84e9bf1 Aug 26 14:31:32 devstack sudo[106570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:31:32 devstack sudo[106570]: pam_unix(sudo:session): session closed for user root Aug 26 14:31:32 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-fe2e0fbe-462a-4fdc-badb-50c9458cef6e tempest-VolumesActionsTest-1373378216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-769b1fcf-df65-43df-a84e-9624e84e9bf1" returned: 0 in 0.707s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:31:32 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-fe2e0fbe-462a-4fdc-badb-50c9458cef6e tempest-VolumesActionsTest-1373378216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-769b1fcf-df65-43df-a84e-9624e84e9bf1 /opt/stack/data/cinder/conversion/769b1fcf-df65-43df-a84e-9624e84e9bf1.temp_image.478b43f4-b5af-4c3a-8929-caae090c3cbaz85av7ru.img {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:31:32 devstack sudo[106612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-769b1fcf-df65-43df-a84e-9624e84e9bf1 /opt/stack/data/cinder/conversion/769b1fcf-df65-43df-a84e-9624e84e9bf1.temp_image.478b43f4-b5af-4c3a-8929-caae090c3cbaz85av7ru.img Aug 26 14:31:32 devstack sudo[106612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:31:33 devstack cinder-volume[94394]: DEBUG oslo_service.periodic_task [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94394) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 14:31:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:31:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:31:33 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:31:33 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:31:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:31:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:31:33 devstack sudo[106645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:31:33 devstack sudo[106645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:31:34 devstack sudo[106645]: pam_unix(sudo:session): session closed for user root Aug 26 14:31:34 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.566s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:31:34 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:31:34 devstack cinder-volume[94394]: DEBUG oslo_service.periodic_task [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Running periodic task VolumeManager._thread_info {{(pid=94394) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 14:31:34 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] thread count: 28 {{(pid=94394) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 14:31:34 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] thread info: [<_MainThread(MainThread, started 126600738033792)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94394) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 14:31:40 devstack sudo[106612]: pam_unix(sudo:session): session closed for user root Aug 26 14:31:40 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-fe2e0fbe-462a-4fdc-badb-50c9458cef6e tempest-VolumesActionsTest-1373378216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-769b1fcf-df65-43df-a84e-9624e84e9bf1 /opt/stack/data/cinder/conversion/769b1fcf-df65-43df-a84e-9624e84e9bf1.temp_image.478b43f4-b5af-4c3a-8929-caae090c3cbaz85av7ru.img" returned: 0 in 7.916s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:31:40 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[98823a1a-0ed7-435d-a619-14f1360c708a]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:31:40 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-fe2e0fbe-462a-4fdc-badb-50c9458cef6e tempest-VolumesActionsTest-1373378216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-769b1fcf-df65-43df-a84e-9624e84e9bf1 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:31:40 devstack sudo[106677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-769b1fcf-df65-43df-a84e-9624e84e9bf1 Aug 26 14:31:40 devstack sudo[106677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:31:41 devstack sudo[106677]: pam_unix(sudo:session): session closed for user root Aug 26 14:31:41 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-fe2e0fbe-462a-4fdc-badb-50c9458cef6e tempest-VolumesActionsTest-1373378216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-769b1fcf-df65-43df-a84e-9624e84e9bf1" returned: 0 in 0.813s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:31:41 devstack cinder-volume[94394]: DEBUG cinder.image.image_utils [None req-fe2e0fbe-462a-4fdc-badb-50c9458cef6e tempest-VolumesActionsTest-1373378216 None] Image conversion details: src /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-769b1fcf-df65-43df-a84e-9624e84e9bf1, size 1024.00 MB, duration 7.92 sec, destination /opt/stack/data/cinder/conversion/769b1fcf-df65-43df-a84e-9624e84e9bf1.temp_image.478b43f4-b5af-4c3a-8929-caae090c3cbaz85av7ru.img {{(pid=94394) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 14:31:41 devstack cinder-volume[94394]: INFO cinder.image.image_utils [None req-fe2e0fbe-462a-4fdc-badb-50c9458cef6e tempest-VolumesActionsTest-1373378216 None] Converted 1024.00 MB image at 129.29 MB/s Aug 26 14:31:41 devstack cinder-volume[94394]: DEBUG cinder.image.image_utils [None req-fe2e0fbe-462a-4fdc-badb-50c9458cef6e tempest-VolumesActionsTest-1373378216 None] 478b43f4-b5af-4c3a-8929-caae090c3cba was raw, no need to convert to raw {{(pid=94394) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Aug 26 14:31:44 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce313c48-ac34-414e-9f4b-e77f9cb71304 tempest-VolumeRetypeWithoutMigrationTest-1990976658 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:31:44 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-ce313c48-ac34-414e-9f4b-e77f9cb71304 tempest-VolumeRetypeWithoutMigrationTest-1990976658 None] Flow 'volume_create_manager' (01c5574c-f79a-4040-8c60-400813f83263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:31:44 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-ce313c48-ac34-414e-9f4b-e77f9cb71304 tempest-VolumeRetypeWithoutMigrationTest-1990976658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (674ce406-5656-4083-8adb-0de7e1f37855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:31:44 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-ce313c48-ac34-414e-9f4b-e77f9cb71304 tempest-VolumeRetypeWithoutMigrationTest-1990976658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (674ce406-5656-4083-8adb-0de7e1f37855) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:31:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-412301483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c175f51d-6167-418d-a6cd-6929dfb38e0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80b42ba638e3440fba751f7aa063df23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:31:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:31:45Z,use_quota=True,user_id='cd2342a30d3e46d8a6878c9066be14c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8cda723a-9956-42fd-825f-33fad20e3ec1),volume_type_id=8cda723a-9956-42fd-825f-33fad20e3ec1)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:31:45 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-ce313c48-ac34-414e-9f4b-e77f9cb71304 tempest-VolumeRetypeWithoutMigrationTest-1990976658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dd6f0a9-3879-4395-8aa3-23df4df18bb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:31:45 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-ce313c48-ac34-414e-9f4b-e77f9cb71304 tempest-VolumeRetypeWithoutMigrationTest-1990976658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dd6f0a9-3879-4395-8aa3-23df4df18bb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:31:45 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-ce313c48-ac34-414e-9f4b-e77f9cb71304 tempest-VolumeRetypeWithoutMigrationTest-1990976658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (962691da-238f-4e3c-b89a-799a877c9f15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:31:45 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-ce313c48-ac34-414e-9f4b-e77f9cb71304 tempest-VolumeRetypeWithoutMigrationTest-1990976658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (962691da-238f-4e3c-b89a-799a877c9f15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c175f51d-6167-418d-a6cd-6929dfb38e0f', 'volume_name': 'volume-c175f51d-6167-418d-a6cd-6929dfb38e0f', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:31:45 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-ce313c48-ac34-414e-9f4b-e77f9cb71304 tempest-VolumeRetypeWithoutMigrationTest-1990976658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (515c3d07-d614-46ac-a33f-b2a7ccc5a0d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:31:45 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-ce313c48-ac34-414e-9f4b-e77f9cb71304 tempest-VolumeRetypeWithoutMigrationTest-1990976658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (515c3d07-d614-46ac-a33f-b2a7ccc5a0d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:31:45 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-ce313c48-ac34-414e-9f4b-e77f9cb71304 tempest-VolumeRetypeWithoutMigrationTest-1990976658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a58890d7-1321-46cf-bd37-698df2c5d7c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:31:45 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-ce313c48-ac34-414e-9f4b-e77f9cb71304 tempest-VolumeRetypeWithoutMigrationTest-1990976658 None] Volume c175f51d-6167-418d-a6cd-6929dfb38e0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c175f51d-6167-418d-a6cd-6929dfb38e0f', 'volume_size': 1} Aug 26 14:31:45 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-ce313c48-ac34-414e-9f4b-e77f9cb71304 tempest-VolumeRetypeWithoutMigrationTest-1990976658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:31:46 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f2d9066-5bf9-4e1f-836d-621debacc803 tempest-VolumesListTestJSON-1817162891 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:31:46 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-3f2d9066-5bf9-4e1f-836d-621debacc803 tempest-VolumesListTestJSON-1817162891 None] Flow 'volume_create_manager' (8849f9b0-e576-4cc2-a595-cfd7e41b6a4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:31:46 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-3f2d9066-5bf9-4e1f-836d-621debacc803 tempest-VolumesListTestJSON-1817162891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75c3302d-2169-4210-947a-be48755f26b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:31:46 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-3f2d9066-5bf9-4e1f-836d-621debacc803 tempest-VolumesListTestJSON-1817162891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75c3302d-2169-4210-947a-be48755f26b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:31:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1176568637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d69e0d1-bb72-4494-826c-472496ff005c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1b56d58d9a02406b9504de5d32d5491c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:31:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:31:47Z,use_quota=True,user_id='cd7447fdfabf41dcb627dc4094baacda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:31:46 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-3f2d9066-5bf9-4e1f-836d-621debacc803 tempest-VolumesListTestJSON-1817162891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9608741b-a084-41a3-ba49-7c609989d6ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:31:46 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-3f2d9066-5bf9-4e1f-836d-621debacc803 tempest-VolumesListTestJSON-1817162891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9608741b-a084-41a3-ba49-7c609989d6ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:31:46 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-3f2d9066-5bf9-4e1f-836d-621debacc803 tempest-VolumesListTestJSON-1817162891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12bc89cb-8d9c-48a1-97c6-f20ce5741153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:31:46 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-3f2d9066-5bf9-4e1f-836d-621debacc803 tempest-VolumesListTestJSON-1817162891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12bc89cb-8d9c-48a1-97c6-f20ce5741153) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d69e0d1-bb72-4494-826c-472496ff005c', 'volume_name': 'volume-6d69e0d1-bb72-4494-826c-472496ff005c', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:31:46 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-3f2d9066-5bf9-4e1f-836d-621debacc803 tempest-VolumesListTestJSON-1817162891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f133443a-977a-4035-a9c9-d7547bda21fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:31:46 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-3f2d9066-5bf9-4e1f-836d-621debacc803 tempest-VolumesListTestJSON-1817162891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f133443a-977a-4035-a9c9-d7547bda21fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:31:46 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-3f2d9066-5bf9-4e1f-836d-621debacc803 tempest-VolumesListTestJSON-1817162891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fd46bf7-2095-47a0-b003-1837887e9eae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:31:46 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-3f2d9066-5bf9-4e1f-836d-621debacc803 tempest-VolumesListTestJSON-1817162891 None] Volume 6d69e0d1-bb72-4494-826c-472496ff005c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d69e0d1-bb72-4494-826c-472496ff005c', 'volume_size': 1} Aug 26 14:31:46 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-3f2d9066-5bf9-4e1f-836d-621debacc803 tempest-VolumesListTestJSON-1817162891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:31:50 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-971361f6-2ae9-49a1-bc5c-115958395686 tempest-VolumesNegativeTest-859833229 None] Acquiring lock "cinder-05e690cf-785a-460d-82b6-ef017e54e6c1-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:31:50 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-971361f6-2ae9-49a1-bc5c-115958395686 tempest-VolumesNegativeTest-859833229 None] Lock "cinder-05e690cf-785a-460d-82b6-ef017e54e6c1-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:31:50 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-971361f6-2ae9-49a1-bc5c-115958395686 tempest-VolumesNegativeTest-859833229 None] Acquiring lock "cinder-quobyte-05e690cf-785a-460d-82b6-ef017e54e6c1" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:31:50 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-971361f6-2ae9-49a1-bc5c-115958395686 tempest-VolumesNegativeTest-859833229 None] Lock "cinder-quobyte-05e690cf-785a-460d-82b6-ef017e54e6c1" acquired by "delete_volume" :: waited 0.022s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:31:50 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fc6a14b-d5c5-4a6d-8400-9c39a76aa8d4]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:31:50 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-971361f6-2ae9-49a1-bc5c-115958395686 tempest-VolumesNegativeTest-859833229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-05e690cf-785a-460d-82b6-ef017e54e6c1 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:31:51 devstack sudo[106714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-05e690cf-785a-460d-82b6-ef017e54e6c1 Aug 26 14:31:51 devstack sudo[106714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:31:51 devstack sudo[106714]: pam_unix(sudo:session): session closed for user root Aug 26 14:31:51 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-971361f6-2ae9-49a1-bc5c-115958395686 tempest-VolumesNegativeTest-859833229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-05e690cf-785a-460d-82b6-ef017e54e6c1" returned: 0 in 0.410s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:31:51 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-971361f6-2ae9-49a1-bc5c-115958395686 tempest-VolumesNegativeTest-859833229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-05e690cf-785a-460d-82b6-ef017e54e6c1 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:31:51 devstack sudo[106719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-05e690cf-785a-460d-82b6-ef017e54e6c1 Aug 26 14:31:51 devstack sudo[106719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:31:51 devstack sudo[106719]: pam_unix(sudo:session): session closed for user root Aug 26 14:31:51 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-971361f6-2ae9-49a1-bc5c-115958395686 tempest-VolumesNegativeTest-859833229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-05e690cf-785a-460d-82b6-ef017e54e6c1" returned: 0 in 0.277s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:31:51 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-971361f6-2ae9-49a1-bc5c-115958395686 tempest-VolumesNegativeTest-859833229 None] Lock "cinder-quobyte-05e690cf-785a-460d-82b6-ef017e54e6c1" released by "delete_volume" :: held 0.739s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:31:51 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-971361f6-2ae9-49a1-bc5c-115958395686 tempest-VolumesNegativeTest-859833229 None] Created reservations ['0618a1a2-5c1e-4718-a460-5cce61cec4f9', 'f8fd5c14-6eb9-4bc9-8a5e-2c42e59b7536', '446c3eee-72f3-4ffc-b847-6441712db894', '859cf61d-0a0d-468f-a896-73c833c2a16a'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:31:51 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-971361f6-2ae9-49a1-bc5c-115958395686 tempest-VolumesNegativeTest-859833229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:31:51 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-971361f6-2ae9-49a1-bc5c-115958395686 tempest-VolumesNegativeTest-859833229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:31:51 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-971361f6-2ae9-49a1-bc5c-115958395686 tempest-VolumesNegativeTest-859833229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:31:51 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-971361f6-2ae9-49a1-bc5c-115958395686 tempest-VolumesNegativeTest-859833229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:31:51 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-971361f6-2ae9-49a1-bc5c-115958395686 tempest-VolumesNegativeTest-859833229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:31:51 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-971361f6-2ae9-49a1-bc5c-115958395686 tempest-VolumesNegativeTest-859833229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:31:51 devstack sudo[106722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:31:51 devstack sudo[106722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:31:52 devstack sudo[106722]: pam_unix(sudo:session): session closed for user root Aug 26 14:31:52 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-971361f6-2ae9-49a1-bc5c-115958395686 tempest-VolumesNegativeTest-859833229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.362s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:31:52 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-971361f6-2ae9-49a1-bc5c-115958395686 tempest-VolumesNegativeTest-859833229 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:31:52 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-971361f6-2ae9-49a1-bc5c-115958395686 tempest-VolumesNegativeTest-859833229 None] Deleted volume successfully. Aug 26 14:31:52 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-971361f6-2ae9-49a1-bc5c-115958395686 tempest-VolumesNegativeTest-859833229 None] Lock "cinder-05e690cf-785a-460d-82b6-ef017e54e6c1-delete_volume" released by "delete_volume" :: held 1.404s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:31:55 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbf3a364-8d72-4c12-a199-2730cc39ac74 tempest-VolumesSnapshotListTestJSON-172713543 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:31:55 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-fbf3a364-8d72-4c12-a199-2730cc39ac74 tempest-VolumesSnapshotListTestJSON-172713543 None] Flow 'volume_create_manager' (c981d525-c860-474b-9db5-89d86b1f7972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:31:55 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-fbf3a364-8d72-4c12-a199-2730cc39ac74 tempest-VolumesSnapshotListTestJSON-172713543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3758822-ecba-4be3-8f4c-f0afab00e4ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:31:55 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-fbf3a364-8d72-4c12-a199-2730cc39ac74 tempest-VolumesSnapshotListTestJSON-172713543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3758822-ecba-4be3-8f4c-f0afab00e4ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:31:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1195263735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=487d8b43-d726-4d30-8439-3a40d3a4d055,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d92a98740e534e12837af48a671b0361',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:31:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:31:55Z,use_quota=True,user_id='3bbbe5d7ec53455d8e111714ef8c7ab7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:31:55 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-fbf3a364-8d72-4c12-a199-2730cc39ac74 tempest-VolumesSnapshotListTestJSON-172713543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a653fe2-ef55-46ba-b120-640709c2a101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:31:55 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-fbf3a364-8d72-4c12-a199-2730cc39ac74 tempest-VolumesSnapshotListTestJSON-172713543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a653fe2-ef55-46ba-b120-640709c2a101) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:31:55 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-fbf3a364-8d72-4c12-a199-2730cc39ac74 tempest-VolumesSnapshotListTestJSON-172713543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97201328-c0ca-48b3-95ec-4066546aee97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:31:55 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-fbf3a364-8d72-4c12-a199-2730cc39ac74 tempest-VolumesSnapshotListTestJSON-172713543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97201328-c0ca-48b3-95ec-4066546aee97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '487d8b43-d726-4d30-8439-3a40d3a4d055', 'volume_name': 'volume-487d8b43-d726-4d30-8439-3a40d3a4d055', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:31:55 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-fbf3a364-8d72-4c12-a199-2730cc39ac74 tempest-VolumesSnapshotListTestJSON-172713543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a90c8860-3828-47ee-b6db-e88dc7001cda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:31:55 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-fbf3a364-8d72-4c12-a199-2730cc39ac74 tempest-VolumesSnapshotListTestJSON-172713543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a90c8860-3828-47ee-b6db-e88dc7001cda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:31:55 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-fbf3a364-8d72-4c12-a199-2730cc39ac74 tempest-VolumesSnapshotListTestJSON-172713543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c229b0ea-5060-4399-83a5-52a5915ac607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:31:55 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-fbf3a364-8d72-4c12-a199-2730cc39ac74 tempest-VolumesSnapshotListTestJSON-172713543 None] Volume 487d8b43-d726-4d30-8439-3a40d3a4d055: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-487d8b43-d726-4d30-8439-3a40d3a4d055', 'volume_size': 1} Aug 26 14:31:55 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-fbf3a364-8d72-4c12-a199-2730cc39ac74 tempest-VolumesSnapshotListTestJSON-172713543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:32:02 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-fe2e0fbe-462a-4fdc-badb-50c9458cef6e tempest-VolumesActionsTest-1373378216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 31.435s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:32:02 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-fe2e0fbe-462a-4fdc-badb-50c9458cef6e tempest-VolumesActionsTest-1373378216 None] Uploaded volume to glance image-id: 478b43f4-b5af-4c3a-8929-caae090c3cba. {{(pid=94394) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Aug 26 14:32:02 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-ce313c48-ac34-414e-9f4b-e77f9cb71304 tempest-VolumeRetypeWithoutMigrationTest-1990976658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 17.407s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:32:02 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-ce313c48-ac34-414e-9f4b-e77f9cb71304 tempest-VolumeRetypeWithoutMigrationTest-1990976658 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:31:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-412301483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c175f51d-6167-418d-a6cd-6929dfb38e0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80b42ba638e3440fba751f7aa063df23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:31:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:31:45Z,use_quota=True,user_id='cd2342a30d3e46d8a6878c9066be14c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8cda723a-9956-42fd-825f-33fad20e3ec1),volume_type_id=8cda723a-9956-42fd-825f-33fad20e3ec1)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:32:02 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-ce313c48-ac34-414e-9f4b-e77f9cb71304 tempest-VolumeRetypeWithoutMigrationTest-1990976658 None] Creating volume c175f51d-6167-418d-a6cd-6929dfb38e0f {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:32:02 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-ce313c48-ac34-414e-9f4b-e77f9cb71304 tempest-VolumeRetypeWithoutMigrationTest-1990976658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:32:02 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-ce313c48-ac34-414e-9f4b-e77f9cb71304 tempest-VolumeRetypeWithoutMigrationTest-1990976658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:32:02 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-ce313c48-ac34-414e-9f4b-e77f9cb71304 tempest-VolumeRetypeWithoutMigrationTest-1990976658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:32:02 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-ce313c48-ac34-414e-9f4b-e77f9cb71304 tempest-VolumeRetypeWithoutMigrationTest-1990976658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:32:02 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-ce313c48-ac34-414e-9f4b-e77f9cb71304 tempest-VolumeRetypeWithoutMigrationTest-1990976658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:32:02 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-ce313c48-ac34-414e-9f4b-e77f9cb71304 tempest-VolumeRetypeWithoutMigrationTest-1990976658 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:32:02 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-ce313c48-ac34-414e-9f4b-e77f9cb71304 tempest-VolumeRetypeWithoutMigrationTest-1990976658 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:32:02 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-ce313c48-ac34-414e-9f4b-e77f9cb71304 tempest-VolumeRetypeWithoutMigrationTest-1990976658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c175f51d-6167-418d-a6cd-6929dfb38e0f 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:32:02 devstack sudo[106727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c175f51d-6167-418d-a6cd-6929dfb38e0f 1073741824 Aug 26 14:32:02 devstack sudo[106727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:32:02 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-fe2e0fbe-462a-4fdc-badb-50c9458cef6e tempest-VolumesActionsTest-1373378216 None] Copy volume to image completed successfully. Aug 26 14:32:02 devstack sudo[106727]: pam_unix(sudo:session): session closed for user root Aug 26 14:32:02 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-ce313c48-ac34-414e-9f4b-e77f9cb71304 tempest-VolumeRetypeWithoutMigrationTest-1990976658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c175f51d-6167-418d-a6cd-6929dfb38e0f 1073741824" returned: 0 in 0.489s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:32:03 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-ce313c48-ac34-414e-9f4b-e77f9cb71304 tempest-VolumeRetypeWithoutMigrationTest-1990976658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c175f51d-6167-418d-a6cd-6929dfb38e0f {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:32:03 devstack sudo[106733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c175f51d-6167-418d-a6cd-6929dfb38e0f Aug 26 14:32:03 devstack sudo[106733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:32:03 devstack sudo[106733]: pam_unix(sudo:session): session closed for user root Aug 26 14:32:03 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-ce313c48-ac34-414e-9f4b-e77f9cb71304 tempest-VolumeRetypeWithoutMigrationTest-1990976658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c175f51d-6167-418d-a6cd-6929dfb38e0f" returned: 0 in 0.250s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:32:03 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-ce313c48-ac34-414e-9f4b-e77f9cb71304 tempest-VolumeRetypeWithoutMigrationTest-1990976658 None] <== create_volume: return (791ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:32:03 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-ce313c48-ac34-414e-9f4b-e77f9cb71304 tempest-VolumeRetypeWithoutMigrationTest-1990976658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.795s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:32:03 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-3f2d9066-5bf9-4e1f-836d-621debacc803 tempest-VolumesListTestJSON-1817162891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.486s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:32:03 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-3f2d9066-5bf9-4e1f-836d-621debacc803 tempest-VolumesListTestJSON-1817162891 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:31:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1176568637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d69e0d1-bb72-4494-826c-472496ff005c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1b56d58d9a02406b9504de5d32d5491c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:31:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:31:47Z,use_quota=True,user_id='cd7447fdfabf41dcb627dc4094baacda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:32:03 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-3f2d9066-5bf9-4e1f-836d-621debacc803 tempest-VolumesListTestJSON-1817162891 None] Creating volume 6d69e0d1-bb72-4494-826c-472496ff005c {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:32:03 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-3f2d9066-5bf9-4e1f-836d-621debacc803 tempest-VolumesListTestJSON-1817162891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:32:03 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-3f2d9066-5bf9-4e1f-836d-621debacc803 tempest-VolumesListTestJSON-1817162891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:32:03 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-3f2d9066-5bf9-4e1f-836d-621debacc803 tempest-VolumesListTestJSON-1817162891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:32:03 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-3f2d9066-5bf9-4e1f-836d-621debacc803 tempest-VolumesListTestJSON-1817162891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:32:03 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-3f2d9066-5bf9-4e1f-836d-621debacc803 tempest-VolumesListTestJSON-1817162891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:32:03 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-3f2d9066-5bf9-4e1f-836d-621debacc803 tempest-VolumesListTestJSON-1817162891 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:32:03 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-3f2d9066-5bf9-4e1f-836d-621debacc803 tempest-VolumesListTestJSON-1817162891 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:32:03 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-3f2d9066-5bf9-4e1f-836d-621debacc803 tempest-VolumesListTestJSON-1817162891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6d69e0d1-bb72-4494-826c-472496ff005c 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:32:03 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-ce313c48-ac34-414e-9f4b-e77f9cb71304 tempest-VolumeRetypeWithoutMigrationTest-1990976658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a58890d7-1321-46cf-bd37-698df2c5d7c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c175f51d-6167-418d-a6cd-6929dfb38e0f', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:32:03 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-ce313c48-ac34-414e-9f4b-e77f9cb71304 tempest-VolumeRetypeWithoutMigrationTest-1990976658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7428021-67b7-4b01-9217-233b5a2cb669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:32:03 devstack sudo[106736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6d69e0d1-bb72-4494-826c-472496ff005c 1073741824 Aug 26 14:32:03 devstack sudo[106736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:32:03 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-ce313c48-ac34-414e-9f4b-e77f9cb71304 tempest-VolumeRetypeWithoutMigrationTest-1990976658 None] Volume volume-c175f51d-6167-418d-a6cd-6929dfb38e0f (c175f51d-6167-418d-a6cd-6929dfb38e0f): created successfully Aug 26 14:32:03 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-ce313c48-ac34-414e-9f4b-e77f9cb71304 tempest-VolumeRetypeWithoutMigrationTest-1990976658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7428021-67b7-4b01-9217-233b5a2cb669) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:32:03 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-ce313c48-ac34-414e-9f4b-e77f9cb71304 tempest-VolumeRetypeWithoutMigrationTest-1990976658 None] Flow 'volume_create_manager' (01c5574c-f79a-4040-8c60-400813f83263) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:32:03 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-ce313c48-ac34-414e-9f4b-e77f9cb71304 tempest-VolumeRetypeWithoutMigrationTest-1990976658 None] Created volume successfully. Aug 26 14:32:03 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e7bbe56a-cf3a-48c9-bf3d-754afa64ecd5 tempest-VolumesActionsTest-1373378216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:32:03 devstack sudo[106736]: pam_unix(sudo:session): session closed for user root Aug 26 14:32:03 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-3f2d9066-5bf9-4e1f-836d-621debacc803 tempest-VolumesListTestJSON-1817162891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6d69e0d1-bb72-4494-826c-472496ff005c 1073741824" returned: 0 in 0.457s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:32:03 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-3f2d9066-5bf9-4e1f-836d-621debacc803 tempest-VolumesListTestJSON-1817162891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6d69e0d1-bb72-4494-826c-472496ff005c {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:32:03 devstack sudo[106742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6d69e0d1-bb72-4494-826c-472496ff005c Aug 26 14:32:03 devstack sudo[106742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:32:04 devstack sudo[106742]: pam_unix(sudo:session): session closed for user root Aug 26 14:32:04 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-3f2d9066-5bf9-4e1f-836d-621debacc803 tempest-VolumesListTestJSON-1817162891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6d69e0d1-bb72-4494-826c-472496ff005c" returned: 0 in 0.258s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:32:04 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-3f2d9066-5bf9-4e1f-836d-621debacc803 tempest-VolumesListTestJSON-1817162891 None] <== create_volume: return (752ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:32:04 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-3f2d9066-5bf9-4e1f-836d-621debacc803 tempest-VolumesListTestJSON-1817162891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.757s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:32:04 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-fbf3a364-8d72-4c12-a199-2730cc39ac74 tempest-VolumesSnapshotListTestJSON-172713543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.584s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:32:04 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-fbf3a364-8d72-4c12-a199-2730cc39ac74 tempest-VolumesSnapshotListTestJSON-172713543 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:31:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1195263735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=487d8b43-d726-4d30-8439-3a40d3a4d055,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d92a98740e534e12837af48a671b0361',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:31:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:31:55Z,use_quota=True,user_id='3bbbe5d7ec53455d8e111714ef8c7ab7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:32:04 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-fbf3a364-8d72-4c12-a199-2730cc39ac74 tempest-VolumesSnapshotListTestJSON-172713543 None] Creating volume 487d8b43-d726-4d30-8439-3a40d3a4d055 {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:32:04 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-fbf3a364-8d72-4c12-a199-2730cc39ac74 tempest-VolumesSnapshotListTestJSON-172713543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:32:04 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-fbf3a364-8d72-4c12-a199-2730cc39ac74 tempest-VolumesSnapshotListTestJSON-172713543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:32:04 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-fbf3a364-8d72-4c12-a199-2730cc39ac74 tempest-VolumesSnapshotListTestJSON-172713543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:32:04 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-fbf3a364-8d72-4c12-a199-2730cc39ac74 tempest-VolumesSnapshotListTestJSON-172713543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:32:04 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-fbf3a364-8d72-4c12-a199-2730cc39ac74 tempest-VolumesSnapshotListTestJSON-172713543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:32:04 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-fbf3a364-8d72-4c12-a199-2730cc39ac74 tempest-VolumesSnapshotListTestJSON-172713543 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:32:04 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-fbf3a364-8d72-4c12-a199-2730cc39ac74 tempest-VolumesSnapshotListTestJSON-172713543 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:32:04 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-fbf3a364-8d72-4c12-a199-2730cc39ac74 tempest-VolumesSnapshotListTestJSON-172713543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-487d8b43-d726-4d30-8439-3a40d3a4d055 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:32:04 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-3f2d9066-5bf9-4e1f-836d-621debacc803 tempest-VolumesListTestJSON-1817162891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fd46bf7-2095-47a0-b003-1837887e9eae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d69e0d1-bb72-4494-826c-472496ff005c', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:32:04 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-3f2d9066-5bf9-4e1f-836d-621debacc803 tempest-VolumesListTestJSON-1817162891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58d41627-260d-4360-ac8f-377782f13cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:32:04 devstack sudo[106745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-487d8b43-d726-4d30-8439-3a40d3a4d055 1073741824 Aug 26 14:32:04 devstack sudo[106745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:32:04 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-3f2d9066-5bf9-4e1f-836d-621debacc803 tempest-VolumesListTestJSON-1817162891 None] Volume volume-6d69e0d1-bb72-4494-826c-472496ff005c (6d69e0d1-bb72-4494-826c-472496ff005c): created successfully Aug 26 14:32:04 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-3f2d9066-5bf9-4e1f-836d-621debacc803 tempest-VolumesListTestJSON-1817162891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58d41627-260d-4360-ac8f-377782f13cb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:32:04 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-3f2d9066-5bf9-4e1f-836d-621debacc803 tempest-VolumesListTestJSON-1817162891 None] Flow 'volume_create_manager' (8849f9b0-e576-4cc2-a595-cfd7e41b6a4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:32:04 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-3f2d9066-5bf9-4e1f-836d-621debacc803 tempest-VolumesListTestJSON-1817162891 None] Created volume successfully. Aug 26 14:32:04 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-65cfa27f-d805-4106-ba03-5b1d7b00368e tempest-VolumeRetypeWithoutMigrationTest-1990976658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:32:04 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-65cfa27f-d805-4106-ba03-5b1d7b00368e tempest-VolumeRetypeWithoutMigrationTest-1990976658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:32:04 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-65cfa27f-d805-4106-ba03-5b1d7b00368e tempest-VolumeRetypeWithoutMigrationTest-1990976658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:32:04 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-65cfa27f-d805-4106-ba03-5b1d7b00368e tempest-VolumeRetypeWithoutMigrationTest-1990976658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:32:04 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-65cfa27f-d805-4106-ba03-5b1d7b00368e tempest-VolumeRetypeWithoutMigrationTest-1990976658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:32:04 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-65cfa27f-d805-4106-ba03-5b1d7b00368e tempest-VolumeRetypeWithoutMigrationTest-1990976658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:32:04 devstack sudo[106751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:32:04 devstack sudo[106751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:32:04 devstack sudo[106745]: pam_unix(sudo:session): session closed for user root Aug 26 14:32:04 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-fbf3a364-8d72-4c12-a199-2730cc39ac74 tempest-VolumesSnapshotListTestJSON-172713543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-487d8b43-d726-4d30-8439-3a40d3a4d055 1073741824" returned: 0 in 0.474s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:32:04 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-fbf3a364-8d72-4c12-a199-2730cc39ac74 tempest-VolumesSnapshotListTestJSON-172713543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-487d8b43-d726-4d30-8439-3a40d3a4d055 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:32:04 devstack sudo[106753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-487d8b43-d726-4d30-8439-3a40d3a4d055 Aug 26 14:32:04 devstack sudo[106753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:32:04 devstack sudo[106751]: pam_unix(sudo:session): session closed for user root Aug 26 14:32:04 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-65cfa27f-d805-4106-ba03-5b1d7b00368e tempest-VolumeRetypeWithoutMigrationTest-1990976658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.253s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:32:04 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-65cfa27f-d805-4106-ba03-5b1d7b00368e tempest-VolumeRetypeWithoutMigrationTest-1990976658 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:32:04 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-65cfa27f-d805-4106-ba03-5b1d7b00368e tempest-VolumeRetypeWithoutMigrationTest-1990976658 None] Retype volume completed successfully. Aug 26 14:32:04 devstack sudo[106753]: pam_unix(sudo:session): session closed for user root Aug 26 14:32:04 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-fbf3a364-8d72-4c12-a199-2730cc39ac74 tempest-VolumesSnapshotListTestJSON-172713543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-487d8b43-d726-4d30-8439-3a40d3a4d055" returned: 0 in 0.256s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:32:04 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-fbf3a364-8d72-4c12-a199-2730cc39ac74 tempest-VolumesSnapshotListTestJSON-172713543 None] <== create_volume: return (770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:32:04 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-fbf3a364-8d72-4c12-a199-2730cc39ac74 tempest-VolumesSnapshotListTestJSON-172713543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.773s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:32:04 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e7bbe56a-cf3a-48c9-bf3d-754afa64ecd5 tempest-VolumesActionsTest-1373378216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.220s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:32:04 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-fbf3a364-8d72-4c12-a199-2730cc39ac74 tempest-VolumesSnapshotListTestJSON-172713543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c229b0ea-5060-4399-83a5-52a5915ac607) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-487d8b43-d726-4d30-8439-3a40d3a4d055', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:32:04 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-fbf3a364-8d72-4c12-a199-2730cc39ac74 tempest-VolumesSnapshotListTestJSON-172713543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (771c9e32-9ec7-4fb9-a110-22a87f0c38f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:32:04 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[a68bf7d6-1201-4efe-a0a0-6d9ee4e241d3]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:32:04 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e7bbe56a-cf3a-48c9-bf3d-754afa64ecd5 tempest-VolumesActionsTest-1373378216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-769b1fcf-df65-43df-a84e-9624e84e9bf1 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:32:04 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-fbf3a364-8d72-4c12-a199-2730cc39ac74 tempest-VolumesSnapshotListTestJSON-172713543 None] Volume volume-487d8b43-d726-4d30-8439-3a40d3a4d055 (487d8b43-d726-4d30-8439-3a40d3a4d055): created successfully Aug 26 14:32:04 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-fbf3a364-8d72-4c12-a199-2730cc39ac74 tempest-VolumesSnapshotListTestJSON-172713543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (771c9e32-9ec7-4fb9-a110-22a87f0c38f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:32:04 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-fbf3a364-8d72-4c12-a199-2730cc39ac74 tempest-VolumesSnapshotListTestJSON-172713543 None] Flow 'volume_create_manager' (c981d525-c860-474b-9db5-89d86b1f7972) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:32:04 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-fbf3a364-8d72-4c12-a199-2730cc39ac74 tempest-VolumesSnapshotListTestJSON-172713543 None] Created volume successfully. Aug 26 14:32:04 devstack sudo[106757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-769b1fcf-df65-43df-a84e-9624e84e9bf1 Aug 26 14:32:04 devstack sudo[106757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:32:05 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-93f3a5c4-e60e-4930-ac1e-d33a940035da tempest-VolumesSnapshotListTestJSON-172713543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:32:05 devstack sudo[106757]: pam_unix(sudo:session): session closed for user root Aug 26 14:32:05 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e7bbe56a-cf3a-48c9-bf3d-754afa64ecd5 tempest-VolumesActionsTest-1373378216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-769b1fcf-df65-43df-a84e-9624e84e9bf1" returned: 0 in 0.401s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:32:05 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[f804b897-7f1e-4ae2-a8bf-9fe83c13d351]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:32:05 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e7bbe56a-cf3a-48c9-bf3d-754afa64ecd5 tempest-VolumesActionsTest-1373378216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-769b1fcf-df65-43df-a84e-9624e84e9bf1 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:32:05 devstack sudo[106762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-769b1fcf-df65-43df-a84e-9624e84e9bf1 Aug 26 14:32:05 devstack sudo[106762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:32:05 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-57924f44-293f-48ce-9e56-e9593bcffab6 tempest-VolumesListTestJSON-1817162891 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:32:05 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-57924f44-293f-48ce-9e56-e9593bcffab6 tempest-VolumesListTestJSON-1817162891 None] Flow 'volume_create_manager' (987e90b1-c75f-4d72-ac73-880eac91e273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:32:05 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-57924f44-293f-48ce-9e56-e9593bcffab6 tempest-VolumesListTestJSON-1817162891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1ea3448-061c-4d8a-91c7-42f10fc562d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:32:05 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-57924f44-293f-48ce-9e56-e9593bcffab6 tempest-VolumesListTestJSON-1817162891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1ea3448-061c-4d8a-91c7-42f10fc562d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:32:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-274528372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c35c82a-764a-43a5-8a35-687f1430813d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1b56d58d9a02406b9504de5d32d5491c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:32:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:32:05Z,use_quota=True,user_id='cd7447fdfabf41dcb627dc4094baacda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:32:05 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-57924f44-293f-48ce-9e56-e9593bcffab6 tempest-VolumesListTestJSON-1817162891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96113d47-392d-4e7d-8288-b1df8fd9baf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:32:05 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-57924f44-293f-48ce-9e56-e9593bcffab6 tempest-VolumesListTestJSON-1817162891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96113d47-392d-4e7d-8288-b1df8fd9baf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:32:05 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-57924f44-293f-48ce-9e56-e9593bcffab6 tempest-VolumesListTestJSON-1817162891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (326b64df-a5db-4ae8-85b5-28bb1742c48c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:32:05 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-57924f44-293f-48ce-9e56-e9593bcffab6 tempest-VolumesListTestJSON-1817162891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (326b64df-a5db-4ae8-85b5-28bb1742c48c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c35c82a-764a-43a5-8a35-687f1430813d', 'volume_name': 'volume-0c35c82a-764a-43a5-8a35-687f1430813d', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:32:05 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-57924f44-293f-48ce-9e56-e9593bcffab6 tempest-VolumesListTestJSON-1817162891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c370cf5e-5d55-4494-a762-acbe032666ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:32:05 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-57924f44-293f-48ce-9e56-e9593bcffab6 tempest-VolumesListTestJSON-1817162891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c370cf5e-5d55-4494-a762-acbe032666ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:32:05 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-57924f44-293f-48ce-9e56-e9593bcffab6 tempest-VolumesListTestJSON-1817162891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a65586b6-6c21-4f23-abcc-f90aca6cc79e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:32:05 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-57924f44-293f-48ce-9e56-e9593bcffab6 tempest-VolumesListTestJSON-1817162891 None] Volume 0c35c82a-764a-43a5-8a35-687f1430813d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c35c82a-764a-43a5-8a35-687f1430813d', 'volume_size': 1} Aug 26 14:32:05 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-57924f44-293f-48ce-9e56-e9593bcffab6 tempest-VolumesListTestJSON-1817162891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:32:05 devstack sudo[106762]: pam_unix(sudo:session): session closed for user root Aug 26 14:32:05 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e7bbe56a-cf3a-48c9-bf3d-754afa64ecd5 tempest-VolumesActionsTest-1373378216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-769b1fcf-df65-43df-a84e-9624e84e9bf1" returned: 0 in 0.390s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:32:05 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e7bbe56a-cf3a-48c9-bf3d-754afa64ecd5 tempest-VolumesActionsTest-1373378216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-769b1fcf-df65-43df-a84e-9624e84e9bf1 /opt/stack/data/cinder/conversion/769b1fcf-df65-43df-a84e-9624e84e9bf1.temp_image.7ba5644c-db79-40a8-9cbc-91e4dcbd2a235tuz8r1s.img {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:32:05 devstack sudo[106767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-769b1fcf-df65-43df-a84e-9624e84e9bf1 /opt/stack/data/cinder/conversion/769b1fcf-df65-43df-a84e-9624e84e9bf1.temp_image.7ba5644c-db79-40a8-9cbc-91e4dcbd2a235tuz8r1s.img Aug 26 14:32:05 devstack sudo[106767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:32:05 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-76e08c2f-a1b5-481c-a34d-a3a8b6a32891 tempest-VolumeRetypeWithoutMigrationTest-1990976658 None] Acquiring lock "cinder-c175f51d-6167-418d-a6cd-6929dfb38e0f-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:32:05 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-76e08c2f-a1b5-481c-a34d-a3a8b6a32891 tempest-VolumeRetypeWithoutMigrationTest-1990976658 None] Lock "cinder-c175f51d-6167-418d-a6cd-6929dfb38e0f-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:32:05 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-76e08c2f-a1b5-481c-a34d-a3a8b6a32891 tempest-VolumeRetypeWithoutMigrationTest-1990976658 None] Acquiring lock "cinder-quobyte-c175f51d-6167-418d-a6cd-6929dfb38e0f" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:32:05 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-76e08c2f-a1b5-481c-a34d-a3a8b6a32891 tempest-VolumeRetypeWithoutMigrationTest-1990976658 None] Lock "cinder-quobyte-c175f51d-6167-418d-a6cd-6929dfb38e0f" acquired by "delete_volume" :: waited 0.015s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:32:05 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[86261a58-2358-4eda-9caa-e5bce1cdbc17]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:32:05 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-76e08c2f-a1b5-481c-a34d-a3a8b6a32891 tempest-VolumeRetypeWithoutMigrationTest-1990976658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c175f51d-6167-418d-a6cd-6929dfb38e0f {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:32:05 devstack sudo[106769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c175f51d-6167-418d-a6cd-6929dfb38e0f Aug 26 14:32:05 devstack sudo[106769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:32:06 devstack sudo[106769]: pam_unix(sudo:session): session closed for user root Aug 26 14:32:06 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-76e08c2f-a1b5-481c-a34d-a3a8b6a32891 tempest-VolumeRetypeWithoutMigrationTest-1990976658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c175f51d-6167-418d-a6cd-6929dfb38e0f" returned: 0 in 0.727s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:32:06 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-76e08c2f-a1b5-481c-a34d-a3a8b6a32891 tempest-VolumeRetypeWithoutMigrationTest-1990976658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c175f51d-6167-418d-a6cd-6929dfb38e0f {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:32:06 devstack sudo[106784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c175f51d-6167-418d-a6cd-6929dfb38e0f Aug 26 14:32:06 devstack sudo[106784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:32:07 devstack sudo[106784]: pam_unix(sudo:session): session closed for user root Aug 26 14:32:07 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-76e08c2f-a1b5-481c-a34d-a3a8b6a32891 tempest-VolumeRetypeWithoutMigrationTest-1990976658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c175f51d-6167-418d-a6cd-6929dfb38e0f" returned: 0 in 0.545s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:32:07 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-76e08c2f-a1b5-481c-a34d-a3a8b6a32891 tempest-VolumeRetypeWithoutMigrationTest-1990976658 None] Lock "cinder-quobyte-c175f51d-6167-418d-a6cd-6929dfb38e0f" released by "delete_volume" :: held 1.345s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:32:07 devstack cinder-volume[94394]: WARNING cinder.quota [None req-76e08c2f-a1b5-481c-a34d-a3a8b6a32891 tempest-VolumeRetypeWithoutMigrationTest-1990976658 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Aug 26 14:32:07 devstack cinder-volume[94394]: WARNING cinder.quota [None req-76e08c2f-a1b5-481c-a34d-a3a8b6a32891 tempest-VolumeRetypeWithoutMigrationTest-1990976658 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Aug 26 14:32:07 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-76e08c2f-a1b5-481c-a34d-a3a8b6a32891 tempest-VolumeRetypeWithoutMigrationTest-1990976658 None] Created reservations ['a40301b7-3ef9-4a98-b2b5-678007e99885', 'fb141a21-4f0a-4f50-90d0-4a5cc4c35a28', 'da7e43ee-b6a7-495c-a702-227ad9ee4a7d', '6245cc07-eecc-4b61-8f3e-6bae42f4a603'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:32:07 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-76e08c2f-a1b5-481c-a34d-a3a8b6a32891 tempest-VolumeRetypeWithoutMigrationTest-1990976658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:32:07 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-76e08c2f-a1b5-481c-a34d-a3a8b6a32891 tempest-VolumeRetypeWithoutMigrationTest-1990976658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:32:07 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-76e08c2f-a1b5-481c-a34d-a3a8b6a32891 tempest-VolumeRetypeWithoutMigrationTest-1990976658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:32:07 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-76e08c2f-a1b5-481c-a34d-a3a8b6a32891 tempest-VolumeRetypeWithoutMigrationTest-1990976658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:32:07 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-76e08c2f-a1b5-481c-a34d-a3a8b6a32891 tempest-VolumeRetypeWithoutMigrationTest-1990976658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:32:07 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-76e08c2f-a1b5-481c-a34d-a3a8b6a32891 tempest-VolumeRetypeWithoutMigrationTest-1990976658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:32:07 devstack sudo[106787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:32:07 devstack sudo[106787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:32:07 devstack sudo[106787]: pam_unix(sudo:session): session closed for user root Aug 26 14:32:07 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-76e08c2f-a1b5-481c-a34d-a3a8b6a32891 tempest-VolumeRetypeWithoutMigrationTest-1990976658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.551s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:32:07 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-76e08c2f-a1b5-481c-a34d-a3a8b6a32891 tempest-VolumeRetypeWithoutMigrationTest-1990976658 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:32:08 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-76e08c2f-a1b5-481c-a34d-a3a8b6a32891 tempest-VolumeRetypeWithoutMigrationTest-1990976658 None] Deleted volume successfully. Aug 26 14:32:08 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-76e08c2f-a1b5-481c-a34d-a3a8b6a32891 tempest-VolumeRetypeWithoutMigrationTest-1990976658 None] Lock "cinder-c175f51d-6167-418d-a6cd-6929dfb38e0f-delete_volume" released by "delete_volume" :: held 2.416s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:32:10 devstack sudo[106767]: pam_unix(sudo:session): session closed for user root Aug 26 14:32:10 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e7bbe56a-cf3a-48c9-bf3d-754afa64ecd5 tempest-VolumesActionsTest-1373378216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-769b1fcf-df65-43df-a84e-9624e84e9bf1 /opt/stack/data/cinder/conversion/769b1fcf-df65-43df-a84e-9624e84e9bf1.temp_image.7ba5644c-db79-40a8-9cbc-91e4dcbd2a235tuz8r1s.img" returned: 0 in 4.889s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:32:10 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[217c25df-09ab-4d08-9d47-c7785020c9e3]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:32:10 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e7bbe56a-cf3a-48c9-bf3d-754afa64ecd5 tempest-VolumesActionsTest-1373378216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-769b1fcf-df65-43df-a84e-9624e84e9bf1 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:32:10 devstack sudo[106792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-769b1fcf-df65-43df-a84e-9624e84e9bf1 Aug 26 14:32:10 devstack sudo[106792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:32:11 devstack sudo[106792]: pam_unix(sudo:session): session closed for user root Aug 26 14:32:11 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e7bbe56a-cf3a-48c9-bf3d-754afa64ecd5 tempest-VolumesActionsTest-1373378216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-769b1fcf-df65-43df-a84e-9624e84e9bf1" returned: 0 in 0.582s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:32:11 devstack cinder-volume[94394]: DEBUG cinder.image.image_utils [None req-e7bbe56a-cf3a-48c9-bf3d-754afa64ecd5 tempest-VolumesActionsTest-1373378216 None] Image conversion details: src /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-769b1fcf-df65-43df-a84e-9624e84e9bf1, size 1024.00 MB, duration 4.89 sec, destination /opt/stack/data/cinder/conversion/769b1fcf-df65-43df-a84e-9624e84e9bf1.temp_image.7ba5644c-db79-40a8-9cbc-91e4dcbd2a235tuz8r1s.img {{(pid=94394) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 14:32:11 devstack cinder-volume[94394]: INFO cinder.image.image_utils [None req-e7bbe56a-cf3a-48c9-bf3d-754afa64ecd5 tempest-VolumesActionsTest-1373378216 None] Converted 1024.00 MB image at 209.39 MB/s Aug 26 14:32:11 devstack cinder-volume[94394]: DEBUG cinder.image.image_utils [None req-e7bbe56a-cf3a-48c9-bf3d-754afa64ecd5 tempest-VolumesActionsTest-1373378216 None] 7ba5644c-db79-40a8-9cbc-91e4dcbd2a23 was raw, converting to qcow2 {{(pid=94394) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Aug 26 14:32:11 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c14bbef-2669-480a-81ed-1bafe1c4c745]: (4, 'raw') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:32:11 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e7bbe56a-cf3a-48c9-bf3d-754afa64ecd5 tempest-VolumesActionsTest-1373378216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/769b1fcf-df65-43df-a84e-9624e84e9bf1.temp_image.7ba5644c-db79-40a8-9cbc-91e4dcbd2a235tuz8r1s.img {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:32:11 devstack sudo[106798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/769b1fcf-df65-43df-a84e-9624e84e9bf1.temp_image.7ba5644c-db79-40a8-9cbc-91e4dcbd2a235tuz8r1s.img Aug 26 14:32:11 devstack sudo[106798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:32:11 devstack sudo[106798]: pam_unix(sudo:session): session closed for user root Aug 26 14:32:11 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e7bbe56a-cf3a-48c9-bf3d-754afa64ecd5 tempest-VolumesActionsTest-1373378216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/769b1fcf-df65-43df-a84e-9624e84e9bf1.temp_image.7ba5644c-db79-40a8-9cbc-91e4dcbd2a235tuz8r1s.img" returned: 0 in 0.335s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:32:11 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e7bbe56a-cf3a-48c9-bf3d-754afa64ecd5 tempest-VolumesActionsTest-1373378216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/769b1fcf-df65-43df-a84e-9624e84e9bf1.temp_image.7ba5644c-db79-40a8-9cbc-91e4dcbd2a235tuz8r1s.img {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:32:11 devstack sudo[106802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/769b1fcf-df65-43df-a84e-9624e84e9bf1.temp_image.7ba5644c-db79-40a8-9cbc-91e4dcbd2a235tuz8r1s.img Aug 26 14:32:11 devstack sudo[106802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:32:11 devstack sudo[106802]: pam_unix(sudo:session): session closed for user root Aug 26 14:32:11 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e7bbe56a-cf3a-48c9-bf3d-754afa64ecd5 tempest-VolumesActionsTest-1373378216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/769b1fcf-df65-43df-a84e-9624e84e9bf1.temp_image.7ba5644c-db79-40a8-9cbc-91e4dcbd2a235tuz8r1s.img" returned: 1 in 0.336s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:32:11 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e7bbe56a-cf3a-48c9-bf3d-754afa64ecd5 tempest-VolumesActionsTest-1373378216 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/769b1fcf-df65-43df-a84e-9624e84e9bf1.temp_image.7ba5644c-db79-40a8-9cbc-91e4dcbd2a235tuz8r1s.img' failed. Not Retrying. {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 14:32:11 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e7bbe56a-cf3a-48c9-bf3d-754afa64ecd5 tempest-VolumesActionsTest-1373378216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/769b1fcf-df65-43df-a84e-9624e84e9bf1.temp_image.7ba5644c-db79-40a8-9cbc-91e4dcbd2a235tuz8r1s.img /opt/stack/data/cinder/conversion/vol_upload_5zuqn6y7 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:32:11 devstack sudo[106807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/769b1fcf-df65-43df-a84e-9624e84e9bf1.temp_image.7ba5644c-db79-40a8-9cbc-91e4dcbd2a235tuz8r1s.img /opt/stack/data/cinder/conversion/vol_upload_5zuqn6y7 Aug 26 14:32:11 devstack sudo[106807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:32:12 devstack sudo[106807]: pam_unix(sudo:session): session closed for user root Aug 26 14:32:12 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e7bbe56a-cf3a-48c9-bf3d-754afa64ecd5 tempest-VolumesActionsTest-1373378216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/769b1fcf-df65-43df-a84e-9624e84e9bf1.temp_image.7ba5644c-db79-40a8-9cbc-91e4dcbd2a235tuz8r1s.img /opt/stack/data/cinder/conversion/vol_upload_5zuqn6y7" returned: 0 in 0.273s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:32:12 devstack cinder-volume[94394]: DEBUG cinder.image.image_utils [None req-e7bbe56a-cf3a-48c9-bf3d-754afa64ecd5 tempest-VolumesActionsTest-1373378216 None] Image conversion details: src /opt/stack/data/cinder/conversion/769b1fcf-df65-43df-a84e-9624e84e9bf1.temp_image.7ba5644c-db79-40a8-9cbc-91e4dcbd2a235tuz8r1s.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_5zuqn6y7 {{(pid=94394) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 14:32:12 devstack cinder-volume[94394]: INFO cinder.image.image_utils [None req-e7bbe56a-cf3a-48c9-bf3d-754afa64ecd5 tempest-VolumesActionsTest-1373378216 None] Converted 1024.00 MB image at 1024.00 MB/s Aug 26 14:32:12 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9714597-0897-4c96-983e-50d4b38ff2eb]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:32:12 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e7bbe56a-cf3a-48c9-bf3d-754afa64ecd5 tempest-VolumesActionsTest-1373378216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_5zuqn6y7 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:32:12 devstack sudo[106813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_5zuqn6y7 Aug 26 14:32:12 devstack sudo[106813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:32:12 devstack sudo[106813]: pam_unix(sudo:session): session closed for user root Aug 26 14:32:12 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e7bbe56a-cf3a-48c9-bf3d-754afa64ecd5 tempest-VolumesActionsTest-1373378216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_5zuqn6y7" returned: 0 in 0.331s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:32:13 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e7bbe56a-cf3a-48c9-bf3d-754afa64ecd5 tempest-VolumesActionsTest-1373378216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 9.011s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:32:13 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-e7bbe56a-cf3a-48c9-bf3d-754afa64ecd5 tempest-VolumesActionsTest-1373378216 None] Uploaded volume to glance image-id: 7ba5644c-db79-40a8-9cbc-91e4dcbd2a23. {{(pid=94394) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Aug 26 14:32:13 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-93f3a5c4-e60e-4930-ac1e-d33a940035da tempest-VolumesSnapshotListTestJSON-172713543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.609s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:32:13 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-93f3a5c4-e60e-4930-ac1e-d33a940035da tempest-VolumesSnapshotListTestJSON-172713543 None] Creating offline snapshot 4ccb37d7-9d64-4442-abd6-6f68e534e656 of volume 487d8b43-d726-4d30-8439-3a40d3a4d055 {{(pid=94394) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 14:32:13 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-e7bbe56a-cf3a-48c9-bf3d-754afa64ecd5 tempest-VolumesActionsTest-1373378216 None] Copy volume to image completed successfully. Aug 26 14:32:13 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[a85bb66d-8036-4549-9810-ae1fbf5449f5]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:32:13 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-93f3a5c4-e60e-4930-ac1e-d33a940035da tempest-VolumesSnapshotListTestJSON-172713543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-487d8b43-d726-4d30-8439-3a40d3a4d055 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:32:14 devstack sudo[106818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-487d8b43-d726-4d30-8439-3a40d3a4d055 Aug 26 14:32:14 devstack sudo[106818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:32:14 devstack sudo[106818]: pam_unix(sudo:session): session closed for user root Aug 26 14:32:14 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-93f3a5c4-e60e-4930-ac1e-d33a940035da tempest-VolumesSnapshotListTestJSON-172713543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-487d8b43-d726-4d30-8439-3a40d3a4d055" returned: 0 in 0.413s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:32:14 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-93f3a5c4-e60e-4930-ac1e-d33a940035da tempest-VolumesSnapshotListTestJSON-172713543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-487d8b43-d726-4d30-8439-3a40d3a4d055,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-487d8b43-d726-4d30-8439-3a40d3a4d055.4ccb37d7-9d64-4442-abd6-6f68e534e656 1G {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:32:14 devstack sudo[106823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-487d8b43-d726-4d30-8439-3a40d3a4d055,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-487d8b43-d726-4d30-8439-3a40d3a4d055.4ccb37d7-9d64-4442-abd6-6f68e534e656 1G Aug 26 14:32:14 devstack sudo[106823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:32:14 devstack sudo[106823]: pam_unix(sudo:session): session closed for user root Aug 26 14:32:14 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-93f3a5c4-e60e-4930-ac1e-d33a940035da tempest-VolumesSnapshotListTestJSON-172713543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-487d8b43-d726-4d30-8439-3a40d3a4d055,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-487d8b43-d726-4d30-8439-3a40d3a4d055.4ccb37d7-9d64-4442-abd6-6f68e534e656 1G" returned: 0 in 0.465s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:32:14 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-93f3a5c4-e60e-4930-ac1e-d33a940035da tempest-VolumesSnapshotListTestJSON-172713543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-487d8b43-d726-4d30-8439-3a40d3a4d055 -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-487d8b43-d726-4d30-8439-3a40d3a4d055.4ccb37d7-9d64-4442-abd6-6f68e534e656 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:32:14 devstack sudo[106829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-487d8b43-d726-4d30-8439-3a40d3a4d055 -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-487d8b43-d726-4d30-8439-3a40d3a4d055.4ccb37d7-9d64-4442-abd6-6f68e534e656 Aug 26 14:32:14 devstack sudo[106829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:32:14 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-ad98c8b7-590b-4765-914d-6cf440fc59f1 tempest-VolumesActionsTest-1373378216 None] Acquiring lock "cinder-769b1fcf-df65-43df-a84e-9624e84e9bf1-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:32:14 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-ad98c8b7-590b-4765-914d-6cf440fc59f1 tempest-VolumesActionsTest-1373378216 None] Lock "cinder-769b1fcf-df65-43df-a84e-9624e84e9bf1-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:32:14 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-ad98c8b7-590b-4765-914d-6cf440fc59f1 tempest-VolumesActionsTest-1373378216 None] Acquiring lock "cinder-quobyte-769b1fcf-df65-43df-a84e-9624e84e9bf1" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:32:14 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-ad98c8b7-590b-4765-914d-6cf440fc59f1 tempest-VolumesActionsTest-1373378216 None] Lock "cinder-quobyte-769b1fcf-df65-43df-a84e-9624e84e9bf1" acquired by "delete_volume" :: waited 0.023s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:32:15 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f7661b0-277d-4788-96e4-7e3ef01dac17]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:32:15 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-ad98c8b7-590b-4765-914d-6cf440fc59f1 tempest-VolumesActionsTest-1373378216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-769b1fcf-df65-43df-a84e-9624e84e9bf1 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:32:15 devstack sudo[106829]: pam_unix(sudo:session): session closed for user root Aug 26 14:32:15 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-93f3a5c4-e60e-4930-ac1e-d33a940035da tempest-VolumesSnapshotListTestJSON-172713543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-487d8b43-d726-4d30-8439-3a40d3a4d055 -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-487d8b43-d726-4d30-8439-3a40d3a4d055.4ccb37d7-9d64-4442-abd6-6f68e534e656" returned: 0 in 0.327s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:32:15 devstack cinder-volume[94394]: WARNING cinder.volume.drivers.remotefs [None req-93f3a5c4-e60e-4930-ac1e-d33a940035da tempest-VolumesSnapshotListTestJSON-172713543 None] /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-487d8b43-d726-4d30-8439-3a40d3a4d055.4ccb37d7-9d64-4442-abd6-6f68e534e656 is being set with open permissions: ugo+rw Aug 26 14:32:15 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-93f3a5c4-e60e-4930-ac1e-d33a940035da tempest-VolumesSnapshotListTestJSON-172713543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-487d8b43-d726-4d30-8439-3a40d3a4d055.4ccb37d7-9d64-4442-abd6-6f68e534e656 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:32:15 devstack sudo[106835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-487d8b43-d726-4d30-8439-3a40d3a4d055.4ccb37d7-9d64-4442-abd6-6f68e534e656 Aug 26 14:32:15 devstack sudo[106835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:32:15 devstack sudo[106834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-769b1fcf-df65-43df-a84e-9624e84e9bf1 Aug 26 14:32:15 devstack sudo[106834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:32:15 devstack sudo[106835]: pam_unix(sudo:session): session closed for user root Aug 26 14:32:15 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-93f3a5c4-e60e-4930-ac1e-d33a940035da tempest-VolumesSnapshotListTestJSON-172713543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-487d8b43-d726-4d30-8439-3a40d3a4d055.4ccb37d7-9d64-4442-abd6-6f68e534e656" returned: 0 in 0.292s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:32:15 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-93f3a5c4-e60e-4930-ac1e-d33a940035da tempest-VolumesSnapshotListTestJSON-172713543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-487d8b43-d726-4d30-8439-3a40d3a4d055.info {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:32:15 devstack sudo[106834]: pam_unix(sudo:session): session closed for user root Aug 26 14:32:15 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-ad98c8b7-590b-4765-914d-6cf440fc59f1 tempest-VolumesActionsTest-1373378216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-769b1fcf-df65-43df-a84e-9624e84e9bf1" returned: 0 in 0.415s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:32:15 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-ad98c8b7-590b-4765-914d-6cf440fc59f1 tempest-VolumesActionsTest-1373378216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-769b1fcf-df65-43df-a84e-9624e84e9bf1 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:32:15 devstack sudo[106842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-487d8b43-d726-4d30-8439-3a40d3a4d055.info Aug 26 14:32:15 devstack sudo[106842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:32:15 devstack sudo[106843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-769b1fcf-df65-43df-a84e-9624e84e9bf1 Aug 26 14:32:15 devstack sudo[106843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:32:15 devstack sudo[106842]: pam_unix(sudo:session): session closed for user root Aug 26 14:32:15 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-93f3a5c4-e60e-4930-ac1e-d33a940035da tempest-VolumesSnapshotListTestJSON-172713543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-487d8b43-d726-4d30-8439-3a40d3a4d055.info" returned: 0 in 0.293s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:32:15 devstack sudo[106843]: pam_unix(sudo:session): session closed for user root Aug 26 14:32:15 devstack cinder-volume[94394]: WARNING cinder.volume.drivers.remotefs [None req-93f3a5c4-e60e-4930-ac1e-d33a940035da tempest-VolumesSnapshotListTestJSON-172713543 None] /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-487d8b43-d726-4d30-8439-3a40d3a4d055.info is being set with open permissions: ugo+rw Aug 26 14:32:15 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-93f3a5c4-e60e-4930-ac1e-d33a940035da tempest-VolumesSnapshotListTestJSON-172713543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-487d8b43-d726-4d30-8439-3a40d3a4d055.info {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:32:15 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-ad98c8b7-590b-4765-914d-6cf440fc59f1 tempest-VolumesActionsTest-1373378216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-769b1fcf-df65-43df-a84e-9624e84e9bf1" returned: 0 in 0.301s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:32:15 devstack sudo[106848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-487d8b43-d726-4d30-8439-3a40d3a4d055.info Aug 26 14:32:15 devstack sudo[106848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:32:15 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-ad98c8b7-590b-4765-914d-6cf440fc59f1 tempest-VolumesActionsTest-1373378216 None] Lock "cinder-quobyte-769b1fcf-df65-43df-a84e-9624e84e9bf1" released by "delete_volume" :: held 0.801s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:32:15 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-ad98c8b7-590b-4765-914d-6cf440fc59f1 tempest-VolumesActionsTest-1373378216 None] Created reservations ['250c7455-c606-46e5-a5e9-957b56380d17', '287fcdef-2b79-4bc9-b021-277edf32cb96', 'bb855a6f-2f22-4d2d-b785-3c0b433e0a86', '6cd3d3fd-59f0-4483-8a8d-678bdfa6a329'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:32:15 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-ad98c8b7-590b-4765-914d-6cf440fc59f1 tempest-VolumesActionsTest-1373378216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:32:15 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-ad98c8b7-590b-4765-914d-6cf440fc59f1 tempest-VolumesActionsTest-1373378216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:32:15 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-ad98c8b7-590b-4765-914d-6cf440fc59f1 tempest-VolumesActionsTest-1373378216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:32:15 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-ad98c8b7-590b-4765-914d-6cf440fc59f1 tempest-VolumesActionsTest-1373378216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:32:15 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-ad98c8b7-590b-4765-914d-6cf440fc59f1 tempest-VolumesActionsTest-1373378216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:32:15 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-ad98c8b7-590b-4765-914d-6cf440fc59f1 tempest-VolumesActionsTest-1373378216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:32:16 devstack sudo[106850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:32:16 devstack sudo[106850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:32:16 devstack sudo[106848]: pam_unix(sudo:session): session closed for user root Aug 26 14:32:16 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-93f3a5c4-e60e-4930-ac1e-d33a940035da tempest-VolumesSnapshotListTestJSON-172713543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-487d8b43-d726-4d30-8439-3a40d3a4d055.info" returned: 0 in 0.339s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:32:16 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-93f3a5c4-e60e-4930-ac1e-d33a940035da tempest-VolumesSnapshotListTestJSON-172713543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.235s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:32:16 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-57924f44-293f-48ce-9e56-e9593bcffab6 tempest-VolumesListTestJSON-1817162891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.489s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:32:16 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-57924f44-293f-48ce-9e56-e9593bcffab6 tempest-VolumesListTestJSON-1817162891 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:32:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-274528372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c35c82a-764a-43a5-8a35-687f1430813d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1b56d58d9a02406b9504de5d32d5491c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:32:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:32:05Z,use_quota=True,user_id='cd7447fdfabf41dcb627dc4094baacda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:32:16 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-57924f44-293f-48ce-9e56-e9593bcffab6 tempest-VolumesListTestJSON-1817162891 None] Creating volume 0c35c82a-764a-43a5-8a35-687f1430813d {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:32:16 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-57924f44-293f-48ce-9e56-e9593bcffab6 tempest-VolumesListTestJSON-1817162891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:32:16 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-57924f44-293f-48ce-9e56-e9593bcffab6 tempest-VolumesListTestJSON-1817162891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:32:16 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-57924f44-293f-48ce-9e56-e9593bcffab6 tempest-VolumesListTestJSON-1817162891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:32:16 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-57924f44-293f-48ce-9e56-e9593bcffab6 tempest-VolumesListTestJSON-1817162891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:32:16 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-57924f44-293f-48ce-9e56-e9593bcffab6 tempest-VolumesListTestJSON-1817162891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:32:16 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-57924f44-293f-48ce-9e56-e9593bcffab6 tempest-VolumesListTestJSON-1817162891 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:32:16 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-57924f44-293f-48ce-9e56-e9593bcffab6 tempest-VolumesListTestJSON-1817162891 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:32:16 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-57924f44-293f-48ce-9e56-e9593bcffab6 tempest-VolumesListTestJSON-1817162891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0c35c82a-764a-43a5-8a35-687f1430813d 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:32:16 devstack sudo[106853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0c35c82a-764a-43a5-8a35-687f1430813d 1073741824 Aug 26 14:32:16 devstack sudo[106853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:32:16 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-93f3a5c4-e60e-4930-ac1e-d33a940035da tempest-VolumesSnapshotListTestJSON-172713543 None] Create snapshot completed successfully Aug 26 14:32:16 devstack sudo[106850]: pam_unix(sudo:session): session closed for user root Aug 26 14:32:16 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-ad98c8b7-590b-4765-914d-6cf440fc59f1 tempest-VolumesActionsTest-1373378216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.312s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:32:16 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-ad98c8b7-590b-4765-914d-6cf440fc59f1 tempest-VolumesActionsTest-1373378216 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:32:16 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-ad98c8b7-590b-4765-914d-6cf440fc59f1 tempest-VolumesActionsTest-1373378216 None] Deleted volume successfully. Aug 26 14:32:16 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-ad98c8b7-590b-4765-914d-6cf440fc59f1 tempest-VolumesActionsTest-1373378216 None] Lock "cinder-769b1fcf-df65-43df-a84e-9624e84e9bf1-delete_volume" released by "delete_volume" :: held 1.418s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:32:16 devstack sudo[106853]: pam_unix(sudo:session): session closed for user root Aug 26 14:32:16 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-57924f44-293f-48ce-9e56-e9593bcffab6 tempest-VolumesListTestJSON-1817162891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0c35c82a-764a-43a5-8a35-687f1430813d 1073741824" returned: 0 in 0.565s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:32:16 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-57924f44-293f-48ce-9e56-e9593bcffab6 tempest-VolumesListTestJSON-1817162891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0c35c82a-764a-43a5-8a35-687f1430813d {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:32:16 devstack sudo[106861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0c35c82a-764a-43a5-8a35-687f1430813d Aug 26 14:32:16 devstack sudo[106861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:32:17 devstack sudo[106861]: pam_unix(sudo:session): session closed for user root Aug 26 14:32:17 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-57924f44-293f-48ce-9e56-e9593bcffab6 tempest-VolumesListTestJSON-1817162891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0c35c82a-764a-43a5-8a35-687f1430813d" returned: 0 in 0.337s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:32:17 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-57924f44-293f-48ce-9e56-e9593bcffab6 tempest-VolumesListTestJSON-1817162891 None] <== create_volume: return (955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:32:17 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-57924f44-293f-48ce-9e56-e9593bcffab6 tempest-VolumesListTestJSON-1817162891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.960s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:32:17 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-57924f44-293f-48ce-9e56-e9593bcffab6 tempest-VolumesListTestJSON-1817162891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a65586b6-6c21-4f23-abcc-f90aca6cc79e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c35c82a-764a-43a5-8a35-687f1430813d', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:32:17 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-57924f44-293f-48ce-9e56-e9593bcffab6 tempest-VolumesListTestJSON-1817162891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f3ba292-f815-4991-b94d-c431832a7e95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:32:17 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-57924f44-293f-48ce-9e56-e9593bcffab6 tempest-VolumesListTestJSON-1817162891 None] Volume volume-0c35c82a-764a-43a5-8a35-687f1430813d (0c35c82a-764a-43a5-8a35-687f1430813d): created successfully Aug 26 14:32:17 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-57924f44-293f-48ce-9e56-e9593bcffab6 tempest-VolumesListTestJSON-1817162891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f3ba292-f815-4991-b94d-c431832a7e95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:32:17 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-57924f44-293f-48ce-9e56-e9593bcffab6 tempest-VolumesListTestJSON-1817162891 None] Flow 'volume_create_manager' (987e90b1-c75f-4d72-ac73-880eac91e273) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:32:17 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-ae8ddcb2-a7ba-4159-97fd-6daf2e1428ed tempest-VolumesSnapshotListTestJSON-172713543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:32:17 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-ae8ddcb2-a7ba-4159-97fd-6daf2e1428ed tempest-VolumesSnapshotListTestJSON-172713543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:32:17 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-ae8ddcb2-a7ba-4159-97fd-6daf2e1428ed tempest-VolumesSnapshotListTestJSON-172713543 None] Creating offline snapshot c6ecf3d0-716b-4254-a87c-e9058e28f4d8 of volume 487d8b43-d726-4d30-8439-3a40d3a4d055 {{(pid=94394) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 14:32:17 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-57924f44-293f-48ce-9e56-e9593bcffab6 tempest-VolumesListTestJSON-1817162891 None] Created volume successfully. Aug 26 14:32:17 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[407441d2-f7c4-44f3-8ff3-06cf9e7b71e0]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:32:17 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-ae8ddcb2-a7ba-4159-97fd-6daf2e1428ed tempest-VolumesSnapshotListTestJSON-172713543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-487d8b43-d726-4d30-8439-3a40d3a4d055.4ccb37d7-9d64-4442-abd6-6f68e534e656 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:32:17 devstack sudo[106864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-487d8b43-d726-4d30-8439-3a40d3a4d055.4ccb37d7-9d64-4442-abd6-6f68e534e656 Aug 26 14:32:17 devstack sudo[106864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:32:17 devstack sudo[106864]: pam_unix(sudo:session): session closed for user root Aug 26 14:32:17 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-ae8ddcb2-a7ba-4159-97fd-6daf2e1428ed tempest-VolumesSnapshotListTestJSON-172713543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-487d8b43-d726-4d30-8439-3a40d3a4d055.4ccb37d7-9d64-4442-abd6-6f68e534e656" returned: 0 in 0.434s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:32:17 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-ae8ddcb2-a7ba-4159-97fd-6daf2e1428ed tempest-VolumesSnapshotListTestJSON-172713543 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-487d8b43-d726-4d30-8439-3a40d3a4d055(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94394) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 14:32:17 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-ae8ddcb2-a7ba-4159-97fd-6daf2e1428ed tempest-VolumesSnapshotListTestJSON-172713543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-487d8b43-d726-4d30-8439-3a40d3a4d055.4ccb37d7-9d64-4442-abd6-6f68e534e656,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-487d8b43-d726-4d30-8439-3a40d3a4d055.c6ecf3d0-716b-4254-a87c-e9058e28f4d8 1G {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:32:17 devstack sudo[106869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-487d8b43-d726-4d30-8439-3a40d3a4d055.4ccb37d7-9d64-4442-abd6-6f68e534e656,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-487d8b43-d726-4d30-8439-3a40d3a4d055.c6ecf3d0-716b-4254-a87c-e9058e28f4d8 1G Aug 26 14:32:17 devstack sudo[106869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:32:18 devstack sudo[106869]: pam_unix(sudo:session): session closed for user root Aug 26 14:32:18 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-ae8ddcb2-a7ba-4159-97fd-6daf2e1428ed tempest-VolumesSnapshotListTestJSON-172713543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-487d8b43-d726-4d30-8439-3a40d3a4d055.4ccb37d7-9d64-4442-abd6-6f68e534e656,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-487d8b43-d726-4d30-8439-3a40d3a4d055.c6ecf3d0-716b-4254-a87c-e9058e28f4d8 1G" returned: 0 in 0.622s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:32:18 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-ae8ddcb2-a7ba-4159-97fd-6daf2e1428ed tempest-VolumesSnapshotListTestJSON-172713543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-487d8b43-d726-4d30-8439-3a40d3a4d055.4ccb37d7-9d64-4442-abd6-6f68e534e656 -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-487d8b43-d726-4d30-8439-3a40d3a4d055.c6ecf3d0-716b-4254-a87c-e9058e28f4d8 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:32:18 devstack sudo[106876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-487d8b43-d726-4d30-8439-3a40d3a4d055.4ccb37d7-9d64-4442-abd6-6f68e534e656 -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-487d8b43-d726-4d30-8439-3a40d3a4d055.c6ecf3d0-716b-4254-a87c-e9058e28f4d8 Aug 26 14:32:18 devstack sudo[106876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:32:18 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-aaf7563c-1f01-4327-bdb3-6bd38f4b7568 tempest-VolumesListTestJSON-1817162891 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:32:18 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-aaf7563c-1f01-4327-bdb3-6bd38f4b7568 tempest-VolumesListTestJSON-1817162891 None] Flow 'volume_create_manager' (36fbc75f-ab78-465d-81b4-91d698bbdfe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:32:18 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-aaf7563c-1f01-4327-bdb3-6bd38f4b7568 tempest-VolumesListTestJSON-1817162891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e82798b7-c06f-45d5-88ee-df76e6625066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:32:18 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-aaf7563c-1f01-4327-bdb3-6bd38f4b7568 tempest-VolumesListTestJSON-1817162891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e82798b7-c06f-45d5-88ee-df76e6625066) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:32:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-129609263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4d3c790-b7fe-4678-af8f-4394d07ec7b8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1b56d58d9a02406b9504de5d32d5491c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:32:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:32:18Z,use_quota=True,user_id='cd7447fdfabf41dcb627dc4094baacda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:32:18 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-aaf7563c-1f01-4327-bdb3-6bd38f4b7568 tempest-VolumesListTestJSON-1817162891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76b2ed24-bfb2-45ee-83f6-1499db42e22b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:32:18 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-aaf7563c-1f01-4327-bdb3-6bd38f4b7568 tempest-VolumesListTestJSON-1817162891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76b2ed24-bfb2-45ee-83f6-1499db42e22b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:32:18 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-aaf7563c-1f01-4327-bdb3-6bd38f4b7568 tempest-VolumesListTestJSON-1817162891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1025d9a3-bbbe-4cd6-a399-a64b9fbf04f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:32:18 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-aaf7563c-1f01-4327-bdb3-6bd38f4b7568 tempest-VolumesListTestJSON-1817162891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1025d9a3-bbbe-4cd6-a399-a64b9fbf04f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4d3c790-b7fe-4678-af8f-4394d07ec7b8', 'volume_name': 'volume-e4d3c790-b7fe-4678-af8f-4394d07ec7b8', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:32:18 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-aaf7563c-1f01-4327-bdb3-6bd38f4b7568 tempest-VolumesListTestJSON-1817162891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6fe797b-0676-4d1e-a52d-a1799194e52e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:32:18 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-aaf7563c-1f01-4327-bdb3-6bd38f4b7568 tempest-VolumesListTestJSON-1817162891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6fe797b-0676-4d1e-a52d-a1799194e52e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:32:18 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-aaf7563c-1f01-4327-bdb3-6bd38f4b7568 tempest-VolumesListTestJSON-1817162891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b745d58f-e3b3-4526-a235-1dc55149a1f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:32:18 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-aaf7563c-1f01-4327-bdb3-6bd38f4b7568 tempest-VolumesListTestJSON-1817162891 None] Volume e4d3c790-b7fe-4678-af8f-4394d07ec7b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4d3c790-b7fe-4678-af8f-4394d07ec7b8', 'volume_size': 1} Aug 26 14:32:18 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-aaf7563c-1f01-4327-bdb3-6bd38f4b7568 tempest-VolumesListTestJSON-1817162891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:32:18 devstack sudo[106876]: pam_unix(sudo:session): session closed for user root Aug 26 14:32:18 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-ae8ddcb2-a7ba-4159-97fd-6daf2e1428ed tempest-VolumesSnapshotListTestJSON-172713543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-487d8b43-d726-4d30-8439-3a40d3a4d055.4ccb37d7-9d64-4442-abd6-6f68e534e656 -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-487d8b43-d726-4d30-8439-3a40d3a4d055.c6ecf3d0-716b-4254-a87c-e9058e28f4d8" returned: 0 in 0.328s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:32:18 devstack cinder-volume[94394]: WARNING cinder.volume.drivers.remotefs [None req-ae8ddcb2-a7ba-4159-97fd-6daf2e1428ed tempest-VolumesSnapshotListTestJSON-172713543 None] /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-487d8b43-d726-4d30-8439-3a40d3a4d055.c6ecf3d0-716b-4254-a87c-e9058e28f4d8 is being set with open permissions: ugo+rw Aug 26 14:32:18 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-ae8ddcb2-a7ba-4159-97fd-6daf2e1428ed tempest-VolumesSnapshotListTestJSON-172713543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-487d8b43-d726-4d30-8439-3a40d3a4d055.c6ecf3d0-716b-4254-a87c-e9058e28f4d8 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:32:18 devstack sudo[106881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-487d8b43-d726-4d30-8439-3a40d3a4d055.c6ecf3d0-716b-4254-a87c-e9058e28f4d8 Aug 26 14:32:18 devstack sudo[106881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:32:18 devstack sudo[106881]: pam_unix(sudo:session): session closed for user root Aug 26 14:32:18 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-ae8ddcb2-a7ba-4159-97fd-6daf2e1428ed tempest-VolumesSnapshotListTestJSON-172713543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-487d8b43-d726-4d30-8439-3a40d3a4d055.c6ecf3d0-716b-4254-a87c-e9058e28f4d8" returned: 0 in 0.280s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:32:18 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-ae8ddcb2-a7ba-4159-97fd-6daf2e1428ed tempest-VolumesSnapshotListTestJSON-172713543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.780s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:32:18 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-aaf7563c-1f01-4327-bdb3-6bd38f4b7568 tempest-VolumesListTestJSON-1817162891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.517s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:32:18 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-aaf7563c-1f01-4327-bdb3-6bd38f4b7568 tempest-VolumesListTestJSON-1817162891 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:32:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-129609263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4d3c790-b7fe-4678-af8f-4394d07ec7b8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1b56d58d9a02406b9504de5d32d5491c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:32:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:32:18Z,use_quota=True,user_id='cd7447fdfabf41dcb627dc4094baacda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:32:18 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-aaf7563c-1f01-4327-bdb3-6bd38f4b7568 tempest-VolumesListTestJSON-1817162891 None] Creating volume e4d3c790-b7fe-4678-af8f-4394d07ec7b8 {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:32:18 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-aaf7563c-1f01-4327-bdb3-6bd38f4b7568 tempest-VolumesListTestJSON-1817162891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:32:18 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-aaf7563c-1f01-4327-bdb3-6bd38f4b7568 tempest-VolumesListTestJSON-1817162891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:32:18 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-aaf7563c-1f01-4327-bdb3-6bd38f4b7568 tempest-VolumesListTestJSON-1817162891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:32:18 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-aaf7563c-1f01-4327-bdb3-6bd38f4b7568 tempest-VolumesListTestJSON-1817162891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:32:18 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-aaf7563c-1f01-4327-bdb3-6bd38f4b7568 tempest-VolumesListTestJSON-1817162891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:32:18 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-aaf7563c-1f01-4327-bdb3-6bd38f4b7568 tempest-VolumesListTestJSON-1817162891 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:32:18 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-aaf7563c-1f01-4327-bdb3-6bd38f4b7568 tempest-VolumesListTestJSON-1817162891 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:32:18 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-aaf7563c-1f01-4327-bdb3-6bd38f4b7568 tempest-VolumesListTestJSON-1817162891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-e4d3c790-b7fe-4678-af8f-4394d07ec7b8 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:32:18 devstack sudo[106886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-e4d3c790-b7fe-4678-af8f-4394d07ec7b8 1073741824 Aug 26 14:32:18 devstack sudo[106886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:32:18 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-ae8ddcb2-a7ba-4159-97fd-6daf2e1428ed tempest-VolumesSnapshotListTestJSON-172713543 None] Create snapshot completed successfully Aug 26 14:32:19 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-4278906a-6196-4150-99a5-ae41515e80e6 tempest-VolumesSnapshotListTestJSON-172713543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:32:19 devstack sudo[106886]: pam_unix(sudo:session): session closed for user root Aug 26 14:32:19 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-aaf7563c-1f01-4327-bdb3-6bd38f4b7568 tempest-VolumesListTestJSON-1817162891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-e4d3c790-b7fe-4678-af8f-4394d07ec7b8 1073741824" returned: 0 in 0.566s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:32:19 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-aaf7563c-1f01-4327-bdb3-6bd38f4b7568 tempest-VolumesListTestJSON-1817162891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-e4d3c790-b7fe-4678-af8f-4394d07ec7b8 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:32:19 devstack sudo[106892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-e4d3c790-b7fe-4678-af8f-4394d07ec7b8 Aug 26 14:32:19 devstack sudo[106892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:32:19 devstack sudo[106892]: pam_unix(sudo:session): session closed for user root Aug 26 14:32:19 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-aaf7563c-1f01-4327-bdb3-6bd38f4b7568 tempest-VolumesListTestJSON-1817162891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-e4d3c790-b7fe-4678-af8f-4394d07ec7b8" returned: 0 in 0.268s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:32:19 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-aaf7563c-1f01-4327-bdb3-6bd38f4b7568 tempest-VolumesListTestJSON-1817162891 None] <== create_volume: return (885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:32:19 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-aaf7563c-1f01-4327-bdb3-6bd38f4b7568 tempest-VolumesListTestJSON-1817162891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:32:19 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-4278906a-6196-4150-99a5-ae41515e80e6 tempest-VolumesSnapshotListTestJSON-172713543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.393s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:32:19 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-aaf7563c-1f01-4327-bdb3-6bd38f4b7568 tempest-VolumesListTestJSON-1817162891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b745d58f-e3b3-4526-a235-1dc55149a1f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4d3c790-b7fe-4678-af8f-4394d07ec7b8', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:32:19 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-aaf7563c-1f01-4327-bdb3-6bd38f4b7568 tempest-VolumesListTestJSON-1817162891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4907ca5-e3a5-4a46-818c-d279b1e5208e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:32:19 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-4278906a-6196-4150-99a5-ae41515e80e6 tempest-VolumesSnapshotListTestJSON-172713543 None] Creating offline snapshot c0dade5c-dc6e-4e0b-8582-d7ffb971daa6 of volume 487d8b43-d726-4d30-8439-3a40d3a4d055 {{(pid=94394) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 14:32:19 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-aaf7563c-1f01-4327-bdb3-6bd38f4b7568 tempest-VolumesListTestJSON-1817162891 None] Volume volume-e4d3c790-b7fe-4678-af8f-4394d07ec7b8 (e4d3c790-b7fe-4678-af8f-4394d07ec7b8): created successfully Aug 26 14:32:19 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-aaf7563c-1f01-4327-bdb3-6bd38f4b7568 tempest-VolumesListTestJSON-1817162891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4907ca5-e3a5-4a46-818c-d279b1e5208e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:32:19 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-aaf7563c-1f01-4327-bdb3-6bd38f4b7568 tempest-VolumesListTestJSON-1817162891 None] Flow 'volume_create_manager' (36fbc75f-ab78-465d-81b4-91d698bbdfe4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:32:19 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[559cef01-eaa0-4769-9052-b118691e7549]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:32:19 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4278906a-6196-4150-99a5-ae41515e80e6 tempest-VolumesSnapshotListTestJSON-172713543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-487d8b43-d726-4d30-8439-3a40d3a4d055.c6ecf3d0-716b-4254-a87c-e9058e28f4d8 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:32:19 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-aaf7563c-1f01-4327-bdb3-6bd38f4b7568 tempest-VolumesListTestJSON-1817162891 None] Created volume successfully. Aug 26 14:32:20 devstack sudo[106895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-487d8b43-d726-4d30-8439-3a40d3a4d055.c6ecf3d0-716b-4254-a87c-e9058e28f4d8 Aug 26 14:32:20 devstack sudo[106895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:32:20 devstack sudo[106895]: pam_unix(sudo:session): session closed for user root Aug 26 14:32:20 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4278906a-6196-4150-99a5-ae41515e80e6 tempest-VolumesSnapshotListTestJSON-172713543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-487d8b43-d726-4d30-8439-3a40d3a4d055.c6ecf3d0-716b-4254-a87c-e9058e28f4d8" returned: 0 in 0.654s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:32:20 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-4278906a-6196-4150-99a5-ae41515e80e6 tempest-VolumesSnapshotListTestJSON-172713543 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-487d8b43-d726-4d30-8439-3a40d3a4d055(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94394) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 14:32:20 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4278906a-6196-4150-99a5-ae41515e80e6 tempest-VolumesSnapshotListTestJSON-172713543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-487d8b43-d726-4d30-8439-3a40d3a4d055.c6ecf3d0-716b-4254-a87c-e9058e28f4d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-487d8b43-d726-4d30-8439-3a40d3a4d055.c0dade5c-dc6e-4e0b-8582-d7ffb971daa6 1G {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:32:20 devstack sudo[106902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-487d8b43-d726-4d30-8439-3a40d3a4d055.c6ecf3d0-716b-4254-a87c-e9058e28f4d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-487d8b43-d726-4d30-8439-3a40d3a4d055.c0dade5c-dc6e-4e0b-8582-d7ffb971daa6 1G Aug 26 14:32:20 devstack sudo[106902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:32:21 devstack sudo[106902]: pam_unix(sudo:session): session closed for user root Aug 26 14:32:21 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4278906a-6196-4150-99a5-ae41515e80e6 tempest-VolumesSnapshotListTestJSON-172713543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-487d8b43-d726-4d30-8439-3a40d3a4d055.c6ecf3d0-716b-4254-a87c-e9058e28f4d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-487d8b43-d726-4d30-8439-3a40d3a4d055.c0dade5c-dc6e-4e0b-8582-d7ffb971daa6 1G" returned: 0 in 0.578s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:32:21 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4278906a-6196-4150-99a5-ae41515e80e6 tempest-VolumesSnapshotListTestJSON-172713543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-487d8b43-d726-4d30-8439-3a40d3a4d055.c6ecf3d0-716b-4254-a87c-e9058e28f4d8 -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-487d8b43-d726-4d30-8439-3a40d3a4d055.c0dade5c-dc6e-4e0b-8582-d7ffb971daa6 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:32:21 devstack sudo[106908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-487d8b43-d726-4d30-8439-3a40d3a4d055.c6ecf3d0-716b-4254-a87c-e9058e28f4d8 -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-487d8b43-d726-4d30-8439-3a40d3a4d055.c0dade5c-dc6e-4e0b-8582-d7ffb971daa6 Aug 26 14:32:21 devstack sudo[106908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:32:21 devstack sudo[106908]: pam_unix(sudo:session): session closed for user root Aug 26 14:32:21 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4278906a-6196-4150-99a5-ae41515e80e6 tempest-VolumesSnapshotListTestJSON-172713543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-487d8b43-d726-4d30-8439-3a40d3a4d055.c6ecf3d0-716b-4254-a87c-e9058e28f4d8 -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-487d8b43-d726-4d30-8439-3a40d3a4d055.c0dade5c-dc6e-4e0b-8582-d7ffb971daa6" returned: 0 in 0.442s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:32:21 devstack cinder-volume[94394]: WARNING cinder.volume.drivers.remotefs [None req-4278906a-6196-4150-99a5-ae41515e80e6 tempest-VolumesSnapshotListTestJSON-172713543 None] /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-487d8b43-d726-4d30-8439-3a40d3a4d055.c0dade5c-dc6e-4e0b-8582-d7ffb971daa6 is being set with open permissions: ugo+rw Aug 26 14:32:21 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4278906a-6196-4150-99a5-ae41515e80e6 tempest-VolumesSnapshotListTestJSON-172713543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-487d8b43-d726-4d30-8439-3a40d3a4d055.c0dade5c-dc6e-4e0b-8582-d7ffb971daa6 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:32:21 devstack sudo[106915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-487d8b43-d726-4d30-8439-3a40d3a4d055.c0dade5c-dc6e-4e0b-8582-d7ffb971daa6 Aug 26 14:32:21 devstack sudo[106915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:32:22 devstack sudo[106915]: pam_unix(sudo:session): session closed for user root Aug 26 14:32:22 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4278906a-6196-4150-99a5-ae41515e80e6 tempest-VolumesSnapshotListTestJSON-172713543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-487d8b43-d726-4d30-8439-3a40d3a4d055.c0dade5c-dc6e-4e0b-8582-d7ffb971daa6" returned: 0 in 0.391s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:32:22 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-4278906a-6196-4150-99a5-ae41515e80e6 tempest-VolumesSnapshotListTestJSON-172713543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.243s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:32:22 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-4278906a-6196-4150-99a5-ae41515e80e6 tempest-VolumesSnapshotListTestJSON-172713543 None] Create snapshot completed successfully Aug 26 14:32:23 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-eb9b8a54-c4e0-46c3-b92f-247c6cdd45e7 tempest-VolumesListTestJSON-1817162891 None] Acquiring lock "cinder-e4d3c790-b7fe-4678-af8f-4394d07ec7b8-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:32:23 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-eb9b8a54-c4e0-46c3-b92f-247c6cdd45e7 tempest-VolumesListTestJSON-1817162891 None] Lock "cinder-e4d3c790-b7fe-4678-af8f-4394d07ec7b8-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:32:23 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-eb9b8a54-c4e0-46c3-b92f-247c6cdd45e7 tempest-VolumesListTestJSON-1817162891 None] Acquiring lock "cinder-quobyte-e4d3c790-b7fe-4678-af8f-4394d07ec7b8" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:32:23 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-eb9b8a54-c4e0-46c3-b92f-247c6cdd45e7 tempest-VolumesListTestJSON-1817162891 None] Lock "cinder-quobyte-e4d3c790-b7fe-4678-af8f-4394d07ec7b8" acquired by "delete_volume" :: waited 0.025s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:32:23 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-dd3f619a-40e1-4088-89d3-aa5f83f13206 tempest-VolumesSnapshotListTestJSON-172713543 None] Acquiring lock "cinder-c0dade5c-dc6e-4e0b-8582-d7ffb971daa6-delete_snapshot" by "delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:32:23 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[75d72f8c-4044-412a-9fc1-6ec75be293fe]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:32:23 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-eb9b8a54-c4e0-46c3-b92f-247c6cdd45e7 tempest-VolumesListTestJSON-1817162891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-e4d3c790-b7fe-4678-af8f-4394d07ec7b8 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:32:23 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-dd3f619a-40e1-4088-89d3-aa5f83f13206 tempest-VolumesSnapshotListTestJSON-172713543 None] Lock "cinder-c0dade5c-dc6e-4e0b-8582-d7ffb971daa6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:32:23 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-dd3f619a-40e1-4088-89d3-aa5f83f13206 tempest-VolumesSnapshotListTestJSON-172713543 None] Acquiring lock "cinder-quobyte-487d8b43-d726-4d30-8439-3a40d3a4d055" by "delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:32:23 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-dd3f619a-40e1-4088-89d3-aa5f83f13206 tempest-VolumesSnapshotListTestJSON-172713543 None] Lock "cinder-quobyte-487d8b43-d726-4d30-8439-3a40d3a4d055" acquired by "delete_snapshot" :: waited 0.038s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:32:23 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-dd3f619a-40e1-4088-89d3-aa5f83f13206 tempest-VolumesSnapshotListTestJSON-172713543 None] Acquiring lock "cinder-quobyte-c0dade5c-dc6e-4e0b-8582-d7ffb971daa6" by "_delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:32:23 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-dd3f619a-40e1-4088-89d3-aa5f83f13206 tempest-VolumesSnapshotListTestJSON-172713543 None] Lock "cinder-quobyte-c0dade5c-dc6e-4e0b-8582-d7ffb971daa6" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:32:23 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-dd3f619a-40e1-4088-89d3-aa5f83f13206 tempest-VolumesSnapshotListTestJSON-172713543 None] Deleting offline snapshot c0dade5c-dc6e-4e0b-8582-d7ffb971daa6 of volume 487d8b43-d726-4d30-8439-3a40d3a4d055 {{(pid=94394) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 14:32:23 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-dd3f619a-40e1-4088-89d3-aa5f83f13206 tempest-VolumesSnapshotListTestJSON-172713543 None] snapshot_file for this snap is: volume-487d8b43-d726-4d30-8439-3a40d3a4d055.c0dade5c-dc6e-4e0b-8582-d7ffb971daa6 {{(pid=94394) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 14:32:23 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[be04da42-f112-495b-a174-145f76c89ef5]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:32:23 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-dd3f619a-40e1-4088-89d3-aa5f83f13206 tempest-VolumesSnapshotListTestJSON-172713543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-487d8b43-d726-4d30-8439-3a40d3a4d055.c0dade5c-dc6e-4e0b-8582-d7ffb971daa6 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:32:23 devstack sudo[106918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-e4d3c790-b7fe-4678-af8f-4394d07ec7b8 Aug 26 14:32:23 devstack sudo[106918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:32:23 devstack sudo[106919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-487d8b43-d726-4d30-8439-3a40d3a4d055.c0dade5c-dc6e-4e0b-8582-d7ffb971daa6 Aug 26 14:32:23 devstack sudo[106919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:32:24 devstack sudo[106918]: pam_unix(sudo:session): session closed for user root Aug 26 14:32:24 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-eb9b8a54-c4e0-46c3-b92f-247c6cdd45e7 tempest-VolumesListTestJSON-1817162891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-e4d3c790-b7fe-4678-af8f-4394d07ec7b8" returned: 0 in 0.513s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:32:24 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-eb9b8a54-c4e0-46c3-b92f-247c6cdd45e7 tempest-VolumesListTestJSON-1817162891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-e4d3c790-b7fe-4678-af8f-4394d07ec7b8 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:32:24 devstack sudo[106927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-e4d3c790-b7fe-4678-af8f-4394d07ec7b8 Aug 26 14:32:24 devstack sudo[106927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:32:24 devstack sudo[106919]: pam_unix(sudo:session): session closed for user root Aug 26 14:32:24 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-dd3f619a-40e1-4088-89d3-aa5f83f13206 tempest-VolumesSnapshotListTestJSON-172713543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-487d8b43-d726-4d30-8439-3a40d3a4d055.c0dade5c-dc6e-4e0b-8582-d7ffb971daa6" returned: 0 in 0.457s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:32:24 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-dd3f619a-40e1-4088-89d3-aa5f83f13206 tempest-VolumesSnapshotListTestJSON-172713543 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-487d8b43-d726-4d30-8439-3a40d3a4d055(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94394) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 14:32:24 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[d298bd18-3f33-46ca-88a9-cea8b77607f6]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:32:24 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-dd3f619a-40e1-4088-89d3-aa5f83f13206 tempest-VolumesSnapshotListTestJSON-172713543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-487d8b43-d726-4d30-8439-3a40d3a4d055.c6ecf3d0-716b-4254-a87c-e9058e28f4d8 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:32:24 devstack sudo[106930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-487d8b43-d726-4d30-8439-3a40d3a4d055.c6ecf3d0-716b-4254-a87c-e9058e28f4d8 Aug 26 14:32:24 devstack sudo[106930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:32:24 devstack sudo[106927]: pam_unix(sudo:session): session closed for user root Aug 26 14:32:24 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-eb9b8a54-c4e0-46c3-b92f-247c6cdd45e7 tempest-VolumesListTestJSON-1817162891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-e4d3c790-b7fe-4678-af8f-4394d07ec7b8" returned: 0 in 0.333s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:32:24 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-eb9b8a54-c4e0-46c3-b92f-247c6cdd45e7 tempest-VolumesListTestJSON-1817162891 None] Lock "cinder-quobyte-e4d3c790-b7fe-4678-af8f-4394d07ec7b8" released by "delete_volume" :: held 0.911s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:32:24 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-eb9b8a54-c4e0-46c3-b92f-247c6cdd45e7 tempest-VolumesListTestJSON-1817162891 None] Created reservations ['802c7909-936e-4bab-8c5f-79064e6e469d', 'fb349805-b1d8-4332-a040-1e8ca055145d', 'bf47c293-4954-46e8-a3ed-f21890181423', 'b789ff53-fcf3-463c-ae02-dc56b204bd49'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:32:24 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3d232ae-ec14-43ac-a257-598e9ffb39c9 tempest-VolumesCloneTest-839220371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:32:24 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-f3d232ae-ec14-43ac-a257-598e9ffb39c9 tempest-VolumesCloneTest-839220371 None] Flow 'volume_create_manager' (c114273f-1b2d-441c-9751-a24fe6fd7154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:32:24 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-f3d232ae-ec14-43ac-a257-598e9ffb39c9 tempest-VolumesCloneTest-839220371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6c1802f-92a2-4557-94ca-4d0997d1a5bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:32:24 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-f3d232ae-ec14-43ac-a257-598e9ffb39c9 tempest-VolumesCloneTest-839220371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6c1802f-92a2-4557-94ca-4d0997d1a5bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:32:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-255288926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c257310f-d002-443f-9093-e0619ca475bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b799f22a04a4ca99641a86daa7cf005',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:32:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:32:25Z,use_quota=True,user_id='b4c2d70f6a724846ad5bad0fa9ccd04f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:32:24 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-f3d232ae-ec14-43ac-a257-598e9ffb39c9 tempest-VolumesCloneTest-839220371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8faf8afc-873e-4edd-bc2d-b38649bb1e1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:32:24 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-f3d232ae-ec14-43ac-a257-598e9ffb39c9 tempest-VolumesCloneTest-839220371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8faf8afc-873e-4edd-bc2d-b38649bb1e1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:32:24 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-f3d232ae-ec14-43ac-a257-598e9ffb39c9 tempest-VolumesCloneTest-839220371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b25ef8e-49df-4e8b-88f7-716e6c84d374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:32:24 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-f3d232ae-ec14-43ac-a257-598e9ffb39c9 tempest-VolumesCloneTest-839220371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b25ef8e-49df-4e8b-88f7-716e6c84d374) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c257310f-d002-443f-9093-e0619ca475bc', 'volume_name': 'volume-c257310f-d002-443f-9093-e0619ca475bc', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:32:24 devstack sudo[106930]: pam_unix(sudo:session): session closed for user root Aug 26 14:32:24 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-f3d232ae-ec14-43ac-a257-598e9ffb39c9 tempest-VolumesCloneTest-839220371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eae5bccf-1cf6-483c-bdfb-4dc5f959b551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:32:24 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-f3d232ae-ec14-43ac-a257-598e9ffb39c9 tempest-VolumesCloneTest-839220371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eae5bccf-1cf6-483c-bdfb-4dc5f959b551) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:32:24 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-f3d232ae-ec14-43ac-a257-598e9ffb39c9 tempest-VolumesCloneTest-839220371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9613ed90-e661-4253-9f88-261242c4b68e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:32:24 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-f3d232ae-ec14-43ac-a257-598e9ffb39c9 tempest-VolumesCloneTest-839220371 None] Volume c257310f-d002-443f-9093-e0619ca475bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c257310f-d002-443f-9093-e0619ca475bc', 'volume_size': 1} Aug 26 14:32:24 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-f3d232ae-ec14-43ac-a257-598e9ffb39c9 tempest-VolumesCloneTest-839220371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:32:24 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-f3d232ae-ec14-43ac-a257-598e9ffb39c9 tempest-VolumesCloneTest-839220371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:32:24 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-f3d232ae-ec14-43ac-a257-598e9ffb39c9 tempest-VolumesCloneTest-839220371 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:32:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-255288926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c257310f-d002-443f-9093-e0619ca475bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b799f22a04a4ca99641a86daa7cf005',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:32:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:32:25Z,use_quota=True,user_id='b4c2d70f6a724846ad5bad0fa9ccd04f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:32:24 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-f3d232ae-ec14-43ac-a257-598e9ffb39c9 tempest-VolumesCloneTest-839220371 None] Creating volume c257310f-d002-443f-9093-e0619ca475bc {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:32:24 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-f3d232ae-ec14-43ac-a257-598e9ffb39c9 tempest-VolumesCloneTest-839220371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:32:24 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-f3d232ae-ec14-43ac-a257-598e9ffb39c9 tempest-VolumesCloneTest-839220371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:32:24 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-f3d232ae-ec14-43ac-a257-598e9ffb39c9 tempest-VolumesCloneTest-839220371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:32:24 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-f3d232ae-ec14-43ac-a257-598e9ffb39c9 tempest-VolumesCloneTest-839220371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:32:24 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-f3d232ae-ec14-43ac-a257-598e9ffb39c9 tempest-VolumesCloneTest-839220371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:32:24 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-f3d232ae-ec14-43ac-a257-598e9ffb39c9 tempest-VolumesCloneTest-839220371 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:32:24 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-f3d232ae-ec14-43ac-a257-598e9ffb39c9 tempest-VolumesCloneTest-839220371 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:32:24 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-f3d232ae-ec14-43ac-a257-598e9ffb39c9 tempest-VolumesCloneTest-839220371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c257310f-d002-443f-9093-e0619ca475bc 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:32:24 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-dd3f619a-40e1-4088-89d3-aa5f83f13206 tempest-VolumesSnapshotListTestJSON-172713543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-487d8b43-d726-4d30-8439-3a40d3a4d055.c6ecf3d0-716b-4254-a87c-e9058e28f4d8" returned: 0 in 0.553s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:32:24 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-dd3f619a-40e1-4088-89d3-aa5f83f13206 tempest-VolumesSnapshotListTestJSON-172713543 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-487d8b43-d726-4d30-8439-3a40d3a4d055(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94394) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 14:32:24 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-dd3f619a-40e1-4088-89d3-aa5f83f13206 tempest-VolumesSnapshotListTestJSON-172713543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-487d8b43-d726-4d30-8439-3a40d3a4d055.c0dade5c-dc6e-4e0b-8582-d7ffb971daa6 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:32:24 devstack sudo[106936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c257310f-d002-443f-9093-e0619ca475bc 1073741824 Aug 26 14:32:24 devstack sudo[106936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:32:24 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-eb9b8a54-c4e0-46c3-b92f-247c6cdd45e7 tempest-VolumesListTestJSON-1817162891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:32:24 devstack sudo[106937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-487d8b43-d726-4d30-8439-3a40d3a4d055.c0dade5c-dc6e-4e0b-8582-d7ffb971daa6 Aug 26 14:32:24 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-eb9b8a54-c4e0-46c3-b92f-247c6cdd45e7 tempest-VolumesListTestJSON-1817162891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:32:24 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-eb9b8a54-c4e0-46c3-b92f-247c6cdd45e7 tempest-VolumesListTestJSON-1817162891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:32:24 devstack sudo[106937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:32:24 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-eb9b8a54-c4e0-46c3-b92f-247c6cdd45e7 tempest-VolumesListTestJSON-1817162891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:32:24 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-eb9b8a54-c4e0-46c3-b92f-247c6cdd45e7 tempest-VolumesListTestJSON-1817162891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:32:24 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-eb9b8a54-c4e0-46c3-b92f-247c6cdd45e7 tempest-VolumesListTestJSON-1817162891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:32:24 devstack sudo[106940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:32:24 devstack sudo[106940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:32:25 devstack sudo[106940]: pam_unix(sudo:session): session closed for user root Aug 26 14:32:25 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-eb9b8a54-c4e0-46c3-b92f-247c6cdd45e7 tempest-VolumesListTestJSON-1817162891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.379s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:32:25 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-eb9b8a54-c4e0-46c3-b92f-247c6cdd45e7 tempest-VolumesListTestJSON-1817162891 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:32:25 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-eb9b8a54-c4e0-46c3-b92f-247c6cdd45e7 tempest-VolumesListTestJSON-1817162891 None] Deleted volume successfully. Aug 26 14:32:25 devstack cinder-volume[94394]: DEBUG dbcounter [-] [94394] Writing DB stats cinder:SELECT=58,cinder:INSERT=13,cinder:UPDATE=64,cinder:DELETE=8 {{(pid=94394) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 14:32:25 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-eb9b8a54-c4e0-46c3-b92f-247c6cdd45e7 tempest-VolumesListTestJSON-1817162891 None] Lock "cinder-e4d3c790-b7fe-4678-af8f-4394d07ec7b8-delete_volume" released by "delete_volume" :: held 1.769s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:32:25 devstack sudo[106936]: pam_unix(sudo:session): session closed for user root Aug 26 14:32:25 devstack sudo[106937]: pam_unix(sudo:session): session closed for user root Aug 26 14:32:25 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-f3d232ae-ec14-43ac-a257-598e9ffb39c9 tempest-VolumesCloneTest-839220371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c257310f-d002-443f-9093-e0619ca475bc 1073741824" returned: 0 in 0.524s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:32:25 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-dd3f619a-40e1-4088-89d3-aa5f83f13206 tempest-VolumesSnapshotListTestJSON-172713543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-487d8b43-d726-4d30-8439-3a40d3a4d055.c0dade5c-dc6e-4e0b-8582-d7ffb971daa6" returned: 0 in 0.507s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:32:25 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-dd3f619a-40e1-4088-89d3-aa5f83f13206 tempest-VolumesSnapshotListTestJSON-172713543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-487d8b43-d726-4d30-8439-3a40d3a4d055.c0dade5c-dc6e-4e0b-8582-d7ffb971daa6 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:32:25 devstack cinder-volume[94394]: DEBUG dbcounter [-] [94394] Writing DB stats cinder:SELECT=58,cinder:UPDATE=71,cinder:DELETE=6,cinder:INSERT=14 {{(pid=94394) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 14:32:25 devstack sudo[106951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-487d8b43-d726-4d30-8439-3a40d3a4d055.c0dade5c-dc6e-4e0b-8582-d7ffb971daa6 Aug 26 14:32:25 devstack sudo[106951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:32:25 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-f3d232ae-ec14-43ac-a257-598e9ffb39c9 tempest-VolumesCloneTest-839220371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c257310f-d002-443f-9093-e0619ca475bc {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:32:25 devstack sudo[106953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c257310f-d002-443f-9093-e0619ca475bc Aug 26 14:32:25 devstack sudo[106953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:32:25 devstack sudo[106951]: pam_unix(sudo:session): session closed for user root Aug 26 14:32:25 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-dd3f619a-40e1-4088-89d3-aa5f83f13206 tempest-VolumesSnapshotListTestJSON-172713543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-487d8b43-d726-4d30-8439-3a40d3a4d055.c0dade5c-dc6e-4e0b-8582-d7ffb971daa6" returned: 0 in 0.285s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:32:25 devstack sudo[106953]: pam_unix(sudo:session): session closed for user root Aug 26 14:32:25 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-f3d232ae-ec14-43ac-a257-598e9ffb39c9 tempest-VolumesCloneTest-839220371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c257310f-d002-443f-9093-e0619ca475bc" returned: 0 in 0.265s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:32:25 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-f3d232ae-ec14-43ac-a257-598e9ffb39c9 tempest-VolumesCloneTest-839220371 None] <== create_volume: return (856ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:32:25 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-f3d232ae-ec14-43ac-a257-598e9ffb39c9 tempest-VolumesCloneTest-839220371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.859s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:32:25 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-dd3f619a-40e1-4088-89d3-aa5f83f13206 tempest-VolumesSnapshotListTestJSON-172713543 None] Lock "cinder-quobyte-c0dade5c-dc6e-4e0b-8582-d7ffb971daa6" released by "_delete_snapshot" :: held 1.926s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:32:25 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-dd3f619a-40e1-4088-89d3-aa5f83f13206 tempest-VolumesSnapshotListTestJSON-172713543 None] Lock "cinder-quobyte-487d8b43-d726-4d30-8439-3a40d3a4d055" released by "delete_snapshot" :: held 1.958s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:32:25 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-f3d232ae-ec14-43ac-a257-598e9ffb39c9 tempest-VolumesCloneTest-839220371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9613ed90-e661-4253-9f88-261242c4b68e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c257310f-d002-443f-9093-e0619ca475bc', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:32:25 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-f3d232ae-ec14-43ac-a257-598e9ffb39c9 tempest-VolumesCloneTest-839220371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd13b324-4417-4e4b-8d3e-972f75fa195a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:32:25 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-f3d232ae-ec14-43ac-a257-598e9ffb39c9 tempest-VolumesCloneTest-839220371 None] Volume volume-c257310f-d002-443f-9093-e0619ca475bc (c257310f-d002-443f-9093-e0619ca475bc): created successfully Aug 26 14:32:25 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-f3d232ae-ec14-43ac-a257-598e9ffb39c9 tempest-VolumesCloneTest-839220371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd13b324-4417-4e4b-8d3e-972f75fa195a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:32:25 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-f3d232ae-ec14-43ac-a257-598e9ffb39c9 tempest-VolumesCloneTest-839220371 None] Flow 'volume_create_manager' (c114273f-1b2d-441c-9751-a24fe6fd7154) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:32:25 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-f3d232ae-ec14-43ac-a257-598e9ffb39c9 tempest-VolumesCloneTest-839220371 None] Created volume successfully. Aug 26 14:32:25 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-dd3f619a-40e1-4088-89d3-aa5f83f13206 tempest-VolumesSnapshotListTestJSON-172713543 None] Created reservations ['aa84dc8a-8fbf-45df-9cb3-03b314ef463f', '78c3d224-a6b7-41a3-8d60-4409240cda63', 'b1378b0a-854c-44f1-a5da-90a4622bf397', 'f6884d0e-de6f-4d9a-bd83-49469a1ca4a5'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:32:25 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-dd3f619a-40e1-4088-89d3-aa5f83f13206 tempest-VolumesSnapshotListTestJSON-172713543 None] Delete snapshot completed successfully. Aug 26 14:32:25 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-dd3f619a-40e1-4088-89d3-aa5f83f13206 tempest-VolumesSnapshotListTestJSON-172713543 None] Lock "cinder-c0dade5c-dc6e-4e0b-8582-d7ffb971daa6-delete_snapshot" released by "delete_snapshot" :: held 2.209s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:32:25 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-5c507f6a-2884-4820-b7f8-b998415da753 tempest-VolumesListTestJSON-1817162891 None] Acquiring lock "cinder-0c35c82a-764a-43a5-8a35-687f1430813d-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:32:25 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-5c507f6a-2884-4820-b7f8-b998415da753 tempest-VolumesListTestJSON-1817162891 None] Lock "cinder-0c35c82a-764a-43a5-8a35-687f1430813d-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:32:25 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-5c507f6a-2884-4820-b7f8-b998415da753 tempest-VolumesListTestJSON-1817162891 None] Acquiring lock "cinder-quobyte-0c35c82a-764a-43a5-8a35-687f1430813d" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:32:25 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-5c507f6a-2884-4820-b7f8-b998415da753 tempest-VolumesListTestJSON-1817162891 None] Lock "cinder-quobyte-0c35c82a-764a-43a5-8a35-687f1430813d" acquired by "delete_volume" :: waited 0.015s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:32:25 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f80fe52-637d-4632-a9cb-f6bc07bc8ac7]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:32:25 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-5c507f6a-2884-4820-b7f8-b998415da753 tempest-VolumesListTestJSON-1817162891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0c35c82a-764a-43a5-8a35-687f1430813d {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:32:26 devstack sudo[106957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0c35c82a-764a-43a5-8a35-687f1430813d Aug 26 14:32:26 devstack sudo[106957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:32:26 devstack sudo[106957]: pam_unix(sudo:session): session closed for user root Aug 26 14:32:26 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-5c507f6a-2884-4820-b7f8-b998415da753 tempest-VolumesListTestJSON-1817162891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0c35c82a-764a-43a5-8a35-687f1430813d" returned: 0 in 0.375s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:32:26 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-5c507f6a-2884-4820-b7f8-b998415da753 tempest-VolumesListTestJSON-1817162891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0c35c82a-764a-43a5-8a35-687f1430813d {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:32:26 devstack sudo[106962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0c35c82a-764a-43a5-8a35-687f1430813d Aug 26 14:32:26 devstack sudo[106962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:32:26 devstack sudo[106962]: pam_unix(sudo:session): session closed for user root Aug 26 14:32:26 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-5c507f6a-2884-4820-b7f8-b998415da753 tempest-VolumesListTestJSON-1817162891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0c35c82a-764a-43a5-8a35-687f1430813d" returned: 0 in 0.259s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:32:26 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-5c507f6a-2884-4820-b7f8-b998415da753 tempest-VolumesListTestJSON-1817162891 None] Lock "cinder-quobyte-0c35c82a-764a-43a5-8a35-687f1430813d" released by "delete_volume" :: held 0.678s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:32:26 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-5c507f6a-2884-4820-b7f8-b998415da753 tempest-VolumesListTestJSON-1817162891 None] Created reservations ['d170cee0-6388-40c7-bcb9-64c17698d421', 'ec10a5f0-e7ec-4fdc-a36f-ef0888bc2b51', '7d20575a-9050-4029-8bc9-85740096224c', 'cd313ae0-d007-4e71-9d8d-d8116ecb323a'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:32:26 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-5c507f6a-2884-4820-b7f8-b998415da753 tempest-VolumesListTestJSON-1817162891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:32:26 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-5c507f6a-2884-4820-b7f8-b998415da753 tempest-VolumesListTestJSON-1817162891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:32:26 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-5c507f6a-2884-4820-b7f8-b998415da753 tempest-VolumesListTestJSON-1817162891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:32:26 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-5c507f6a-2884-4820-b7f8-b998415da753 tempest-VolumesListTestJSON-1817162891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:32:26 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-5c507f6a-2884-4820-b7f8-b998415da753 tempest-VolumesListTestJSON-1817162891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:32:26 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-5c507f6a-2884-4820-b7f8-b998415da753 tempest-VolumesListTestJSON-1817162891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:32:26 devstack sudo[106965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:32:26 devstack sudo[106965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:32:26 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-7dd4394d-e649-4fd4-b05d-9297686e62c7 tempest-VolumesSnapshotListTestJSON-172713543 None] Acquiring lock "cinder-c6ecf3d0-716b-4254-a87c-e9058e28f4d8-delete_snapshot" by "delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:32:26 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-7dd4394d-e649-4fd4-b05d-9297686e62c7 tempest-VolumesSnapshotListTestJSON-172713543 None] Lock "cinder-c6ecf3d0-716b-4254-a87c-e9058e28f4d8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:32:27 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-7dd4394d-e649-4fd4-b05d-9297686e62c7 tempest-VolumesSnapshotListTestJSON-172713543 None] Acquiring lock "cinder-quobyte-487d8b43-d726-4d30-8439-3a40d3a4d055" by "delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:32:27 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-7dd4394d-e649-4fd4-b05d-9297686e62c7 tempest-VolumesSnapshotListTestJSON-172713543 None] Lock "cinder-quobyte-487d8b43-d726-4d30-8439-3a40d3a4d055" acquired by "delete_snapshot" :: waited 0.021s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:32:27 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-7dd4394d-e649-4fd4-b05d-9297686e62c7 tempest-VolumesSnapshotListTestJSON-172713543 None] Acquiring lock "cinder-quobyte-c6ecf3d0-716b-4254-a87c-e9058e28f4d8" by "_delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:32:27 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-7dd4394d-e649-4fd4-b05d-9297686e62c7 tempest-VolumesSnapshotListTestJSON-172713543 None] Lock "cinder-quobyte-c6ecf3d0-716b-4254-a87c-e9058e28f4d8" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:32:27 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-7dd4394d-e649-4fd4-b05d-9297686e62c7 tempest-VolumesSnapshotListTestJSON-172713543 None] Deleting offline snapshot c6ecf3d0-716b-4254-a87c-e9058e28f4d8 of volume 487d8b43-d726-4d30-8439-3a40d3a4d055 {{(pid=94394) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 14:32:27 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-7dd4394d-e649-4fd4-b05d-9297686e62c7 tempest-VolumesSnapshotListTestJSON-172713543 None] snapshot_file for this snap is: volume-487d8b43-d726-4d30-8439-3a40d3a4d055.c6ecf3d0-716b-4254-a87c-e9058e28f4d8 {{(pid=94394) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 14:32:27 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7859028-37ba-476d-b40c-a02ac8966375]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:32:27 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-7dd4394d-e649-4fd4-b05d-9297686e62c7 tempest-VolumesSnapshotListTestJSON-172713543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-487d8b43-d726-4d30-8439-3a40d3a4d055.c6ecf3d0-716b-4254-a87c-e9058e28f4d8 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:32:27 devstack sudo[106965]: pam_unix(sudo:session): session closed for user root Aug 26 14:32:27 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-5c507f6a-2884-4820-b7f8-b998415da753 tempest-VolumesListTestJSON-1817162891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.331s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:32:27 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-5c507f6a-2884-4820-b7f8-b998415da753 tempest-VolumesListTestJSON-1817162891 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:32:27 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-5c507f6a-2884-4820-b7f8-b998415da753 tempest-VolumesListTestJSON-1817162891 None] Deleted volume successfully. Aug 26 14:32:27 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-5c507f6a-2884-4820-b7f8-b998415da753 tempest-VolumesListTestJSON-1817162891 None] Lock "cinder-0c35c82a-764a-43a5-8a35-687f1430813d-delete_volume" released by "delete_volume" :: held 1.315s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:32:27 devstack sudo[106967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-487d8b43-d726-4d30-8439-3a40d3a4d055.c6ecf3d0-716b-4254-a87c-e9058e28f4d8 Aug 26 14:32:27 devstack sudo[106967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:32:27 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-e833681f-d15d-469b-b159-cadff709296b tempest-VolumesListTestJSON-1817162891 None] Acquiring lock "cinder-6d69e0d1-bb72-4494-826c-472496ff005c-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:32:27 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-e833681f-d15d-469b-b159-cadff709296b tempest-VolumesListTestJSON-1817162891 None] Lock "cinder-6d69e0d1-bb72-4494-826c-472496ff005c-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:32:27 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-e833681f-d15d-469b-b159-cadff709296b tempest-VolumesListTestJSON-1817162891 None] Acquiring lock "cinder-quobyte-6d69e0d1-bb72-4494-826c-472496ff005c" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:32:27 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-e833681f-d15d-469b-b159-cadff709296b tempest-VolumesListTestJSON-1817162891 None] Lock "cinder-quobyte-6d69e0d1-bb72-4494-826c-472496ff005c" acquired by "delete_volume" :: waited 0.017s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:32:27 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[4963a413-3619-4bae-aa5e-d7d51ecb6b2f]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:32:27 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e833681f-d15d-469b-b159-cadff709296b tempest-VolumesListTestJSON-1817162891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6d69e0d1-bb72-4494-826c-472496ff005c {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:32:27 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-f33a29e5-e742-4efa-8792-3c72a5ff967f tempest-VolumesCloneTest-839220371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:32:27 devstack sudo[106970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6d69e0d1-bb72-4494-826c-472496ff005c Aug 26 14:32:27 devstack sudo[106970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:32:27 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-f33a29e5-e742-4efa-8792-3c72a5ff967f tempest-VolumesCloneTest-839220371 None] Flow 'volume_create_manager' (01e9c059-fcb5-4433-abe2-473e54dbf9ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:32:27 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-f33a29e5-e742-4efa-8792-3c72a5ff967f tempest-VolumesCloneTest-839220371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2329f4c6-94d4-4729-81eb-36748a149185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:32:27 devstack sudo[106967]: pam_unix(sudo:session): session closed for user root Aug 26 14:32:27 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-f33a29e5-e742-4efa-8792-3c72a5ff967f tempest-VolumesCloneTest-839220371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2329f4c6-94d4-4729-81eb-36748a149185) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:32:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1688237135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9fd01c7-7f96-41da-881b-58a03bc41e2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b799f22a04a4ca99641a86daa7cf005',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:32:27Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=c257310f-d002-443f-9093-e0619ca475bc,status='creating',terminated_at=None,updated_at=2026-08-26T12:32:27Z,use_quota=True,user_id='b4c2d70f6a724846ad5bad0fa9ccd04f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:32:27 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-f33a29e5-e742-4efa-8792-3c72a5ff967f tempest-VolumesCloneTest-839220371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (799ac77a-e871-4f03-92cc-98dca8d23f1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:32:27 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-f33a29e5-e742-4efa-8792-3c72a5ff967f tempest-VolumesCloneTest-839220371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (799ac77a-e871-4f03-92cc-98dca8d23f1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:32:27 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-f33a29e5-e742-4efa-8792-3c72a5ff967f tempest-VolumesCloneTest-839220371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1a27da1-7e90-4538-9d2c-4570dec36de8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:32:27 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-7dd4394d-e649-4fd4-b05d-9297686e62c7 tempest-VolumesSnapshotListTestJSON-172713543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-487d8b43-d726-4d30-8439-3a40d3a4d055.c6ecf3d0-716b-4254-a87c-e9058e28f4d8" returned: 0 in 0.527s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:32:27 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-7dd4394d-e649-4fd4-b05d-9297686e62c7 tempest-VolumesSnapshotListTestJSON-172713543 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-487d8b43-d726-4d30-8439-3a40d3a4d055(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94394) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 14:32:27 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-f33a29e5-e742-4efa-8792-3c72a5ff967f tempest-VolumesCloneTest-839220371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1a27da1-7e90-4538-9d2c-4570dec36de8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'd9fd01c7-7f96-41da-881b-58a03bc41e2e', 'volume_name': 'volume-d9fd01c7-7f96-41da-881b-58a03bc41e2e', 'volume_size': 2, 'source_volid': 'c257310f-d002-443f-9093-e0619ca475bc', 'source_volstatus': 'available'}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:32:27 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-f33a29e5-e742-4efa-8792-3c72a5ff967f tempest-VolumesCloneTest-839220371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ced0221-0622-4447-ac27-3f875535537e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:32:27 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-f33a29e5-e742-4efa-8792-3c72a5ff967f tempest-VolumesCloneTest-839220371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ced0221-0622-4447-ac27-3f875535537e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:32:27 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-f33a29e5-e742-4efa-8792-3c72a5ff967f tempest-VolumesCloneTest-839220371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7cb0af1-f170-4c57-958e-3fc4e70df571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:32:27 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-f33a29e5-e742-4efa-8792-3c72a5ff967f tempest-VolumesCloneTest-839220371 None] Volume d9fd01c7-7f96-41da-881b-58a03bc41e2e: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-d9fd01c7-7f96-41da-881b-58a03bc41e2e', 'volume_size': 2, 'source_volid': 'c257310f-d002-443f-9093-e0619ca475bc', 'source_volstatus': 'available'} Aug 26 14:32:27 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3354ec0-b3e7-4d45-bc4b-1fe786803e79]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:32:27 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-7dd4394d-e649-4fd4-b05d-9297686e62c7 tempest-VolumesSnapshotListTestJSON-172713543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-487d8b43-d726-4d30-8439-3a40d3a4d055.4ccb37d7-9d64-4442-abd6-6f68e534e656 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:32:27 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-f33a29e5-e742-4efa-8792-3c72a5ff967f tempest-VolumesCloneTest-839220371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:32:27 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-f33a29e5-e742-4efa-8792-3c72a5ff967f tempest-VolumesCloneTest-839220371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:32:27 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-f33a29e5-e742-4efa-8792-3c72a5ff967f tempest-VolumesCloneTest-839220371 None] Cloning volume c257310f-d002-443f-9093-e0619ca475bc to volume d9fd01c7-7f96-41da-881b-58a03bc41e2e Aug 26 14:32:27 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-f33a29e5-e742-4efa-8792-3c72a5ff967f tempest-VolumesCloneTest-839220371 None] Creating offline snapshot e14d0505-5be4-4113-8a30-12183378e02d of volume c257310f-d002-443f-9093-e0619ca475bc {{(pid=94394) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 14:32:27 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaff8c9b-0e6d-4d64-8aed-06b42d2120f0]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:32:27 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-f33a29e5-e742-4efa-8792-3c72a5ff967f tempest-VolumesCloneTest-839220371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c257310f-d002-443f-9093-e0619ca475bc {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:32:27 devstack sudo[106975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-487d8b43-d726-4d30-8439-3a40d3a4d055.4ccb37d7-9d64-4442-abd6-6f68e534e656 Aug 26 14:32:27 devstack sudo[106975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:32:27 devstack sudo[106970]: pam_unix(sudo:session): session closed for user root Aug 26 14:32:27 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e833681f-d15d-469b-b159-cadff709296b tempest-VolumesListTestJSON-1817162891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6d69e0d1-bb72-4494-826c-472496ff005c" returned: 0 in 0.463s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:32:27 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e833681f-d15d-469b-b159-cadff709296b tempest-VolumesListTestJSON-1817162891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6d69e0d1-bb72-4494-826c-472496ff005c {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:32:27 devstack sudo[106992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c257310f-d002-443f-9093-e0619ca475bc Aug 26 14:32:27 devstack sudo[106992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:32:27 devstack sudo[107015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6d69e0d1-bb72-4494-826c-472496ff005c Aug 26 14:32:27 devstack sudo[107015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:32:28 devstack sudo[106975]: pam_unix(sudo:session): session closed for user root Aug 26 14:32:28 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-7dd4394d-e649-4fd4-b05d-9297686e62c7 tempest-VolumesSnapshotListTestJSON-172713543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-487d8b43-d726-4d30-8439-3a40d3a4d055.4ccb37d7-9d64-4442-abd6-6f68e534e656" returned: 0 in 0.463s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:32:28 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-7dd4394d-e649-4fd4-b05d-9297686e62c7 tempest-VolumesSnapshotListTestJSON-172713543 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-487d8b43-d726-4d30-8439-3a40d3a4d055(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94394) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 14:32:28 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-7dd4394d-e649-4fd4-b05d-9297686e62c7 tempest-VolumesSnapshotListTestJSON-172713543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-487d8b43-d726-4d30-8439-3a40d3a4d055.c6ecf3d0-716b-4254-a87c-e9058e28f4d8 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:32:28 devstack sudo[107024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-487d8b43-d726-4d30-8439-3a40d3a4d055.c6ecf3d0-716b-4254-a87c-e9058e28f4d8 Aug 26 14:32:28 devstack sudo[107024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:32:28 devstack sudo[106992]: pam_unix(sudo:session): session closed for user root Aug 26 14:32:28 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-f33a29e5-e742-4efa-8792-3c72a5ff967f tempest-VolumesCloneTest-839220371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c257310f-d002-443f-9093-e0619ca475bc" returned: 0 in 0.467s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:32:28 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-f33a29e5-e742-4efa-8792-3c72a5ff967f tempest-VolumesCloneTest-839220371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c257310f-d002-443f-9093-e0619ca475bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c257310f-d002-443f-9093-e0619ca475bc.e14d0505-5be4-4113-8a30-12183378e02d 1G {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:32:28 devstack sudo[107027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c257310f-d002-443f-9093-e0619ca475bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c257310f-d002-443f-9093-e0619ca475bc.e14d0505-5be4-4113-8a30-12183378e02d 1G Aug 26 14:32:28 devstack sudo[107027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:32:28 devstack sudo[107015]: pam_unix(sudo:session): session closed for user root Aug 26 14:32:28 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e833681f-d15d-469b-b159-cadff709296b tempest-VolumesListTestJSON-1817162891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6d69e0d1-bb72-4494-826c-472496ff005c" returned: 0 in 0.482s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:32:28 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-e833681f-d15d-469b-b159-cadff709296b tempest-VolumesListTestJSON-1817162891 None] Lock "cinder-quobyte-6d69e0d1-bb72-4494-826c-472496ff005c" released by "delete_volume" :: held 1.019s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:32:28 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-e833681f-d15d-469b-b159-cadff709296b tempest-VolumesListTestJSON-1817162891 None] Created reservations ['ac04e0d4-f764-4b2d-9285-c2d65a5884fd', '15a56b7b-7ee6-4002-8ceb-31b76855e6a7', '262064ed-fa01-4182-af46-a9b8df6cdd63', 'bbd4ea8c-ef2a-46ae-b131-c7829631c392'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:32:28 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e833681f-d15d-469b-b159-cadff709296b tempest-VolumesListTestJSON-1817162891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:32:28 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e833681f-d15d-469b-b159-cadff709296b tempest-VolumesListTestJSON-1817162891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:32:28 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-e833681f-d15d-469b-b159-cadff709296b tempest-VolumesListTestJSON-1817162891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:32:28 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-e833681f-d15d-469b-b159-cadff709296b tempest-VolumesListTestJSON-1817162891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:32:28 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e833681f-d15d-469b-b159-cadff709296b tempest-VolumesListTestJSON-1817162891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:32:28 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e833681f-d15d-469b-b159-cadff709296b tempest-VolumesListTestJSON-1817162891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:32:28 devstack sudo[107039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:32:28 devstack sudo[107039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:32:28 devstack sudo[107024]: pam_unix(sudo:session): session closed for user root Aug 26 14:32:28 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-7dd4394d-e649-4fd4-b05d-9297686e62c7 tempest-VolumesSnapshotListTestJSON-172713543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-487d8b43-d726-4d30-8439-3a40d3a4d055.c6ecf3d0-716b-4254-a87c-e9058e28f4d8" returned: 0 in 0.571s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:32:28 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-7dd4394d-e649-4fd4-b05d-9297686e62c7 tempest-VolumesSnapshotListTestJSON-172713543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-487d8b43-d726-4d30-8439-3a40d3a4d055.c6ecf3d0-716b-4254-a87c-e9058e28f4d8 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:32:28 devstack sudo[107041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-487d8b43-d726-4d30-8439-3a40d3a4d055.c6ecf3d0-716b-4254-a87c-e9058e28f4d8 Aug 26 14:32:28 devstack sudo[107041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:32:28 devstack sudo[107027]: pam_unix(sudo:session): session closed for user root Aug 26 14:32:28 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-f33a29e5-e742-4efa-8792-3c72a5ff967f tempest-VolumesCloneTest-839220371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c257310f-d002-443f-9093-e0619ca475bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c257310f-d002-443f-9093-e0619ca475bc.e14d0505-5be4-4113-8a30-12183378e02d 1G" returned: 0 in 0.543s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:32:28 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-f33a29e5-e742-4efa-8792-3c72a5ff967f tempest-VolumesCloneTest-839220371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c257310f-d002-443f-9093-e0619ca475bc -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c257310f-d002-443f-9093-e0619ca475bc.e14d0505-5be4-4113-8a30-12183378e02d {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:32:28 devstack sudo[107044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c257310f-d002-443f-9093-e0619ca475bc -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c257310f-d002-443f-9093-e0619ca475bc.e14d0505-5be4-4113-8a30-12183378e02d Aug 26 14:32:28 devstack sudo[107044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:32:28 devstack sudo[107039]: pam_unix(sudo:session): session closed for user root Aug 26 14:32:28 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e833681f-d15d-469b-b159-cadff709296b tempest-VolumesListTestJSON-1817162891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.300s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:32:28 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-e833681f-d15d-469b-b159-cadff709296b tempest-VolumesListTestJSON-1817162891 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:32:28 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-e833681f-d15d-469b-b159-cadff709296b tempest-VolumesListTestJSON-1817162891 None] Deleted volume successfully. Aug 26 14:32:28 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-e833681f-d15d-469b-b159-cadff709296b tempest-VolumesListTestJSON-1817162891 None] Lock "cinder-6d69e0d1-bb72-4494-826c-472496ff005c-delete_volume" released by "delete_volume" :: held 1.648s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:32:29 devstack sudo[107041]: pam_unix(sudo:session): session closed for user root Aug 26 14:32:29 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-7dd4394d-e649-4fd4-b05d-9297686e62c7 tempest-VolumesSnapshotListTestJSON-172713543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-487d8b43-d726-4d30-8439-3a40d3a4d055.c6ecf3d0-716b-4254-a87c-e9058e28f4d8" returned: 0 in 0.320s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:32:29 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-7dd4394d-e649-4fd4-b05d-9297686e62c7 tempest-VolumesSnapshotListTestJSON-172713543 None] Lock "cinder-quobyte-c6ecf3d0-716b-4254-a87c-e9058e28f4d8" released by "_delete_snapshot" :: held 2.037s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:32:29 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-7dd4394d-e649-4fd4-b05d-9297686e62c7 tempest-VolumesSnapshotListTestJSON-172713543 None] Lock "cinder-quobyte-487d8b43-d726-4d30-8439-3a40d3a4d055" released by "delete_snapshot" :: held 2.062s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:32:29 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-7dd4394d-e649-4fd4-b05d-9297686e62c7 tempest-VolumesSnapshotListTestJSON-172713543 None] Created reservations ['5d80792f-9fef-4c19-91df-6ac6c5c14930', 'dff918da-766e-4589-bb73-0085b091fa18', '300f49a8-cf4f-498a-b4bc-57bad412292f', 'ae29a2a1-2485-4014-aee4-023b3b5bb456'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:32:29 devstack sudo[107044]: pam_unix(sudo:session): session closed for user root Aug 26 14:32:29 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-f33a29e5-e742-4efa-8792-3c72a5ff967f tempest-VolumesCloneTest-839220371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c257310f-d002-443f-9093-e0619ca475bc -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c257310f-d002-443f-9093-e0619ca475bc.e14d0505-5be4-4113-8a30-12183378e02d" returned: 0 in 0.381s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:32:29 devstack cinder-volume[94394]: WARNING cinder.volume.drivers.remotefs [None req-f33a29e5-e742-4efa-8792-3c72a5ff967f tempest-VolumesCloneTest-839220371 None] /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c257310f-d002-443f-9093-e0619ca475bc.e14d0505-5be4-4113-8a30-12183378e02d is being set with open permissions: ugo+rw Aug 26 14:32:29 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-f33a29e5-e742-4efa-8792-3c72a5ff967f tempest-VolumesCloneTest-839220371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c257310f-d002-443f-9093-e0619ca475bc.e14d0505-5be4-4113-8a30-12183378e02d {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:32:29 devstack sudo[107052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c257310f-d002-443f-9093-e0619ca475bc.e14d0505-5be4-4113-8a30-12183378e02d Aug 26 14:32:29 devstack sudo[107052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:32:29 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-7dd4394d-e649-4fd4-b05d-9297686e62c7 tempest-VolumesSnapshotListTestJSON-172713543 None] Delete snapshot completed successfully. Aug 26 14:32:29 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-7dd4394d-e649-4fd4-b05d-9297686e62c7 tempest-VolumesSnapshotListTestJSON-172713543 None] Lock "cinder-c6ecf3d0-716b-4254-a87c-e9058e28f4d8-delete_snapshot" released by "delete_snapshot" :: held 2.252s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:32:29 devstack sudo[107052]: pam_unix(sudo:session): session closed for user root Aug 26 14:32:29 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-f33a29e5-e742-4efa-8792-3c72a5ff967f tempest-VolumesCloneTest-839220371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c257310f-d002-443f-9093-e0619ca475bc.e14d0505-5be4-4113-8a30-12183378e02d" returned: 0 in 0.264s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:32:29 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-f33a29e5-e742-4efa-8792-3c72a5ff967f tempest-VolumesCloneTest-839220371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c257310f-d002-443f-9093-e0619ca475bc.info {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:32:29 devstack sudo[107055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c257310f-d002-443f-9093-e0619ca475bc.info Aug 26 14:32:29 devstack sudo[107055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:32:29 devstack sudo[107055]: pam_unix(sudo:session): session closed for user root Aug 26 14:32:29 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-f33a29e5-e742-4efa-8792-3c72a5ff967f tempest-VolumesCloneTest-839220371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c257310f-d002-443f-9093-e0619ca475bc.info" returned: 0 in 0.311s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:32:29 devstack cinder-volume[94394]: WARNING cinder.volume.drivers.remotefs [None req-f33a29e5-e742-4efa-8792-3c72a5ff967f tempest-VolumesCloneTest-839220371 None] /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c257310f-d002-443f-9093-e0619ca475bc.info is being set with open permissions: ugo+rw Aug 26 14:32:29 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-f33a29e5-e742-4efa-8792-3c72a5ff967f tempest-VolumesCloneTest-839220371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c257310f-d002-443f-9093-e0619ca475bc.info {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:32:29 devstack sudo[107058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c257310f-d002-443f-9093-e0619ca475bc.info Aug 26 14:32:29 devstack sudo[107058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:32:30 devstack sudo[107058]: pam_unix(sudo:session): session closed for user root Aug 26 14:32:30 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-f33a29e5-e742-4efa-8792-3c72a5ff967f tempest-VolumesCloneTest-839220371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c257310f-d002-443f-9093-e0619ca475bc.info" returned: 0 in 0.291s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:32:30 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-f33a29e5-e742-4efa-8792-3c72a5ff967f tempest-VolumesCloneTest-839220371 None] Acquiring lock "cinder-quobyte-d9fd01c7-7f96-41da-881b-58a03bc41e2e" by "_copy_volume_from_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:32:30 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-f33a29e5-e742-4efa-8792-3c72a5ff967f tempest-VolumesCloneTest-839220371 None] Lock "cinder-quobyte-d9fd01c7-7f96-41da-881b-58a03bc41e2e" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:32:30 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-f33a29e5-e742-4efa-8792-3c72a5ff967f tempest-VolumesCloneTest-839220371 None] snapshot: e14d0505-5be4-4113-8a30-12183378e02d, volume: d9fd01c7-7f96-41da-881b-58a03bc41e2e, {{(pid=94394) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 26 14:32:30 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-f33a29e5-e742-4efa-8792-3c72a5ff967f tempest-VolumesCloneTest-839220371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:32:30 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-f33a29e5-e742-4efa-8792-3c72a5ff967f tempest-VolumesCloneTest-839220371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:32:30 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-f33a29e5-e742-4efa-8792-3c72a5ff967f tempest-VolumesCloneTest-839220371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:32:30 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-f33a29e5-e742-4efa-8792-3c72a5ff967f tempest-VolumesCloneTest-839220371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:32:30 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-f33a29e5-e742-4efa-8792-3c72a5ff967f tempest-VolumesCloneTest-839220371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:32:30 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[17f726c0-7df1-4736-b830-c128a2f178c4]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:32:30 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-f33a29e5-e742-4efa-8792-3c72a5ff967f tempest-VolumesCloneTest-839220371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c257310f-d002-443f-9093-e0619ca475bc.e14d0505-5be4-4113-8a30-12183378e02d {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:32:30 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-af666240-aac4-4022-be56-c2c3a7418c8b tempest-VolumesSnapshotListTestJSON-172713543 None] Acquiring lock "cinder-4ccb37d7-9d64-4442-abd6-6f68e534e656-delete_snapshot" by "delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:32:30 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-af666240-aac4-4022-be56-c2c3a7418c8b tempest-VolumesSnapshotListTestJSON-172713543 None] Lock "cinder-4ccb37d7-9d64-4442-abd6-6f68e534e656-delete_snapshot" acquired by "delete_snapshot" :: waited 0.053s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:32:30 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-af666240-aac4-4022-be56-c2c3a7418c8b tempest-VolumesSnapshotListTestJSON-172713543 None] Acquiring lock "cinder-quobyte-487d8b43-d726-4d30-8439-3a40d3a4d055" by "delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:32:30 devstack sudo[107062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c257310f-d002-443f-9093-e0619ca475bc.e14d0505-5be4-4113-8a30-12183378e02d Aug 26 14:32:30 devstack sudo[107062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:32:30 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-af666240-aac4-4022-be56-c2c3a7418c8b tempest-VolumesSnapshotListTestJSON-172713543 None] Lock "cinder-quobyte-487d8b43-d726-4d30-8439-3a40d3a4d055" acquired by "delete_snapshot" :: waited 0.039s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:32:30 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-af666240-aac4-4022-be56-c2c3a7418c8b tempest-VolumesSnapshotListTestJSON-172713543 None] Acquiring lock "cinder-quobyte-4ccb37d7-9d64-4442-abd6-6f68e534e656" by "_delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:32:30 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-af666240-aac4-4022-be56-c2c3a7418c8b tempest-VolumesSnapshotListTestJSON-172713543 None] Lock "cinder-quobyte-4ccb37d7-9d64-4442-abd6-6f68e534e656" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:32:30 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-af666240-aac4-4022-be56-c2c3a7418c8b tempest-VolumesSnapshotListTestJSON-172713543 None] Deleting offline snapshot 4ccb37d7-9d64-4442-abd6-6f68e534e656 of volume 487d8b43-d726-4d30-8439-3a40d3a4d055 {{(pid=94394) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 14:32:30 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-af666240-aac4-4022-be56-c2c3a7418c8b tempest-VolumesSnapshotListTestJSON-172713543 None] snapshot_file for this snap is: volume-487d8b43-d726-4d30-8439-3a40d3a4d055.4ccb37d7-9d64-4442-abd6-6f68e534e656 {{(pid=94394) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 14:32:30 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[8de15d97-e21f-4ffb-8287-cc7e0ba92261]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:32:30 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-af666240-aac4-4022-be56-c2c3a7418c8b tempest-VolumesSnapshotListTestJSON-172713543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-487d8b43-d726-4d30-8439-3a40d3a4d055.4ccb37d7-9d64-4442-abd6-6f68e534e656 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:32:30 devstack sudo[107064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-487d8b43-d726-4d30-8439-3a40d3a4d055.4ccb37d7-9d64-4442-abd6-6f68e534e656 Aug 26 14:32:30 devstack sudo[107064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:32:30 devstack sudo[107062]: pam_unix(sudo:session): session closed for user root Aug 26 14:32:30 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-f33a29e5-e742-4efa-8792-3c72a5ff967f tempest-VolumesCloneTest-839220371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c257310f-d002-443f-9093-e0619ca475bc.e14d0505-5be4-4113-8a30-12183378e02d" returned: 0 in 0.474s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:32:30 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-f33a29e5-e742-4efa-8792-3c72a5ff967f tempest-VolumesCloneTest-839220371 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c257310f-d002-443f-9093-e0619ca475bc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94394) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 14:32:30 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[9817b43c-3dc7-40b1-8648-dcbaa08258bd]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:32:30 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-f33a29e5-e742-4efa-8792-3c72a5ff967f tempest-VolumesCloneTest-839220371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c257310f-d002-443f-9093-e0619ca475bc {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:32:30 devstack sudo[107069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c257310f-d002-443f-9093-e0619ca475bc Aug 26 14:32:30 devstack sudo[107069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:32:30 devstack sudo[107064]: pam_unix(sudo:session): session closed for user root Aug 26 14:32:30 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-af666240-aac4-4022-be56-c2c3a7418c8b tempest-VolumesSnapshotListTestJSON-172713543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-487d8b43-d726-4d30-8439-3a40d3a4d055.4ccb37d7-9d64-4442-abd6-6f68e534e656" returned: 0 in 0.500s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:32:30 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-af666240-aac4-4022-be56-c2c3a7418c8b tempest-VolumesSnapshotListTestJSON-172713543 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-487d8b43-d726-4d30-8439-3a40d3a4d055(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94394) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 14:32:30 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[c96cd4c7-be3a-432e-8f97-0f7047ef8ee3]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:32:30 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-af666240-aac4-4022-be56-c2c3a7418c8b tempest-VolumesSnapshotListTestJSON-172713543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-487d8b43-d726-4d30-8439-3a40d3a4d055 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:32:31 devstack sudo[107074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-487d8b43-d726-4d30-8439-3a40d3a4d055 Aug 26 14:32:31 devstack sudo[107074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:32:31 devstack sudo[107069]: pam_unix(sudo:session): session closed for user root Aug 26 14:32:31 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-f33a29e5-e742-4efa-8792-3c72a5ff967f tempest-VolumesCloneTest-839220371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c257310f-d002-443f-9093-e0619ca475bc" returned: 0 in 0.543s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:32:31 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-f33a29e5-e742-4efa-8792-3c72a5ff967f tempest-VolumesCloneTest-839220371 None] will copy from snapshot at /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c257310f-d002-443f-9093-e0619ca475bc {{(pid=94394) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 26 14:32:31 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-f33a29e5-e742-4efa-8792-3c72a5ff967f tempest-VolumesCloneTest-839220371 None] Creating direct copy from snapshot {{(pid=94394) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 26 14:32:31 devstack cinder-volume[94394]: DEBUG cinder.utils [None req-f33a29e5-e742-4efa-8792-3c72a5ff967f tempest-VolumesCloneTest-839220371 None] Path /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d9fd01c7-7f96-41da-881b-58a03bc41e2e not found in is_blk_device check {{(pid=94394) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 26 14:32:31 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-f33a29e5-e742-4efa-8792-3c72a5ff967f tempest-VolumesCloneTest-839220371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c257310f-d002-443f-9093-e0619ca475bc /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d9fd01c7-7f96-41da-881b-58a03bc41e2e {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:32:31 devstack sudo[107079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c257310f-d002-443f-9093-e0619ca475bc /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d9fd01c7-7f96-41da-881b-58a03bc41e2e Aug 26 14:32:31 devstack sudo[107079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:32:31 devstack sudo[107074]: pam_unix(sudo:session): session closed for user root Aug 26 14:32:31 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-af666240-aac4-4022-be56-c2c3a7418c8b tempest-VolumesSnapshotListTestJSON-172713543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-487d8b43-d726-4d30-8439-3a40d3a4d055" returned: 0 in 0.449s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:32:31 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-af666240-aac4-4022-be56-c2c3a7418c8b tempest-VolumesSnapshotListTestJSON-172713543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-487d8b43-d726-4d30-8439-3a40d3a4d055.4ccb37d7-9d64-4442-abd6-6f68e534e656 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:32:31 devstack sudo[107084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-487d8b43-d726-4d30-8439-3a40d3a4d055.4ccb37d7-9d64-4442-abd6-6f68e534e656 Aug 26 14:32:31 devstack sudo[107084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:32:32 devstack sudo[107084]: pam_unix(sudo:session): session closed for user root Aug 26 14:32:32 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-af666240-aac4-4022-be56-c2c3a7418c8b tempest-VolumesSnapshotListTestJSON-172713543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-487d8b43-d726-4d30-8439-3a40d3a4d055.4ccb37d7-9d64-4442-abd6-6f68e534e656" returned: 0 in 0.666s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:32:32 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-af666240-aac4-4022-be56-c2c3a7418c8b tempest-VolumesSnapshotListTestJSON-172713543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-487d8b43-d726-4d30-8439-3a40d3a4d055.4ccb37d7-9d64-4442-abd6-6f68e534e656 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:32:32 devstack sudo[107099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-487d8b43-d726-4d30-8439-3a40d3a4d055.4ccb37d7-9d64-4442-abd6-6f68e534e656 Aug 26 14:32:32 devstack sudo[107099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:32:32 devstack sudo[107099]: pam_unix(sudo:session): session closed for user root Aug 26 14:32:32 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-af666240-aac4-4022-be56-c2c3a7418c8b tempest-VolumesSnapshotListTestJSON-172713543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-487d8b43-d726-4d30-8439-3a40d3a4d055.4ccb37d7-9d64-4442-abd6-6f68e534e656" returned: 0 in 0.773s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:32:33 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-af666240-aac4-4022-be56-c2c3a7418c8b tempest-VolumesSnapshotListTestJSON-172713543 None] Lock "cinder-quobyte-4ccb37d7-9d64-4442-abd6-6f68e534e656" released by "_delete_snapshot" :: held 2.619s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:32:33 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-af666240-aac4-4022-be56-c2c3a7418c8b tempest-VolumesSnapshotListTestJSON-172713543 None] Lock "cinder-quobyte-487d8b43-d726-4d30-8439-3a40d3a4d055" released by "delete_snapshot" :: held 2.681s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:32:33 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-af666240-aac4-4022-be56-c2c3a7418c8b tempest-VolumesSnapshotListTestJSON-172713543 None] Created reservations ['3ec2101c-a733-42c6-adad-a0cea8c1227e', 'b03d1fa6-8853-47e9-8089-80c8f76619dc', '8a515734-21c0-4196-ad76-11386741527c', '49f403d2-f192-4867-a3e6-1f387460444b'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:32:33 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-af666240-aac4-4022-be56-c2c3a7418c8b tempest-VolumesSnapshotListTestJSON-172713543 None] Delete snapshot completed successfully. Aug 26 14:32:33 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-af666240-aac4-4022-be56-c2c3a7418c8b tempest-VolumesSnapshotListTestJSON-172713543 None] Lock "cinder-4ccb37d7-9d64-4442-abd6-6f68e534e656-delete_snapshot" released by "delete_snapshot" :: held 3.112s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:32:33 devstack cinder-volume[94394]: DEBUG oslo_service.periodic_task [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94394) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 14:32:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:32:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:32:33 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:32:33 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:32:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:32:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:32:33 devstack sudo[107102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:32:33 devstack sudo[107102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:32:33 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-694a8cf9-8788-4341-936d-44f70f7e43b9 tempest-VolumesSnapshotListTestJSON-172713543 None] Acquiring lock "cinder-487d8b43-d726-4d30-8439-3a40d3a4d055-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:32:33 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-694a8cf9-8788-4341-936d-44f70f7e43b9 tempest-VolumesSnapshotListTestJSON-172713543 None] Lock "cinder-487d8b43-d726-4d30-8439-3a40d3a4d055-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:32:34 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-694a8cf9-8788-4341-936d-44f70f7e43b9 tempest-VolumesSnapshotListTestJSON-172713543 None] Acquiring lock "cinder-quobyte-487d8b43-d726-4d30-8439-3a40d3a4d055" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:32:34 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-694a8cf9-8788-4341-936d-44f70f7e43b9 tempest-VolumesSnapshotListTestJSON-172713543 None] Lock "cinder-quobyte-487d8b43-d726-4d30-8439-3a40d3a4d055" acquired by "delete_volume" :: waited 0.065s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:32:34 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[06b003cd-ef7e-4859-b27a-bdef2ebeff79]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:32:34 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-694a8cf9-8788-4341-936d-44f70f7e43b9 tempest-VolumesSnapshotListTestJSON-172713543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-487d8b43-d726-4d30-8439-3a40d3a4d055 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:32:34 devstack sudo[107102]: pam_unix(sudo:session): session closed for user root Aug 26 14:32:34 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.735s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:32:34 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:32:34 devstack cinder-volume[94394]: DEBUG oslo_service.periodic_task [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Running periodic task VolumeManager._thread_info {{(pid=94394) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 14:32:34 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] thread count: 28 {{(pid=94394) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 14:32:34 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] thread info: [<_MainThread(MainThread, started 126600738033792)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94394) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 14:32:34 devstack sudo[107105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-487d8b43-d726-4d30-8439-3a40d3a4d055 Aug 26 14:32:34 devstack sudo[107105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:32:35 devstack sudo[107105]: pam_unix(sudo:session): session closed for user root Aug 26 14:32:35 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-694a8cf9-8788-4341-936d-44f70f7e43b9 tempest-VolumesSnapshotListTestJSON-172713543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-487d8b43-d726-4d30-8439-3a40d3a4d055" returned: 0 in 1.555s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:32:35 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-694a8cf9-8788-4341-936d-44f70f7e43b9 tempest-VolumesSnapshotListTestJSON-172713543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-487d8b43-d726-4d30-8439-3a40d3a4d055 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:32:35 devstack sudo[107110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-487d8b43-d726-4d30-8439-3a40d3a4d055 Aug 26 14:32:35 devstack sudo[107110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:32:36 devstack sudo[107110]: pam_unix(sudo:session): session closed for user root Aug 26 14:32:36 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-694a8cf9-8788-4341-936d-44f70f7e43b9 tempest-VolumesSnapshotListTestJSON-172713543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-487d8b43-d726-4d30-8439-3a40d3a4d055" returned: 0 in 0.669s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:32:36 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-694a8cf9-8788-4341-936d-44f70f7e43b9 tempest-VolumesSnapshotListTestJSON-172713543 None] Lock "cinder-quobyte-487d8b43-d726-4d30-8439-3a40d3a4d055" released by "delete_volume" :: held 2.420s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:32:36 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-694a8cf9-8788-4341-936d-44f70f7e43b9 tempest-VolumesSnapshotListTestJSON-172713543 None] Created reservations ['bf06fd03-84d7-4378-bb40-a259c956b26c', '47b7a262-131e-4c2c-a45a-38e625eae7a8', '622bc3c6-f9a2-4a68-b92e-2402f1309c93', 'a6e054e6-8b2a-4879-bd5a-edde84efcc74'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:32:36 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-694a8cf9-8788-4341-936d-44f70f7e43b9 tempest-VolumesSnapshotListTestJSON-172713543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:32:36 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-694a8cf9-8788-4341-936d-44f70f7e43b9 tempest-VolumesSnapshotListTestJSON-172713543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:32:36 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-694a8cf9-8788-4341-936d-44f70f7e43b9 tempest-VolumesSnapshotListTestJSON-172713543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:32:36 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-694a8cf9-8788-4341-936d-44f70f7e43b9 tempest-VolumesSnapshotListTestJSON-172713543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:32:36 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-694a8cf9-8788-4341-936d-44f70f7e43b9 tempest-VolumesSnapshotListTestJSON-172713543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:32:36 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-694a8cf9-8788-4341-936d-44f70f7e43b9 tempest-VolumesSnapshotListTestJSON-172713543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:32:36 devstack sudo[107113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:32:36 devstack sudo[107113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:32:37 devstack sudo[107113]: pam_unix(sudo:session): session closed for user root Aug 26 14:32:37 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-694a8cf9-8788-4341-936d-44f70f7e43b9 tempest-VolumesSnapshotListTestJSON-172713543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.403s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:32:37 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-694a8cf9-8788-4341-936d-44f70f7e43b9 tempest-VolumesSnapshotListTestJSON-172713543 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:32:37 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-694a8cf9-8788-4341-936d-44f70f7e43b9 tempest-VolumesSnapshotListTestJSON-172713543 None] Deleted volume successfully. Aug 26 14:32:37 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-694a8cf9-8788-4341-936d-44f70f7e43b9 tempest-VolumesSnapshotListTestJSON-172713543 None] Lock "cinder-487d8b43-d726-4d30-8439-3a40d3a4d055-delete_volume" released by "delete_volume" :: held 3.435s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:32:37 devstack sudo[107079]: pam_unix(sudo:session): session closed for user root Aug 26 14:32:37 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-f33a29e5-e742-4efa-8792-3c72a5ff967f tempest-VolumesCloneTest-839220371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c257310f-d002-443f-9093-e0619ca475bc /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d9fd01c7-7f96-41da-881b-58a03bc41e2e" returned: 0 in 6.118s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:32:37 devstack cinder-volume[94394]: DEBUG cinder.image.image_utils [None req-f33a29e5-e742-4efa-8792-3c72a5ff967f tempest-VolumesCloneTest-839220371 None] Image conversion details: src /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c257310f-d002-443f-9093-e0619ca475bc, size 1024.00 MB, duration 6.12 sec, destination /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d9fd01c7-7f96-41da-881b-58a03bc41e2e {{(pid=94394) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 14:32:37 devstack cinder-volume[94394]: INFO cinder.image.image_utils [None req-f33a29e5-e742-4efa-8792-3c72a5ff967f tempest-VolumesCloneTest-839220371 None] Converted 1024.00 MB image at 167.31 MB/s Aug 26 14:32:37 devstack cinder-volume[94394]: WARNING cinder.volume.drivers.remotefs [None req-f33a29e5-e742-4efa-8792-3c72a5ff967f tempest-VolumesCloneTest-839220371 None] /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d9fd01c7-7f96-41da-881b-58a03bc41e2e is being set with open permissions: ugo+rw Aug 26 14:32:37 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-f33a29e5-e742-4efa-8792-3c72a5ff967f tempest-VolumesCloneTest-839220371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d9fd01c7-7f96-41da-881b-58a03bc41e2e {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:32:37 devstack sudo[107116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d9fd01c7-7f96-41da-881b-58a03bc41e2e Aug 26 14:32:37 devstack sudo[107116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:32:37 devstack sudo[107116]: pam_unix(sudo:session): session closed for user root Aug 26 14:32:37 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-f33a29e5-e742-4efa-8792-3c72a5ff967f tempest-VolumesCloneTest-839220371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d9fd01c7-7f96-41da-881b-58a03bc41e2e" returned: 0 in 0.341s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:32:37 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-f33a29e5-e742-4efa-8792-3c72a5ff967f tempest-VolumesCloneTest-839220371 None] Lock "cinder-quobyte-d9fd01c7-7f96-41da-881b-58a03bc41e2e" released by "_copy_volume_from_snapshot" :: held 7.599s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:32:37 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-f33a29e5-e742-4efa-8792-3c72a5ff967f tempest-VolumesCloneTest-839220371 None] Acquiring lock "cinder-quobyte-e14d0505-5be4-4113-8a30-12183378e02d" by "_delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:32:37 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-f33a29e5-e742-4efa-8792-3c72a5ff967f tempest-VolumesCloneTest-839220371 None] Lock "cinder-quobyte-e14d0505-5be4-4113-8a30-12183378e02d" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:32:37 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-f33a29e5-e742-4efa-8792-3c72a5ff967f tempest-VolumesCloneTest-839220371 None] Deleting offline snapshot e14d0505-5be4-4113-8a30-12183378e02d of volume c257310f-d002-443f-9093-e0619ca475bc {{(pid=94394) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 14:32:37 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-f33a29e5-e742-4efa-8792-3c72a5ff967f tempest-VolumesCloneTest-839220371 None] snapshot_file for this snap is: volume-c257310f-d002-443f-9093-e0619ca475bc.e14d0505-5be4-4113-8a30-12183378e02d {{(pid=94394) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 14:32:37 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9aef369-fe3e-466c-9fc7-85f3c59c36d1]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:32:37 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-f33a29e5-e742-4efa-8792-3c72a5ff967f tempest-VolumesCloneTest-839220371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c257310f-d002-443f-9093-e0619ca475bc.e14d0505-5be4-4113-8a30-12183378e02d {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:32:38 devstack sudo[107119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c257310f-d002-443f-9093-e0619ca475bc.e14d0505-5be4-4113-8a30-12183378e02d Aug 26 14:32:38 devstack sudo[107119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:32:38 devstack sudo[107119]: pam_unix(sudo:session): session closed for user root Aug 26 14:32:38 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-f33a29e5-e742-4efa-8792-3c72a5ff967f tempest-VolumesCloneTest-839220371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c257310f-d002-443f-9093-e0619ca475bc.e14d0505-5be4-4113-8a30-12183378e02d" returned: 0 in 0.491s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:32:38 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-f33a29e5-e742-4efa-8792-3c72a5ff967f tempest-VolumesCloneTest-839220371 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c257310f-d002-443f-9093-e0619ca475bc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94394) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 14:32:38 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8a514b0-51e5-4961-b6e3-4cac9e97718b]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:32:38 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-f33a29e5-e742-4efa-8792-3c72a5ff967f tempest-VolumesCloneTest-839220371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c257310f-d002-443f-9093-e0619ca475bc {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:32:38 devstack sudo[107126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c257310f-d002-443f-9093-e0619ca475bc Aug 26 14:32:38 devstack sudo[107126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:32:39 devstack sudo[107126]: pam_unix(sudo:session): session closed for user root Aug 26 14:32:39 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-f33a29e5-e742-4efa-8792-3c72a5ff967f tempest-VolumesCloneTest-839220371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c257310f-d002-443f-9093-e0619ca475bc" returned: 0 in 0.870s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:32:39 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-f33a29e5-e742-4efa-8792-3c72a5ff967f tempest-VolumesCloneTest-839220371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c257310f-d002-443f-9093-e0619ca475bc.e14d0505-5be4-4113-8a30-12183378e02d {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:32:39 devstack sudo[107131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c257310f-d002-443f-9093-e0619ca475bc.e14d0505-5be4-4113-8a30-12183378e02d Aug 26 14:32:39 devstack sudo[107131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:32:39 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-0434ee58-375f-4d55-9384-885bd614a788 tempest-SnapshotMetadataTestJSON-2078962396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:32:39 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-0434ee58-375f-4d55-9384-885bd614a788 tempest-SnapshotMetadataTestJSON-2078962396 None] Flow 'volume_create_manager' (f299d558-1830-42bb-a01f-9b8caeb6c706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:32:39 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-0434ee58-375f-4d55-9384-885bd614a788 tempest-SnapshotMetadataTestJSON-2078962396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e19b01e6-d158-4952-875a-10896fe80fa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:32:39 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-0434ee58-375f-4d55-9384-885bd614a788 tempest-SnapshotMetadataTestJSON-2078962396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e19b01e6-d158-4952-875a-10896fe80fa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:32:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1886100684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfecbe55-0efa-40bb-af6a-a7cbefd0f955,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55940eed14a94bf8989d0aa0f6be8de2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:32:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:32:39Z,use_quota=True,user_id='4e2e10346fc6417993a3afc1cad4ab9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:32:39 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-0434ee58-375f-4d55-9384-885bd614a788 tempest-SnapshotMetadataTestJSON-2078962396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccec998c-3f40-4320-b157-32ce20874f2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:32:39 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-0434ee58-375f-4d55-9384-885bd614a788 tempest-SnapshotMetadataTestJSON-2078962396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccec998c-3f40-4320-b157-32ce20874f2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:32:39 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-0434ee58-375f-4d55-9384-885bd614a788 tempest-SnapshotMetadataTestJSON-2078962396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0db6bdec-5b66-462b-8b80-97c72afd6d4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:32:39 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-0434ee58-375f-4d55-9384-885bd614a788 tempest-SnapshotMetadataTestJSON-2078962396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0db6bdec-5b66-462b-8b80-97c72afd6d4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfecbe55-0efa-40bb-af6a-a7cbefd0f955', 'volume_name': 'volume-dfecbe55-0efa-40bb-af6a-a7cbefd0f955', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:32:39 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-0434ee58-375f-4d55-9384-885bd614a788 tempest-SnapshotMetadataTestJSON-2078962396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fa5fcae-b769-4ad1-9d46-c2a78de7444b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:32:39 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-0434ee58-375f-4d55-9384-885bd614a788 tempest-SnapshotMetadataTestJSON-2078962396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fa5fcae-b769-4ad1-9d46-c2a78de7444b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:32:39 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-0434ee58-375f-4d55-9384-885bd614a788 tempest-SnapshotMetadataTestJSON-2078962396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (700e2b59-bb09-48d5-887d-ccb3ac62f7dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:32:39 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-0434ee58-375f-4d55-9384-885bd614a788 tempest-SnapshotMetadataTestJSON-2078962396 None] Volume dfecbe55-0efa-40bb-af6a-a7cbefd0f955: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfecbe55-0efa-40bb-af6a-a7cbefd0f955', 'volume_size': 1} Aug 26 14:32:39 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-0434ee58-375f-4d55-9384-885bd614a788 tempest-SnapshotMetadataTestJSON-2078962396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:32:39 devstack sudo[107131]: pam_unix(sudo:session): session closed for user root Aug 26 14:32:39 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-f33a29e5-e742-4efa-8792-3c72a5ff967f tempest-VolumesCloneTest-839220371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c257310f-d002-443f-9093-e0619ca475bc.e14d0505-5be4-4113-8a30-12183378e02d" returned: 0 in 0.515s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:32:39 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-f33a29e5-e742-4efa-8792-3c72a5ff967f tempest-VolumesCloneTest-839220371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c257310f-d002-443f-9093-e0619ca475bc.e14d0505-5be4-4113-8a30-12183378e02d {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:32:39 devstack sudo[107137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c257310f-d002-443f-9093-e0619ca475bc.e14d0505-5be4-4113-8a30-12183378e02d Aug 26 14:32:39 devstack sudo[107137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:32:40 devstack sudo[107137]: pam_unix(sudo:session): session closed for user root Aug 26 14:32:40 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-f33a29e5-e742-4efa-8792-3c72a5ff967f tempest-VolumesCloneTest-839220371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c257310f-d002-443f-9093-e0619ca475bc.e14d0505-5be4-4113-8a30-12183378e02d" returned: 0 in 0.311s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:32:40 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-f33a29e5-e742-4efa-8792-3c72a5ff967f tempest-VolumesCloneTest-839220371 None] Lock "cinder-quobyte-e14d0505-5be4-4113-8a30-12183378e02d" released by "_delete_snapshot" :: held 2.354s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:32:40 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-f33a29e5-e742-4efa-8792-3c72a5ff967f tempest-VolumesCloneTest-839220371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.458s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:32:40 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-0434ee58-375f-4d55-9384-885bd614a788 tempest-SnapshotMetadataTestJSON-2078962396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.524s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:32:40 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-0434ee58-375f-4d55-9384-885bd614a788 tempest-SnapshotMetadataTestJSON-2078962396 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:32:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1886100684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfecbe55-0efa-40bb-af6a-a7cbefd0f955,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55940eed14a94bf8989d0aa0f6be8de2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:32:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:32:39Z,use_quota=True,user_id='4e2e10346fc6417993a3afc1cad4ab9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:32:40 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-0434ee58-375f-4d55-9384-885bd614a788 tempest-SnapshotMetadataTestJSON-2078962396 None] Creating volume dfecbe55-0efa-40bb-af6a-a7cbefd0f955 {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:32:40 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-0434ee58-375f-4d55-9384-885bd614a788 tempest-SnapshotMetadataTestJSON-2078962396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:32:40 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-0434ee58-375f-4d55-9384-885bd614a788 tempest-SnapshotMetadataTestJSON-2078962396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:32:40 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-0434ee58-375f-4d55-9384-885bd614a788 tempest-SnapshotMetadataTestJSON-2078962396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:32:40 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-0434ee58-375f-4d55-9384-885bd614a788 tempest-SnapshotMetadataTestJSON-2078962396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:32:40 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-0434ee58-375f-4d55-9384-885bd614a788 tempest-SnapshotMetadataTestJSON-2078962396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:32:40 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-0434ee58-375f-4d55-9384-885bd614a788 tempest-SnapshotMetadataTestJSON-2078962396 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:32:40 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-0434ee58-375f-4d55-9384-885bd614a788 tempest-SnapshotMetadataTestJSON-2078962396 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:32:40 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-0434ee58-375f-4d55-9384-885bd614a788 tempest-SnapshotMetadataTestJSON-2078962396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-dfecbe55-0efa-40bb-af6a-a7cbefd0f955 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:32:40 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-f33a29e5-e742-4efa-8792-3c72a5ff967f tempest-VolumesCloneTest-839220371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7cb0af1-f170-4c57-958e-3fc4e70df571) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9fd01c7-7f96-41da-881b-58a03bc41e2e', 'volume_size': 2, 'source_volid': 'c257310f-d002-443f-9093-e0619ca475bc', 'source_volstatus': 'available'}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:32:40 devstack sudo[107141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-dfecbe55-0efa-40bb-af6a-a7cbefd0f955 1073741824 Aug 26 14:32:40 devstack sudo[107141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:32:40 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-f33a29e5-e742-4efa-8792-3c72a5ff967f tempest-VolumesCloneTest-839220371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82f60fe0-6f69-49fd-82e0-ef9c9364adad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:32:40 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-f33a29e5-e742-4efa-8792-3c72a5ff967f tempest-VolumesCloneTest-839220371 None] Volume volume-d9fd01c7-7f96-41da-881b-58a03bc41e2e (d9fd01c7-7f96-41da-881b-58a03bc41e2e): created successfully Aug 26 14:32:40 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-f33a29e5-e742-4efa-8792-3c72a5ff967f tempest-VolumesCloneTest-839220371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82f60fe0-6f69-49fd-82e0-ef9c9364adad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:32:40 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-f33a29e5-e742-4efa-8792-3c72a5ff967f tempest-VolumesCloneTest-839220371 None] Flow 'volume_create_manager' (01e9c059-fcb5-4433-abe2-473e54dbf9ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:32:40 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-f33a29e5-e742-4efa-8792-3c72a5ff967f tempest-VolumesCloneTest-839220371 None] Created volume successfully. Aug 26 14:32:40 devstack sudo[107141]: pam_unix(sudo:session): session closed for user root Aug 26 14:32:40 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-0434ee58-375f-4d55-9384-885bd614a788 tempest-SnapshotMetadataTestJSON-2078962396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-dfecbe55-0efa-40bb-af6a-a7cbefd0f955 1073741824" returned: 0 in 0.608s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:32:40 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-0434ee58-375f-4d55-9384-885bd614a788 tempest-SnapshotMetadataTestJSON-2078962396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-dfecbe55-0efa-40bb-af6a-a7cbefd0f955 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:32:40 devstack sudo[107147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-dfecbe55-0efa-40bb-af6a-a7cbefd0f955 Aug 26 14:32:40 devstack sudo[107147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:32:41 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-f761a0ef-0beb-4df9-b66b-09fe2f9a4472 tempest-VolumesCloneTest-839220371 None] Acquiring lock "cinder-d9fd01c7-7f96-41da-881b-58a03bc41e2e-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:32:41 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-f761a0ef-0beb-4df9-b66b-09fe2f9a4472 tempest-VolumesCloneTest-839220371 None] Lock "cinder-d9fd01c7-7f96-41da-881b-58a03bc41e2e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:32:41 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-f761a0ef-0beb-4df9-b66b-09fe2f9a4472 tempest-VolumesCloneTest-839220371 None] Acquiring lock "cinder-quobyte-d9fd01c7-7f96-41da-881b-58a03bc41e2e" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:32:41 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-f761a0ef-0beb-4df9-b66b-09fe2f9a4472 tempest-VolumesCloneTest-839220371 None] Lock "cinder-quobyte-d9fd01c7-7f96-41da-881b-58a03bc41e2e" acquired by "delete_volume" :: waited 0.017s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:32:41 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[33457a9f-adfa-4617-9433-bd35ed9adc15]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:32:41 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-f761a0ef-0beb-4df9-b66b-09fe2f9a4472 tempest-VolumesCloneTest-839220371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d9fd01c7-7f96-41da-881b-58a03bc41e2e {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:32:41 devstack sudo[107147]: pam_unix(sudo:session): session closed for user root Aug 26 14:32:41 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-0434ee58-375f-4d55-9384-885bd614a788 tempest-SnapshotMetadataTestJSON-2078962396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-dfecbe55-0efa-40bb-af6a-a7cbefd0f955" returned: 0 in 0.344s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:32:41 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-0434ee58-375f-4d55-9384-885bd614a788 tempest-SnapshotMetadataTestJSON-2078962396 None] <== create_volume: return (1006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:32:41 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-0434ee58-375f-4d55-9384-885bd614a788 tempest-SnapshotMetadataTestJSON-2078962396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:32:41 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-0434ee58-375f-4d55-9384-885bd614a788 tempest-SnapshotMetadataTestJSON-2078962396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (700e2b59-bb09-48d5-887d-ccb3ac62f7dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfecbe55-0efa-40bb-af6a-a7cbefd0f955', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:32:41 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-0434ee58-375f-4d55-9384-885bd614a788 tempest-SnapshotMetadataTestJSON-2078962396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e519c3d9-3eaa-41c0-8b29-8ca659652a95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:32:41 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-0434ee58-375f-4d55-9384-885bd614a788 tempest-SnapshotMetadataTestJSON-2078962396 None] Volume volume-dfecbe55-0efa-40bb-af6a-a7cbefd0f955 (dfecbe55-0efa-40bb-af6a-a7cbefd0f955): created successfully Aug 26 14:32:41 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-0434ee58-375f-4d55-9384-885bd614a788 tempest-SnapshotMetadataTestJSON-2078962396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e519c3d9-3eaa-41c0-8b29-8ca659652a95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:32:41 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-0434ee58-375f-4d55-9384-885bd614a788 tempest-SnapshotMetadataTestJSON-2078962396 None] Flow 'volume_create_manager' (f299d558-1830-42bb-a01f-9b8caeb6c706) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:32:41 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-0434ee58-375f-4d55-9384-885bd614a788 tempest-SnapshotMetadataTestJSON-2078962396 None] Created volume successfully. Aug 26 14:32:41 devstack sudo[107150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d9fd01c7-7f96-41da-881b-58a03bc41e2e Aug 26 14:32:41 devstack sudo[107150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:32:41 devstack sudo[107150]: pam_unix(sudo:session): session closed for user root Aug 26 14:32:41 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-f761a0ef-0beb-4df9-b66b-09fe2f9a4472 tempest-VolumesCloneTest-839220371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d9fd01c7-7f96-41da-881b-58a03bc41e2e" returned: 0 in 0.504s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:32:41 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-f761a0ef-0beb-4df9-b66b-09fe2f9a4472 tempest-VolumesCloneTest-839220371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d9fd01c7-7f96-41da-881b-58a03bc41e2e {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:32:41 devstack sudo[107161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d9fd01c7-7f96-41da-881b-58a03bc41e2e Aug 26 14:32:41 devstack sudo[107161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:32:41 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-8ac912d9-e53f-4f58-a95f-be7378f21c4e tempest-SnapshotMetadataTestJSON-2078962396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:32:41 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-8ac912d9-e53f-4f58-a95f-be7378f21c4e tempest-SnapshotMetadataTestJSON-2078962396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:32:41 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-8ac912d9-e53f-4f58-a95f-be7378f21c4e tempest-SnapshotMetadataTestJSON-2078962396 None] Creating offline snapshot 7f7222f8-728e-4f62-bbfa-85365f67bbec of volume dfecbe55-0efa-40bb-af6a-a7cbefd0f955 {{(pid=94394) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 14:32:42 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[26ec2f72-aa78-4100-97de-f2880f52e71b]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:32:42 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-8ac912d9-e53f-4f58-a95f-be7378f21c4e tempest-SnapshotMetadataTestJSON-2078962396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-dfecbe55-0efa-40bb-af6a-a7cbefd0f955 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:32:42 devstack sudo[107161]: pam_unix(sudo:session): session closed for user root Aug 26 14:32:42 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-f761a0ef-0beb-4df9-b66b-09fe2f9a4472 tempest-VolumesCloneTest-839220371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d9fd01c7-7f96-41da-881b-58a03bc41e2e" returned: 0 in 0.361s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:32:42 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-f761a0ef-0beb-4df9-b66b-09fe2f9a4472 tempest-VolumesCloneTest-839220371 None] Lock "cinder-quobyte-d9fd01c7-7f96-41da-881b-58a03bc41e2e" released by "delete_volume" :: held 0.923s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:32:42 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-f761a0ef-0beb-4df9-b66b-09fe2f9a4472 tempest-VolumesCloneTest-839220371 None] Created reservations ['cc13e051-6b07-4ac0-b998-cc8861902e53', 'dbaa9472-b555-4a18-9f2d-7850735ed536', '8937185a-df67-47ab-9284-e5ded006ace0', '976a3a86-007f-4f94-82f1-821814fe4279'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:32:42 devstack sudo[107164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-dfecbe55-0efa-40bb-af6a-a7cbefd0f955 Aug 26 14:32:42 devstack sudo[107164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:32:42 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-f761a0ef-0beb-4df9-b66b-09fe2f9a4472 tempest-VolumesCloneTest-839220371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:32:42 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-f761a0ef-0beb-4df9-b66b-09fe2f9a4472 tempest-VolumesCloneTest-839220371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:32:42 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-f761a0ef-0beb-4df9-b66b-09fe2f9a4472 tempest-VolumesCloneTest-839220371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:32:42 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-f761a0ef-0beb-4df9-b66b-09fe2f9a4472 tempest-VolumesCloneTest-839220371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:32:42 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-f761a0ef-0beb-4df9-b66b-09fe2f9a4472 tempest-VolumesCloneTest-839220371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:32:42 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-f761a0ef-0beb-4df9-b66b-09fe2f9a4472 tempest-VolumesCloneTest-839220371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:32:42 devstack sudo[107166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:32:42 devstack sudo[107166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:32:42 devstack sudo[107164]: pam_unix(sudo:session): session closed for user root Aug 26 14:32:42 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-8ac912d9-e53f-4f58-a95f-be7378f21c4e tempest-SnapshotMetadataTestJSON-2078962396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-dfecbe55-0efa-40bb-af6a-a7cbefd0f955" returned: 0 in 0.510s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:32:42 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-8ac912d9-e53f-4f58-a95f-be7378f21c4e tempest-SnapshotMetadataTestJSON-2078962396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-dfecbe55-0efa-40bb-af6a-a7cbefd0f955,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-dfecbe55-0efa-40bb-af6a-a7cbefd0f955.7f7222f8-728e-4f62-bbfa-85365f67bbec 1G {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:32:42 devstack sudo[107166]: pam_unix(sudo:session): session closed for user root Aug 26 14:32:42 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-f761a0ef-0beb-4df9-b66b-09fe2f9a4472 tempest-VolumesCloneTest-839220371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.314s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:32:42 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-f761a0ef-0beb-4df9-b66b-09fe2f9a4472 tempest-VolumesCloneTest-839220371 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:32:42 devstack sudo[107173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-dfecbe55-0efa-40bb-af6a-a7cbefd0f955,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-dfecbe55-0efa-40bb-af6a-a7cbefd0f955.7f7222f8-728e-4f62-bbfa-85365f67bbec 1G Aug 26 14:32:42 devstack sudo[107173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:32:42 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-f761a0ef-0beb-4df9-b66b-09fe2f9a4472 tempest-VolumesCloneTest-839220371 None] Deleted volume successfully. Aug 26 14:32:42 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-f761a0ef-0beb-4df9-b66b-09fe2f9a4472 tempest-VolumesCloneTest-839220371 None] Lock "cinder-d9fd01c7-7f96-41da-881b-58a03bc41e2e-delete_volume" released by "delete_volume" :: held 1.534s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:32:43 devstack sudo[107173]: pam_unix(sudo:session): session closed for user root Aug 26 14:32:43 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-8ac912d9-e53f-4f58-a95f-be7378f21c4e tempest-SnapshotMetadataTestJSON-2078962396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-dfecbe55-0efa-40bb-af6a-a7cbefd0f955,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-dfecbe55-0efa-40bb-af6a-a7cbefd0f955.7f7222f8-728e-4f62-bbfa-85365f67bbec 1G" returned: 0 in 0.584s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:32:43 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-8ac912d9-e53f-4f58-a95f-be7378f21c4e tempest-SnapshotMetadataTestJSON-2078962396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dfecbe55-0efa-40bb-af6a-a7cbefd0f955 -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-dfecbe55-0efa-40bb-af6a-a7cbefd0f955.7f7222f8-728e-4f62-bbfa-85365f67bbec {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:32:43 devstack sudo[107184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dfecbe55-0efa-40bb-af6a-a7cbefd0f955 -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-dfecbe55-0efa-40bb-af6a-a7cbefd0f955.7f7222f8-728e-4f62-bbfa-85365f67bbec Aug 26 14:32:43 devstack sudo[107184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:32:43 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-1dd145ff-a058-40f1-8f24-2f5b5e8f8019 tempest-VolumesCloneTest-839220371 None] Acquiring lock "cinder-c257310f-d002-443f-9093-e0619ca475bc-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:32:43 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-1dd145ff-a058-40f1-8f24-2f5b5e8f8019 tempest-VolumesCloneTest-839220371 None] Lock "cinder-c257310f-d002-443f-9093-e0619ca475bc-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:32:43 devstack sudo[107184]: pam_unix(sudo:session): session closed for user root Aug 26 14:32:43 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-8ac912d9-e53f-4f58-a95f-be7378f21c4e tempest-SnapshotMetadataTestJSON-2078962396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dfecbe55-0efa-40bb-af6a-a7cbefd0f955 -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-dfecbe55-0efa-40bb-af6a-a7cbefd0f955.7f7222f8-728e-4f62-bbfa-85365f67bbec" returned: 0 in 0.371s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:32:43 devstack cinder-volume[94394]: WARNING cinder.volume.drivers.remotefs [None req-8ac912d9-e53f-4f58-a95f-be7378f21c4e tempest-SnapshotMetadataTestJSON-2078962396 None] /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-dfecbe55-0efa-40bb-af6a-a7cbefd0f955.7f7222f8-728e-4f62-bbfa-85365f67bbec is being set with open permissions: ugo+rw Aug 26 14:32:43 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-8ac912d9-e53f-4f58-a95f-be7378f21c4e tempest-SnapshotMetadataTestJSON-2078962396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-dfecbe55-0efa-40bb-af6a-a7cbefd0f955.7f7222f8-728e-4f62-bbfa-85365f67bbec {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:32:43 devstack sudo[107189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-dfecbe55-0efa-40bb-af6a-a7cbefd0f955.7f7222f8-728e-4f62-bbfa-85365f67bbec Aug 26 14:32:43 devstack sudo[107189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:32:43 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-1dd145ff-a058-40f1-8f24-2f5b5e8f8019 tempest-VolumesCloneTest-839220371 None] Acquiring lock "cinder-quobyte-c257310f-d002-443f-9093-e0619ca475bc" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:32:43 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-1dd145ff-a058-40f1-8f24-2f5b5e8f8019 tempest-VolumesCloneTest-839220371 None] Lock "cinder-quobyte-c257310f-d002-443f-9093-e0619ca475bc" acquired by "delete_volume" :: waited 0.022s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:32:43 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[422a9d6d-7902-46fc-9dc7-5bccb47a5cee]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:32:43 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-1dd145ff-a058-40f1-8f24-2f5b5e8f8019 tempest-VolumesCloneTest-839220371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c257310f-d002-443f-9093-e0619ca475bc {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:32:43 devstack sudo[107191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c257310f-d002-443f-9093-e0619ca475bc Aug 26 14:32:43 devstack sudo[107191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:32:43 devstack sudo[107189]: pam_unix(sudo:session): session closed for user root Aug 26 14:32:43 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-8ac912d9-e53f-4f58-a95f-be7378f21c4e tempest-SnapshotMetadataTestJSON-2078962396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-dfecbe55-0efa-40bb-af6a-a7cbefd0f955.7f7222f8-728e-4f62-bbfa-85365f67bbec" returned: 0 in 0.325s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:32:43 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-8ac912d9-e53f-4f58-a95f-be7378f21c4e tempest-SnapshotMetadataTestJSON-2078962396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-dfecbe55-0efa-40bb-af6a-a7cbefd0f955.info {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:32:43 devstack sudo[107194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-dfecbe55-0efa-40bb-af6a-a7cbefd0f955.info Aug 26 14:32:43 devstack sudo[107194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:32:44 devstack sudo[107191]: pam_unix(sudo:session): session closed for user root Aug 26 14:32:44 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-1dd145ff-a058-40f1-8f24-2f5b5e8f8019 tempest-VolumesCloneTest-839220371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c257310f-d002-443f-9093-e0619ca475bc" returned: 0 in 0.521s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:32:44 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-1dd145ff-a058-40f1-8f24-2f5b5e8f8019 tempest-VolumesCloneTest-839220371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c257310f-d002-443f-9093-e0619ca475bc {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:32:44 devstack sudo[107194]: pam_unix(sudo:session): session closed for user root Aug 26 14:32:44 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-8ac912d9-e53f-4f58-a95f-be7378f21c4e tempest-SnapshotMetadataTestJSON-2078962396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-dfecbe55-0efa-40bb-af6a-a7cbefd0f955.info" returned: 0 in 0.349s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:32:44 devstack cinder-volume[94394]: WARNING cinder.volume.drivers.remotefs [None req-8ac912d9-e53f-4f58-a95f-be7378f21c4e tempest-SnapshotMetadataTestJSON-2078962396 None] /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-dfecbe55-0efa-40bb-af6a-a7cbefd0f955.info is being set with open permissions: ugo+rw Aug 26 14:32:44 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-8ac912d9-e53f-4f58-a95f-be7378f21c4e tempest-SnapshotMetadataTestJSON-2078962396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-dfecbe55-0efa-40bb-af6a-a7cbefd0f955.info {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:32:44 devstack sudo[107200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c257310f-d002-443f-9093-e0619ca475bc Aug 26 14:32:44 devstack sudo[107200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:32:44 devstack sudo[107201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-dfecbe55-0efa-40bb-af6a-a7cbefd0f955.info Aug 26 14:32:44 devstack sudo[107201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:32:44 devstack sudo[107201]: pam_unix(sudo:session): session closed for user root Aug 26 14:32:44 devstack sudo[107200]: pam_unix(sudo:session): session closed for user root Aug 26 14:32:44 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-8ac912d9-e53f-4f58-a95f-be7378f21c4e tempest-SnapshotMetadataTestJSON-2078962396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-dfecbe55-0efa-40bb-af6a-a7cbefd0f955.info" returned: 0 in 0.317s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:32:44 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-8ac912d9-e53f-4f58-a95f-be7378f21c4e tempest-SnapshotMetadataTestJSON-2078962396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.575s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:32:44 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-1dd145ff-a058-40f1-8f24-2f5b5e8f8019 tempest-VolumesCloneTest-839220371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c257310f-d002-443f-9093-e0619ca475bc" returned: 0 in 0.384s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:32:44 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-1dd145ff-a058-40f1-8f24-2f5b5e8f8019 tempest-VolumesCloneTest-839220371 None] Lock "cinder-quobyte-c257310f-d002-443f-9093-e0619ca475bc" released by "delete_volume" :: held 1.041s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:32:44 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-8ac912d9-e53f-4f58-a95f-be7378f21c4e tempest-SnapshotMetadataTestJSON-2078962396 None] Create snapshot completed successfully Aug 26 14:32:44 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-1dd145ff-a058-40f1-8f24-2f5b5e8f8019 tempest-VolumesCloneTest-839220371 None] Created reservations ['6a4afc12-b37f-4e3f-aeb5-c16ce29b9c1e', '3413d5a2-b7fc-434c-b4e5-fd6cf3980495', 'd7cf9bb3-903e-4895-94ac-35306d22b567', '08cb61de-8cec-4365-8e22-c578096c7701'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:32:44 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-1dd145ff-a058-40f1-8f24-2f5b5e8f8019 tempest-VolumesCloneTest-839220371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:32:44 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-1dd145ff-a058-40f1-8f24-2f5b5e8f8019 tempest-VolumesCloneTest-839220371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:32:44 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-1dd145ff-a058-40f1-8f24-2f5b5e8f8019 tempest-VolumesCloneTest-839220371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:32:44 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-1dd145ff-a058-40f1-8f24-2f5b5e8f8019 tempest-VolumesCloneTest-839220371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:32:44 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-1dd145ff-a058-40f1-8f24-2f5b5e8f8019 tempest-VolumesCloneTest-839220371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:32:44 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-1dd145ff-a058-40f1-8f24-2f5b5e8f8019 tempest-VolumesCloneTest-839220371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:32:44 devstack sudo[107206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:32:44 devstack sudo[107206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:32:45 devstack sudo[107206]: pam_unix(sudo:session): session closed for user root Aug 26 14:32:45 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-1dd145ff-a058-40f1-8f24-2f5b5e8f8019 tempest-VolumesCloneTest-839220371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.266s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:32:45 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-1dd145ff-a058-40f1-8f24-2f5b5e8f8019 tempest-VolumesCloneTest-839220371 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:32:45 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-1dd145ff-a058-40f1-8f24-2f5b5e8f8019 tempest-VolumesCloneTest-839220371 None] Deleted volume successfully. Aug 26 14:32:45 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-1dd145ff-a058-40f1-8f24-2f5b5e8f8019 tempest-VolumesCloneTest-839220371 None] Lock "cinder-c257310f-d002-443f-9093-e0619ca475bc-delete_volume" released by "delete_volume" :: held 1.620s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:32:45 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-3db26f89-e47e-4a80-9503-07b8bd8405fd tempest-SnapshotMetadataTestJSON-2078962396 None] Acquiring lock "cinder-7f7222f8-728e-4f62-bbfa-85365f67bbec-delete_snapshot" by "delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:32:46 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-3db26f89-e47e-4a80-9503-07b8bd8405fd tempest-SnapshotMetadataTestJSON-2078962396 None] Lock "cinder-7f7222f8-728e-4f62-bbfa-85365f67bbec-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:32:46 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-3db26f89-e47e-4a80-9503-07b8bd8405fd tempest-SnapshotMetadataTestJSON-2078962396 None] Acquiring lock "cinder-quobyte-dfecbe55-0efa-40bb-af6a-a7cbefd0f955" by "delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:32:46 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-3db26f89-e47e-4a80-9503-07b8bd8405fd tempest-SnapshotMetadataTestJSON-2078962396 None] Lock "cinder-quobyte-dfecbe55-0efa-40bb-af6a-a7cbefd0f955" acquired by "delete_snapshot" :: waited 0.036s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:32:46 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-3db26f89-e47e-4a80-9503-07b8bd8405fd tempest-SnapshotMetadataTestJSON-2078962396 None] Acquiring lock "cinder-quobyte-7f7222f8-728e-4f62-bbfa-85365f67bbec" by "_delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:32:46 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-3db26f89-e47e-4a80-9503-07b8bd8405fd tempest-SnapshotMetadataTestJSON-2078962396 None] Lock "cinder-quobyte-7f7222f8-728e-4f62-bbfa-85365f67bbec" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:32:46 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-3db26f89-e47e-4a80-9503-07b8bd8405fd tempest-SnapshotMetadataTestJSON-2078962396 None] Deleting offline snapshot 7f7222f8-728e-4f62-bbfa-85365f67bbec of volume dfecbe55-0efa-40bb-af6a-a7cbefd0f955 {{(pid=94394) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 14:32:46 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-3db26f89-e47e-4a80-9503-07b8bd8405fd tempest-SnapshotMetadataTestJSON-2078962396 None] snapshot_file for this snap is: volume-dfecbe55-0efa-40bb-af6a-a7cbefd0f955.7f7222f8-728e-4f62-bbfa-85365f67bbec {{(pid=94394) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 14:32:46 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[d46eb3c5-9685-4021-8e6d-45eeea01c58f]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:32:46 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-3db26f89-e47e-4a80-9503-07b8bd8405fd tempest-SnapshotMetadataTestJSON-2078962396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-dfecbe55-0efa-40bb-af6a-a7cbefd0f955.7f7222f8-728e-4f62-bbfa-85365f67bbec {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:32:46 devstack sudo[107209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-dfecbe55-0efa-40bb-af6a-a7cbefd0f955.7f7222f8-728e-4f62-bbfa-85365f67bbec Aug 26 14:32:46 devstack sudo[107209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:32:46 devstack sudo[107209]: pam_unix(sudo:session): session closed for user root Aug 26 14:32:46 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-3db26f89-e47e-4a80-9503-07b8bd8405fd tempest-SnapshotMetadataTestJSON-2078962396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-dfecbe55-0efa-40bb-af6a-a7cbefd0f955.7f7222f8-728e-4f62-bbfa-85365f67bbec" returned: 0 in 0.456s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:32:46 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-3db26f89-e47e-4a80-9503-07b8bd8405fd tempest-SnapshotMetadataTestJSON-2078962396 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dfecbe55-0efa-40bb-af6a-a7cbefd0f955(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94394) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 14:32:46 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fa811f7-c5c4-4f92-83b2-0c081afe5ad6]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:32:46 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-3db26f89-e47e-4a80-9503-07b8bd8405fd tempest-SnapshotMetadataTestJSON-2078962396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-dfecbe55-0efa-40bb-af6a-a7cbefd0f955 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:32:46 devstack sudo[107214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-dfecbe55-0efa-40bb-af6a-a7cbefd0f955 Aug 26 14:32:46 devstack sudo[107214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:32:47 devstack sudo[107214]: pam_unix(sudo:session): session closed for user root Aug 26 14:32:47 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-3db26f89-e47e-4a80-9503-07b8bd8405fd tempest-SnapshotMetadataTestJSON-2078962396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-dfecbe55-0efa-40bb-af6a-a7cbefd0f955" returned: 0 in 0.470s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:32:47 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-3db26f89-e47e-4a80-9503-07b8bd8405fd tempest-SnapshotMetadataTestJSON-2078962396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-dfecbe55-0efa-40bb-af6a-a7cbefd0f955.7f7222f8-728e-4f62-bbfa-85365f67bbec {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:32:47 devstack sudo[107220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-dfecbe55-0efa-40bb-af6a-a7cbefd0f955.7f7222f8-728e-4f62-bbfa-85365f67bbec Aug 26 14:32:47 devstack sudo[107220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:32:47 devstack sudo[107220]: pam_unix(sudo:session): session closed for user root Aug 26 14:32:47 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-3db26f89-e47e-4a80-9503-07b8bd8405fd tempest-SnapshotMetadataTestJSON-2078962396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-dfecbe55-0efa-40bb-af6a-a7cbefd0f955.7f7222f8-728e-4f62-bbfa-85365f67bbec" returned: 0 in 0.391s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:32:47 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-3db26f89-e47e-4a80-9503-07b8bd8405fd tempest-SnapshotMetadataTestJSON-2078962396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-dfecbe55-0efa-40bb-af6a-a7cbefd0f955.7f7222f8-728e-4f62-bbfa-85365f67bbec {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:32:47 devstack sudo[107229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-dfecbe55-0efa-40bb-af6a-a7cbefd0f955.7f7222f8-728e-4f62-bbfa-85365f67bbec Aug 26 14:32:47 devstack sudo[107229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:32:47 devstack sudo[107229]: pam_unix(sudo:session): session closed for user root Aug 26 14:32:47 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-3db26f89-e47e-4a80-9503-07b8bd8405fd tempest-SnapshotMetadataTestJSON-2078962396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-dfecbe55-0efa-40bb-af6a-a7cbefd0f955.7f7222f8-728e-4f62-bbfa-85365f67bbec" returned: 0 in 0.266s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:32:47 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-3db26f89-e47e-4a80-9503-07b8bd8405fd tempest-SnapshotMetadataTestJSON-2078962396 None] Lock "cinder-quobyte-7f7222f8-728e-4f62-bbfa-85365f67bbec" released by "_delete_snapshot" :: held 1.724s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:32:47 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-3db26f89-e47e-4a80-9503-07b8bd8405fd tempest-SnapshotMetadataTestJSON-2078962396 None] Lock "cinder-quobyte-dfecbe55-0efa-40bb-af6a-a7cbefd0f955" released by "delete_snapshot" :: held 1.757s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:32:47 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-3db26f89-e47e-4a80-9503-07b8bd8405fd tempest-SnapshotMetadataTestJSON-2078962396 None] Created reservations ['e9e46504-0edd-46fc-bbe8-b40ac3894650', 'a24d3341-1076-4f64-a338-71955e48ff2e', 'de073f1d-8f7d-4781-9215-fc08df68a24d', '9fb8c105-677c-4895-9a6d-b194556ae46a'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:32:48 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-3db26f89-e47e-4a80-9503-07b8bd8405fd tempest-SnapshotMetadataTestJSON-2078962396 None] Delete snapshot completed successfully. Aug 26 14:32:48 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-3db26f89-e47e-4a80-9503-07b8bd8405fd tempest-SnapshotMetadataTestJSON-2078962396 None] Lock "cinder-7f7222f8-728e-4f62-bbfa-85365f67bbec-delete_snapshot" released by "delete_snapshot" :: held 2.007s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:32:48 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-5291df6c-7d95-42a8-a0f7-18f165e8bac0 tempest-SnapshotMetadataTestJSON-2078962396 None] Acquiring lock "cinder-dfecbe55-0efa-40bb-af6a-a7cbefd0f955-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:32:48 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-5291df6c-7d95-42a8-a0f7-18f165e8bac0 tempest-SnapshotMetadataTestJSON-2078962396 None] Lock "cinder-dfecbe55-0efa-40bb-af6a-a7cbefd0f955-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:32:48 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-5291df6c-7d95-42a8-a0f7-18f165e8bac0 tempest-SnapshotMetadataTestJSON-2078962396 None] Acquiring lock "cinder-quobyte-dfecbe55-0efa-40bb-af6a-a7cbefd0f955" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:32:48 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-5291df6c-7d95-42a8-a0f7-18f165e8bac0 tempest-SnapshotMetadataTestJSON-2078962396 None] Lock "cinder-quobyte-dfecbe55-0efa-40bb-af6a-a7cbefd0f955" acquired by "delete_volume" :: waited 0.021s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:32:48 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[1503287f-d0c4-4702-b7fd-8594785a88b4]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:32:48 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-5291df6c-7d95-42a8-a0f7-18f165e8bac0 tempest-SnapshotMetadataTestJSON-2078962396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-dfecbe55-0efa-40bb-af6a-a7cbefd0f955 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:32:48 devstack sudo[107232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-dfecbe55-0efa-40bb-af6a-a7cbefd0f955 Aug 26 14:32:48 devstack sudo[107232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:32:49 devstack sudo[107232]: pam_unix(sudo:session): session closed for user root Aug 26 14:32:49 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-5291df6c-7d95-42a8-a0f7-18f165e8bac0 tempest-SnapshotMetadataTestJSON-2078962396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-dfecbe55-0efa-40bb-af6a-a7cbefd0f955" returned: 0 in 0.547s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:32:49 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-5291df6c-7d95-42a8-a0f7-18f165e8bac0 tempest-SnapshotMetadataTestJSON-2078962396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-dfecbe55-0efa-40bb-af6a-a7cbefd0f955 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:32:49 devstack sudo[107237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-dfecbe55-0efa-40bb-af6a-a7cbefd0f955 Aug 26 14:32:49 devstack sudo[107237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:32:49 devstack sudo[107237]: pam_unix(sudo:session): session closed for user root Aug 26 14:32:49 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-5291df6c-7d95-42a8-a0f7-18f165e8bac0 tempest-SnapshotMetadataTestJSON-2078962396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-dfecbe55-0efa-40bb-af6a-a7cbefd0f955" returned: 0 in 0.349s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:32:49 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-5291df6c-7d95-42a8-a0f7-18f165e8bac0 tempest-SnapshotMetadataTestJSON-2078962396 None] Lock "cinder-quobyte-dfecbe55-0efa-40bb-af6a-a7cbefd0f955" released by "delete_volume" :: held 1.045s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:32:49 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-5291df6c-7d95-42a8-a0f7-18f165e8bac0 tempest-SnapshotMetadataTestJSON-2078962396 None] Created reservations ['2e85f0c2-5702-42cf-9d45-47cb372e4bfd', '8ce4fcbe-b3c3-4074-951d-0b73295dcdd2', '66deb6ea-bff5-4270-9294-7fcc269a6ffa', '3819be70-f272-46ad-85a8-cfa25e951855'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:32:49 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-5291df6c-7d95-42a8-a0f7-18f165e8bac0 tempest-SnapshotMetadataTestJSON-2078962396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:32:49 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-5291df6c-7d95-42a8-a0f7-18f165e8bac0 tempest-SnapshotMetadataTestJSON-2078962396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:32:49 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-5291df6c-7d95-42a8-a0f7-18f165e8bac0 tempest-SnapshotMetadataTestJSON-2078962396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:32:49 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-5291df6c-7d95-42a8-a0f7-18f165e8bac0 tempest-SnapshotMetadataTestJSON-2078962396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:32:49 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-5291df6c-7d95-42a8-a0f7-18f165e8bac0 tempest-SnapshotMetadataTestJSON-2078962396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:32:49 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-5291df6c-7d95-42a8-a0f7-18f165e8bac0 tempest-SnapshotMetadataTestJSON-2078962396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:32:49 devstack sudo[107240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:32:49 devstack sudo[107240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:32:49 devstack sudo[107240]: pam_unix(sudo:session): session closed for user root Aug 26 14:32:49 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-5291df6c-7d95-42a8-a0f7-18f165e8bac0 tempest-SnapshotMetadataTestJSON-2078962396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.308s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:32:49 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-5291df6c-7d95-42a8-a0f7-18f165e8bac0 tempest-SnapshotMetadataTestJSON-2078962396 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:32:49 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-5291df6c-7d95-42a8-a0f7-18f165e8bac0 tempest-SnapshotMetadataTestJSON-2078962396 None] Deleted volume successfully. Aug 26 14:32:49 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-5291df6c-7d95-42a8-a0f7-18f165e8bac0 tempest-SnapshotMetadataTestJSON-2078962396 None] Lock "cinder-dfecbe55-0efa-40bb-af6a-a7cbefd0f955-delete_volume" released by "delete_volume" :: held 1.650s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:32:52 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-52295b9c-8567-43b2-a250-ad590058c505 tempest-VolumesExtendTest-1078351233 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:32:52 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-52295b9c-8567-43b2-a250-ad590058c505 tempest-VolumesExtendTest-1078351233 None] Flow 'volume_create_manager' (84164249-dad3-46fe-aae3-edd1352831d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:32:52 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-52295b9c-8567-43b2-a250-ad590058c505 tempest-VolumesExtendTest-1078351233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a7ba8b2-2ab8-44b5-b438-53743a554890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:32:52 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-52295b9c-8567-43b2-a250-ad590058c505 tempest-VolumesExtendTest-1078351233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a7ba8b2-2ab8-44b5-b438-53743a554890) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:32:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1943346275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ecf426a-20b1-4c6f-b54f-4724218debb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d6dc6df74d442ea9f8607226675472c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:32:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:32:53Z,use_quota=True,user_id='b5eb6395fcc34962b2732c8a9f0e58c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:32:52 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-52295b9c-8567-43b2-a250-ad590058c505 tempest-VolumesExtendTest-1078351233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52464a87-9eaa-491a-a1c0-5132dd628272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:32:52 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-52295b9c-8567-43b2-a250-ad590058c505 tempest-VolumesExtendTest-1078351233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52464a87-9eaa-491a-a1c0-5132dd628272) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:32:52 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-52295b9c-8567-43b2-a250-ad590058c505 tempest-VolumesExtendTest-1078351233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e0b7b5c-deca-40da-ade4-c838fce66f71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:32:52 devstack cinder-volume[94394]: DEBUG cinder.image.glance [None req-52295b9c-8567-43b2-a250-ad590058c505 tempest-VolumesExtendTest-1078351233 None] Creating Keystone auth plugin from conf {{(pid=94394) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 26 14:32:53 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-52295b9c-8567-43b2-a250-ad590058c505 tempest-VolumesExtendTest-1078351233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e0b7b5c-deca-40da-ade4-c838fce66f71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2ecf426a-20b1-4c6f-b54f-4724218debb9', 'volume_name': 'volume-2ecf426a-20b1-4c6f-b54f-4724218debb9', 'volume_size': 1, 'image_id': '2681f5d8-1c86-4dfd-86fb-c29aaed49dc6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2681f5d8-1c86-4dfd-86fb-c29aaed49dc6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cbf977c46caa48c18e414079bf75016d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2681f5d8-1c86-4dfd-86fb-c29aaed49dc6', 'created_at': datetime.datetime(2026, 8, 26, 12, 16, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 12, 16, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2681f5d8-1c86-4dfd-86fb-c29aaed49dc6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:32:53 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-52295b9c-8567-43b2-a250-ad590058c505 tempest-VolumesExtendTest-1078351233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09be556b-1aac-44f5-ac32-2c601787957f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:32:53 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-52295b9c-8567-43b2-a250-ad590058c505 tempest-VolumesExtendTest-1078351233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09be556b-1aac-44f5-ac32-2c601787957f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:32:53 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-52295b9c-8567-43b2-a250-ad590058c505 tempest-VolumesExtendTest-1078351233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a80b34eb-8c02-45ea-8377-31691124f1cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:32:53 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-52295b9c-8567-43b2-a250-ad590058c505 tempest-VolumesExtendTest-1078351233 None] Volume 2ecf426a-20b1-4c6f-b54f-4724218debb9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2ecf426a-20b1-4c6f-b54f-4724218debb9', 'volume_size': 1, 'image_id': '2681f5d8-1c86-4dfd-86fb-c29aaed49dc6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2681f5d8-1c86-4dfd-86fb-c29aaed49dc6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cbf977c46caa48c18e414079bf75016d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2681f5d8-1c86-4dfd-86fb-c29aaed49dc6', 'created_at': datetime.datetime(2026, 8, 26, 12, 16, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 12, 16, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2681f5d8-1c86-4dfd-86fb-c29aaed49dc6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 26 14:32:53 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-52295b9c-8567-43b2-a250-ad590058c505 tempest-VolumesExtendTest-1078351233 None] Trying to clone 2ecf426a-20b1-4c6f-b54f-4724218debb9 from image 2681f5d8-1c86-4dfd-86fb-c29aaed49dc6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/2681f5d8-1c86-4dfd-86fb-c29aaed49dc6', 'metadata': {}}]). {{(pid=94394) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 26 14:32:53 devstack cinder-volume[94394]: DEBUG cinder.image.image_utils [None req-52295b9c-8567-43b2-a250-ad590058c505 tempest-VolumesExtendTest-1078351233 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2681f5d8-1c86-4dfd-86fb-c29aaed49dc6_o4n6o5tndevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=94394) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 26 14:32:53 devstack cinder-volume[94394]: INFO cinder.image.image_utils [None req-52295b9c-8567-43b2-a250-ad590058c505 tempest-VolumesExtendTest-1078351233 None] Image download 20.69 MB at 20.69 MB/s Aug 26 14:32:53 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a3ee266-60e8-4a8f-af08-78bb5710212f]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:32:53 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-52295b9c-8567-43b2-a250-ad590058c505 tempest-VolumesExtendTest-1078351233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2681f5d8-1c86-4dfd-86fb-c29aaed49dc6_o4n6o5tndevstack@QuobyteHD {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:32:53 devstack sudo[107245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2681f5d8-1c86-4dfd-86fb-c29aaed49dc6_o4n6o5tndevstack@QuobyteHD Aug 26 14:32:53 devstack sudo[107245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:32:54 devstack sudo[107245]: pam_unix(sudo:session): session closed for user root Aug 26 14:32:54 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-52295b9c-8567-43b2-a250-ad590058c505 tempest-VolumesExtendTest-1078351233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2681f5d8-1c86-4dfd-86fb-c29aaed49dc6_o4n6o5tndevstack@QuobyteHD" returned: 0 in 0.464s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:32:54 devstack cinder-volume[94394]: DEBUG cinder.image.image_utils [None req-52295b9c-8567-43b2-a250-ad590058c505 tempest-VolumesExtendTest-1078351233 None] Temporary image 2681f5d8-1c86-4dfd-86fb-c29aaed49dc6 is fetched for user b5eb6395fcc34962b2732c8a9f0e58c0. {{(pid=94394) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 26 14:32:54 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[70076490-aa21-4f06-b1f5-c68ffc012995]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:32:54 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-52295b9c-8567-43b2-a250-ad590058c505 tempest-VolumesExtendTest-1078351233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2681f5d8-1c86-4dfd-86fb-c29aaed49dc6_o4n6o5tndevstack@QuobyteHD {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:32:54 devstack sudo[107251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2681f5d8-1c86-4dfd-86fb-c29aaed49dc6_o4n6o5tndevstack@QuobyteHD Aug 26 14:32:54 devstack sudo[107251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:32:54 devstack sudo[107251]: pam_unix(sudo:session): session closed for user root Aug 26 14:32:54 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-52295b9c-8567-43b2-a250-ad590058c505 tempest-VolumesExtendTest-1078351233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2681f5d8-1c86-4dfd-86fb-c29aaed49dc6_o4n6o5tndevstack@QuobyteHD" returned: 0 in 0.382s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:32:54 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-52295b9c-8567-43b2-a250-ad590058c505 tempest-VolumesExtendTest-1078351233 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:32:54 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-52295b9c-8567-43b2-a250-ad590058c505 tempest-VolumesExtendTest-1078351233 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:32:54 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-52295b9c-8567-43b2-a250-ad590058c505 tempest-VolumesExtendTest-1078351233 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:32:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1943346275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ecf426a-20b1-4c6f-b54f-4724218debb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d6dc6df74d442ea9f8607226675472c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:32:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:32:53Z,use_quota=True,user_id='b5eb6395fcc34962b2732c8a9f0e58c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:32:54 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-52295b9c-8567-43b2-a250-ad590058c505 tempest-VolumesExtendTest-1078351233 None] Creating volume 2ecf426a-20b1-4c6f-b54f-4724218debb9 {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:32:54 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-52295b9c-8567-43b2-a250-ad590058c505 tempest-VolumesExtendTest-1078351233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:32:54 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-52295b9c-8567-43b2-a250-ad590058c505 tempest-VolumesExtendTest-1078351233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:32:54 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-52295b9c-8567-43b2-a250-ad590058c505 tempest-VolumesExtendTest-1078351233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:32:54 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-52295b9c-8567-43b2-a250-ad590058c505 tempest-VolumesExtendTest-1078351233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:32:54 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-52295b9c-8567-43b2-a250-ad590058c505 tempest-VolumesExtendTest-1078351233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:32:54 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-52295b9c-8567-43b2-a250-ad590058c505 tempest-VolumesExtendTest-1078351233 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:32:54 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-52295b9c-8567-43b2-a250-ad590058c505 tempest-VolumesExtendTest-1078351233 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:32:54 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-52295b9c-8567-43b2-a250-ad590058c505 tempest-VolumesExtendTest-1078351233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2ecf426a-20b1-4c6f-b54f-4724218debb9 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:32:54 devstack sudo[107257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2ecf426a-20b1-4c6f-b54f-4724218debb9 1073741824 Aug 26 14:32:54 devstack sudo[107257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:32:55 devstack sudo[107257]: pam_unix(sudo:session): session closed for user root Aug 26 14:32:55 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-52295b9c-8567-43b2-a250-ad590058c505 tempest-VolumesExtendTest-1078351233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2ecf426a-20b1-4c6f-b54f-4724218debb9 1073741824" returned: 0 in 0.687s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:32:55 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-52295b9c-8567-43b2-a250-ad590058c505 tempest-VolumesExtendTest-1078351233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2ecf426a-20b1-4c6f-b54f-4724218debb9 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:32:55 devstack sudo[107263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2ecf426a-20b1-4c6f-b54f-4724218debb9 Aug 26 14:32:55 devstack sudo[107263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:32:55 devstack sudo[107263]: pam_unix(sudo:session): session closed for user root Aug 26 14:32:55 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-52295b9c-8567-43b2-a250-ad590058c505 tempest-VolumesExtendTest-1078351233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2ecf426a-20b1-4c6f-b54f-4724218debb9" returned: 0 in 0.323s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:32:55 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-52295b9c-8567-43b2-a250-ad590058c505 tempest-VolumesExtendTest-1078351233 None] <== create_volume: return (1075ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:32:55 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-52295b9c-8567-43b2-a250-ad590058c505 tempest-VolumesExtendTest-1078351233 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.081s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:32:55 devstack cinder-volume[94394]: DEBUG cinder.volume.volume_utils [None req-52295b9c-8567-43b2-a250-ad590058c505 tempest-VolumesExtendTest-1078351233 None] Attempting download of 2681f5d8-1c86-4dfd-86fb-c29aaed49dc6 ((None, [{'url': 'file:///opt/stack/data/glance/images/2681f5d8-1c86-4dfd-86fb-c29aaed49dc6', 'metadata': {}}])) to volume 2ecf426a-20b1-4c6f-b54f-4724218debb9. {{(pid=94394) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 26 14:32:55 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[f50a4848-1c0d-41e0-8737-092b1edf93b5]: (4, 'raw') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:32:55 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-52295b9c-8567-43b2-a250-ad590058c505 tempest-VolumesExtendTest-1078351233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2681f5d8-1c86-4dfd-86fb-c29aaed49dc6_pedxmcez {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:32:55 devstack sudo[107266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2681f5d8-1c86-4dfd-86fb-c29aaed49dc6_pedxmcez Aug 26 14:32:55 devstack sudo[107266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:32:56 devstack sudo[107266]: pam_unix(sudo:session): session closed for user root Aug 26 14:32:56 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-52295b9c-8567-43b2-a250-ad590058c505 tempest-VolumesExtendTest-1078351233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2681f5d8-1c86-4dfd-86fb-c29aaed49dc6_pedxmcez" returned: 0 in 0.392s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:32:56 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-52295b9c-8567-43b2-a250-ad590058c505 tempest-VolumesExtendTest-1078351233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2681f5d8-1c86-4dfd-86fb-c29aaed49dc6_pedxmcez {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:32:56 devstack sudo[107270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2681f5d8-1c86-4dfd-86fb-c29aaed49dc6_pedxmcez Aug 26 14:32:56 devstack sudo[107270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:32:56 devstack sudo[107270]: pam_unix(sudo:session): session closed for user root Aug 26 14:32:56 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-52295b9c-8567-43b2-a250-ad590058c505 tempest-VolumesExtendTest-1078351233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2681f5d8-1c86-4dfd-86fb-c29aaed49dc6_pedxmcez" returned: 1 in 0.425s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:32:56 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-52295b9c-8567-43b2-a250-ad590058c505 tempest-VolumesExtendTest-1078351233 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2681f5d8-1c86-4dfd-86fb-c29aaed49dc6_pedxmcez' failed. Not Retrying. {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 14:32:56 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6fe0809-cdba-40f7-94ed-4cfc23502914]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:32:56 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-52295b9c-8567-43b2-a250-ad590058c505 tempest-VolumesExtendTest-1078351233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2681f5d8-1c86-4dfd-86fb-c29aaed49dc6_o4n6o5tndevstack@QuobyteHD {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:32:56 devstack sudo[107275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2681f5d8-1c86-4dfd-86fb-c29aaed49dc6_o4n6o5tndevstack@QuobyteHD Aug 26 14:32:56 devstack sudo[107275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:32:57 devstack sudo[107275]: pam_unix(sudo:session): session closed for user root Aug 26 14:32:57 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-52295b9c-8567-43b2-a250-ad590058c505 tempest-VolumesExtendTest-1078351233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2681f5d8-1c86-4dfd-86fb-c29aaed49dc6_o4n6o5tndevstack@QuobyteHD" returned: 0 in 0.392s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:32:57 devstack cinder-volume[94394]: DEBUG cinder.image.image_utils [None req-52295b9c-8567-43b2-a250-ad590058c505 tempest-VolumesExtendTest-1078351233 None] 2681f5d8-1c86-4dfd-86fb-c29aaed49dc6 was qcow2, converting to qcow2 {{(pid=94394) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 26 14:32:57 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-52295b9c-8567-43b2-a250-ad590058c505 tempest-VolumesExtendTest-1078351233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2681f5d8-1c86-4dfd-86fb-c29aaed49dc6_o4n6o5tndevstack@QuobyteHD /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2ecf426a-20b1-4c6f-b54f-4724218debb9 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:32:57 devstack sudo[107281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2681f5d8-1c86-4dfd-86fb-c29aaed49dc6_o4n6o5tndevstack@QuobyteHD /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2ecf426a-20b1-4c6f-b54f-4724218debb9 Aug 26 14:32:57 devstack sudo[107281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:32:59 devstack sudo[107281]: pam_unix(sudo:session): session closed for user root Aug 26 14:32:59 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-52295b9c-8567-43b2-a250-ad590058c505 tempest-VolumesExtendTest-1078351233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2681f5d8-1c86-4dfd-86fb-c29aaed49dc6_o4n6o5tndevstack@QuobyteHD /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2ecf426a-20b1-4c6f-b54f-4724218debb9" returned: 0 in 2.243s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:32:59 devstack cinder-volume[94394]: DEBUG cinder.image.image_utils [None req-52295b9c-8567-43b2-a250-ad590058c505 tempest-VolumesExtendTest-1078351233 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2681f5d8-1c86-4dfd-86fb-c29aaed49dc6_o4n6o5tndevstack@QuobyteHD, size 112.00 MB, duration 2.24 sec, destination /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2ecf426a-20b1-4c6f-b54f-4724218debb9 {{(pid=94394) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 14:32:59 devstack cinder-volume[94394]: INFO cinder.image.image_utils [None req-52295b9c-8567-43b2-a250-ad590058c505 tempest-VolumesExtendTest-1078351233 None] Converted 112.00 MB image at 49.90 MB/s Aug 26 14:32:59 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-52295b9c-8567-43b2-a250-ad590058c505 tempest-VolumesExtendTest-1078351233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2ecf426a-20b1-4c6f-b54f-4724218debb9 1G {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:32:59 devstack sudo[107289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2ecf426a-20b1-4c6f-b54f-4724218debb9 1G Aug 26 14:32:59 devstack sudo[107289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:32:59 devstack sudo[107289]: pam_unix(sudo:session): session closed for user root Aug 26 14:32:59 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-52295b9c-8567-43b2-a250-ad590058c505 tempest-VolumesExtendTest-1078351233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2ecf426a-20b1-4c6f-b54f-4724218debb9 1G" returned: 0 in 0.410s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:32:59 devstack cinder-volume[94394]: DEBUG cinder.volume.volume_utils [None req-52295b9c-8567-43b2-a250-ad590058c505 tempest-VolumesExtendTest-1078351233 None] Downloaded image 2681f5d8-1c86-4dfd-86fb-c29aaed49dc6 ((None, [{'url': 'file:///opt/stack/data/glance/images/2681f5d8-1c86-4dfd-86fb-c29aaed49dc6', 'metadata': {}}])) to volume 2ecf426a-20b1-4c6f-b54f-4724218debb9 successfully. {{(pid=94394) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 26 14:32:59 devstack cinder-volume[94394]: DEBUG cinder.image.image_utils [None req-52295b9c-8567-43b2-a250-ad590058c505 tempest-VolumesExtendTest-1078351233 None] Temporary image 2681f5d8-1c86-4dfd-86fb-c29aaed49dc6 for user b5eb6395fcc34962b2732c8a9f0e58c0 is deleted. {{(pid=94394) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 26 14:32:59 devstack cinder-volume[94394]: DEBUG cinder.volume.volume_utils [None req-52295b9c-8567-43b2-a250-ad590058c505 tempest-VolumesExtendTest-1078351233 None] Marking volume 2ecf426a-20b1-4c6f-b54f-4724218debb9 as bootable. {{(pid=94394) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 26 14:32:59 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-52295b9c-8567-43b2-a250-ad590058c505 tempest-VolumesExtendTest-1078351233 None] Copying metadata from image 2681f5d8-1c86-4dfd-86fb-c29aaed49dc6 to 2ecf426a-20b1-4c6f-b54f-4724218debb9. {{(pid=94394) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 26 14:32:59 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-52295b9c-8567-43b2-a250-ad590058c505 tempest-VolumesExtendTest-1078351233 None] Creating volume glance metadata for volume 2ecf426a-20b1-4c6f-b54f-4724218debb9 backed by image 2681f5d8-1c86-4dfd-86fb-c29aaed49dc6 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '2681f5d8-1c86-4dfd-86fb-c29aaed49dc6', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=94394) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 26 14:32:59 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-52295b9c-8567-43b2-a250-ad590058c505 tempest-VolumesExtendTest-1078351233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a80b34eb-8c02-45ea-8377-31691124f1cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ecf426a-20b1-4c6f-b54f-4724218debb9', 'volume_size': 1, 'image_id': '2681f5d8-1c86-4dfd-86fb-c29aaed49dc6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2681f5d8-1c86-4dfd-86fb-c29aaed49dc6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cbf977c46caa48c18e414079bf75016d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2681f5d8-1c86-4dfd-86fb-c29aaed49dc6', 'created_at': datetime.datetime(2026, 8, 26, 12, 16, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 12, 16, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2681f5d8-1c86-4dfd-86fb-c29aaed49dc6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:32:59 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-52295b9c-8567-43b2-a250-ad590058c505 tempest-VolumesExtendTest-1078351233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d220a461-aaef-4973-be9a-ab4c7e91f8c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:32:59 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-52295b9c-8567-43b2-a250-ad590058c505 tempest-VolumesExtendTest-1078351233 None] Volume volume-2ecf426a-20b1-4c6f-b54f-4724218debb9 (2ecf426a-20b1-4c6f-b54f-4724218debb9): created successfully Aug 26 14:32:59 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-52295b9c-8567-43b2-a250-ad590058c505 tempest-VolumesExtendTest-1078351233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d220a461-aaef-4973-be9a-ab4c7e91f8c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:32:59 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-52295b9c-8567-43b2-a250-ad590058c505 tempest-VolumesExtendTest-1078351233 None] Flow 'volume_create_manager' (84164249-dad3-46fe-aae3-edd1352831d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:32:59 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-52295b9c-8567-43b2-a250-ad590058c505 tempest-VolumesExtendTest-1078351233 None] Created volume successfully. Aug 26 14:33:00 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-8a5f63ee-9d39-41cf-920a-3d6e6880d020 tempest-VolumesExtendTest-1078351233 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:33:00 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-8a5f63ee-9d39-41cf-920a-3d6e6880d020 tempest-VolumesExtendTest-1078351233 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:33:00 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[89b36970-43b0-4761-8617-1590b5d06149]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:33:00 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-8a5f63ee-9d39-41cf-920a-3d6e6880d020 tempest-VolumesExtendTest-1078351233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2ecf426a-20b1-4c6f-b54f-4724218debb9 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:33:00 devstack sudo[107296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2ecf426a-20b1-4c6f-b54f-4724218debb9 Aug 26 14:33:00 devstack sudo[107296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:33:01 devstack sudo[107296]: pam_unix(sudo:session): session closed for user root Aug 26 14:33:01 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-8a5f63ee-9d39-41cf-920a-3d6e6880d020 tempest-VolumesExtendTest-1078351233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2ecf426a-20b1-4c6f-b54f-4724218debb9" returned: 0 in 0.621s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:33:01 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-8a5f63ee-9d39-41cf-920a-3d6e6880d020 tempest-VolumesExtendTest-1078351233 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2ecf426a-20b1-4c6f-b54f-4724218debb9 2G {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:33:01 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-8a5f63ee-9d39-41cf-920a-3d6e6880d020 tempest-VolumesExtendTest-1078351233 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2ecf426a-20b1-4c6f-b54f-4724218debb9 2G" returned: 0 in 0.148s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:33:01 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-8a5f63ee-9d39-41cf-920a-3d6e6880d020 tempest-VolumesExtendTest-1078351233 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.799s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:33:01 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-8a5f63ee-9d39-41cf-920a-3d6e6880d020 tempest-VolumesExtendTest-1078351233 None] Extend volume completed successfully. Aug 26 14:33:02 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-39d20fe2-98c1-4682-9c56-f048be19b32f tempest-VolumesExtendTest-1078351233 None] Acquiring lock "cinder-2ecf426a-20b1-4c6f-b54f-4724218debb9-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:33:02 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-39d20fe2-98c1-4682-9c56-f048be19b32f tempest-VolumesExtendTest-1078351233 None] Lock "cinder-2ecf426a-20b1-4c6f-b54f-4724218debb9-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:33:02 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-39d20fe2-98c1-4682-9c56-f048be19b32f tempest-VolumesExtendTest-1078351233 None] Acquiring lock "cinder-quobyte-2ecf426a-20b1-4c6f-b54f-4724218debb9" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:33:02 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-39d20fe2-98c1-4682-9c56-f048be19b32f tempest-VolumesExtendTest-1078351233 None] Lock "cinder-quobyte-2ecf426a-20b1-4c6f-b54f-4724218debb9" acquired by "delete_volume" :: waited 0.022s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:33:02 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[9681d0d4-0d94-45bc-bf29-bc70b211a50c]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:33:02 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-39d20fe2-98c1-4682-9c56-f048be19b32f tempest-VolumesExtendTest-1078351233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2ecf426a-20b1-4c6f-b54f-4724218debb9 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:33:02 devstack sudo[107304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2ecf426a-20b1-4c6f-b54f-4724218debb9 Aug 26 14:33:02 devstack sudo[107304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:33:02 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-c402be79-08c5-40e9-b902-7f411398c163 tempest-AbsoluteLimitsTests-1441498327 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:33:02 devstack sudo[107304]: pam_unix(sudo:session): session closed for user root Aug 26 14:33:02 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-c402be79-08c5-40e9-b902-7f411398c163 tempest-AbsoluteLimitsTests-1441498327 None] Flow 'volume_create_manager' (90632725-0d5a-426b-ad95-875fea7710c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:33:02 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-c402be79-08c5-40e9-b902-7f411398c163 tempest-AbsoluteLimitsTests-1441498327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d5a4be4-e1cd-4e4e-8e45-675b72c4f946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:33:02 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-39d20fe2-98c1-4682-9c56-f048be19b32f tempest-VolumesExtendTest-1078351233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2ecf426a-20b1-4c6f-b54f-4724218debb9" returned: 0 in 0.569s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:33:02 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-39d20fe2-98c1-4682-9c56-f048be19b32f tempest-VolumesExtendTest-1078351233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2ecf426a-20b1-4c6f-b54f-4724218debb9 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:33:02 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-c402be79-08c5-40e9-b902-7f411398c163 tempest-AbsoluteLimitsTests-1441498327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d5a4be4-e1cd-4e4e-8e45-675b72c4f946) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:33:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-961239815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e35d3c6-3289-4fff-8839-d0a1adbb7cf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bec2c9b41ef24095a07dfc1973bee666',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:33:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:33:03Z,use_quota=True,user_id='1dcd5ee99b6243109c960d554821743f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:33:02 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-c402be79-08c5-40e9-b902-7f411398c163 tempest-AbsoluteLimitsTests-1441498327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8eed6990-f40a-4287-93cf-cfc4a829aedc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:33:02 devstack sudo[107309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2ecf426a-20b1-4c6f-b54f-4724218debb9 Aug 26 14:33:02 devstack sudo[107309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:33:02 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-c402be79-08c5-40e9-b902-7f411398c163 tempest-AbsoluteLimitsTests-1441498327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8eed6990-f40a-4287-93cf-cfc4a829aedc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:33:02 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-c402be79-08c5-40e9-b902-7f411398c163 tempest-AbsoluteLimitsTests-1441498327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d057781-4ac0-43ce-b83c-147a52529fb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:33:02 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-c402be79-08c5-40e9-b902-7f411398c163 tempest-AbsoluteLimitsTests-1441498327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d057781-4ac0-43ce-b83c-147a52529fb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e35d3c6-3289-4fff-8839-d0a1adbb7cf7', 'volume_name': 'volume-7e35d3c6-3289-4fff-8839-d0a1adbb7cf7', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:33:02 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-c402be79-08c5-40e9-b902-7f411398c163 tempest-AbsoluteLimitsTests-1441498327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6bec43a-fca9-41e6-8945-362ad038d086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:33:02 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-c402be79-08c5-40e9-b902-7f411398c163 tempest-AbsoluteLimitsTests-1441498327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6bec43a-fca9-41e6-8945-362ad038d086) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:33:02 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-c402be79-08c5-40e9-b902-7f411398c163 tempest-AbsoluteLimitsTests-1441498327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52da92fe-0bae-45e2-9e1b-6d2c0f75dfb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:33:02 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-c402be79-08c5-40e9-b902-7f411398c163 tempest-AbsoluteLimitsTests-1441498327 None] Volume 7e35d3c6-3289-4fff-8839-d0a1adbb7cf7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e35d3c6-3289-4fff-8839-d0a1adbb7cf7', 'volume_size': 1} Aug 26 14:33:02 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-c402be79-08c5-40e9-b902-7f411398c163 tempest-AbsoluteLimitsTests-1441498327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:33:02 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-c402be79-08c5-40e9-b902-7f411398c163 tempest-AbsoluteLimitsTests-1441498327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:33:02 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-c402be79-08c5-40e9-b902-7f411398c163 tempest-AbsoluteLimitsTests-1441498327 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:33:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-961239815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e35d3c6-3289-4fff-8839-d0a1adbb7cf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bec2c9b41ef24095a07dfc1973bee666',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:33:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:33:03Z,use_quota=True,user_id='1dcd5ee99b6243109c960d554821743f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:33:02 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-c402be79-08c5-40e9-b902-7f411398c163 tempest-AbsoluteLimitsTests-1441498327 None] Creating volume 7e35d3c6-3289-4fff-8839-d0a1adbb7cf7 {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:33:02 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-c402be79-08c5-40e9-b902-7f411398c163 tempest-AbsoluteLimitsTests-1441498327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:33:02 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-c402be79-08c5-40e9-b902-7f411398c163 tempest-AbsoluteLimitsTests-1441498327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:33:02 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-c402be79-08c5-40e9-b902-7f411398c163 tempest-AbsoluteLimitsTests-1441498327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:33:02 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-c402be79-08c5-40e9-b902-7f411398c163 tempest-AbsoluteLimitsTests-1441498327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:33:02 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-c402be79-08c5-40e9-b902-7f411398c163 tempest-AbsoluteLimitsTests-1441498327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:33:02 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-c402be79-08c5-40e9-b902-7f411398c163 tempest-AbsoluteLimitsTests-1441498327 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:33:02 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-c402be79-08c5-40e9-b902-7f411398c163 tempest-AbsoluteLimitsTests-1441498327 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:33:02 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-c402be79-08c5-40e9-b902-7f411398c163 tempest-AbsoluteLimitsTests-1441498327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-7e35d3c6-3289-4fff-8839-d0a1adbb7cf7 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:33:02 devstack sudo[107311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-7e35d3c6-3289-4fff-8839-d0a1adbb7cf7 1073741824 Aug 26 14:33:02 devstack sudo[107311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:33:03 devstack sudo[107309]: pam_unix(sudo:session): session closed for user root Aug 26 14:33:03 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-39d20fe2-98c1-4682-9c56-f048be19b32f tempest-VolumesExtendTest-1078351233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2ecf426a-20b1-4c6f-b54f-4724218debb9" returned: 0 in 0.497s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:33:03 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-39d20fe2-98c1-4682-9c56-f048be19b32f tempest-VolumesExtendTest-1078351233 None] Lock "cinder-quobyte-2ecf426a-20b1-4c6f-b54f-4724218debb9" released by "delete_volume" :: held 1.115s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:33:03 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-39d20fe2-98c1-4682-9c56-f048be19b32f tempest-VolumesExtendTest-1078351233 None] Created reservations ['fc7dff95-c3d5-4a23-8015-cb047f8f51ae', '7191f34a-ebb2-47cf-8524-4d3920c41f4f', 'e0062095-52e7-4c35-b97d-82a9152772fc', 'a5d89a6c-8078-40a0-99fb-83d5a368a841'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:33:03 devstack sudo[107311]: pam_unix(sudo:session): session closed for user root Aug 26 14:33:03 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-c402be79-08c5-40e9-b902-7f411398c163 tempest-AbsoluteLimitsTests-1441498327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-7e35d3c6-3289-4fff-8839-d0a1adbb7cf7 1073741824" returned: 0 in 0.548s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:33:03 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-39d20fe2-98c1-4682-9c56-f048be19b32f tempest-VolumesExtendTest-1078351233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:33:03 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-39d20fe2-98c1-4682-9c56-f048be19b32f tempest-VolumesExtendTest-1078351233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:33:03 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-39d20fe2-98c1-4682-9c56-f048be19b32f tempest-VolumesExtendTest-1078351233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:33:03 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-39d20fe2-98c1-4682-9c56-f048be19b32f tempest-VolumesExtendTest-1078351233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:33:03 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-39d20fe2-98c1-4682-9c56-f048be19b32f tempest-VolumesExtendTest-1078351233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:33:03 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-39d20fe2-98c1-4682-9c56-f048be19b32f tempest-VolumesExtendTest-1078351233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:33:03 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-c402be79-08c5-40e9-b902-7f411398c163 tempest-AbsoluteLimitsTests-1441498327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-7e35d3c6-3289-4fff-8839-d0a1adbb7cf7 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:33:03 devstack sudo[107318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:33:03 devstack sudo[107318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:33:03 devstack sudo[107319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-7e35d3c6-3289-4fff-8839-d0a1adbb7cf7 Aug 26 14:33:03 devstack sudo[107319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:33:03 devstack sudo[107318]: pam_unix(sudo:session): session closed for user root Aug 26 14:33:03 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-39d20fe2-98c1-4682-9c56-f048be19b32f tempest-VolumesExtendTest-1078351233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.288s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:33:03 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-39d20fe2-98c1-4682-9c56-f048be19b32f tempest-VolumesExtendTest-1078351233 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:33:03 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-39d20fe2-98c1-4682-9c56-f048be19b32f tempest-VolumesExtendTest-1078351233 None] Deleted volume successfully. Aug 26 14:33:03 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-39d20fe2-98c1-4682-9c56-f048be19b32f tempest-VolumesExtendTest-1078351233 None] Lock "cinder-2ecf426a-20b1-4c6f-b54f-4724218debb9-delete_volume" released by "delete_volume" :: held 1.716s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:33:03 devstack sudo[107319]: pam_unix(sudo:session): session closed for user root Aug 26 14:33:03 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-c402be79-08c5-40e9-b902-7f411398c163 tempest-AbsoluteLimitsTests-1441498327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-7e35d3c6-3289-4fff-8839-d0a1adbb7cf7" returned: 0 in 0.372s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:33:03 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-c402be79-08c5-40e9-b902-7f411398c163 tempest-AbsoluteLimitsTests-1441498327 None] <== create_volume: return (1011ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:33:03 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-c402be79-08c5-40e9-b902-7f411398c163 tempest-AbsoluteLimitsTests-1441498327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.014s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:33:03 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-c402be79-08c5-40e9-b902-7f411398c163 tempest-AbsoluteLimitsTests-1441498327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52da92fe-0bae-45e2-9e1b-6d2c0f75dfb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e35d3c6-3289-4fff-8839-d0a1adbb7cf7', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:33:03 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-c402be79-08c5-40e9-b902-7f411398c163 tempest-AbsoluteLimitsTests-1441498327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ce481eb-3a7e-41f3-82bc-08bd116f91f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:33:03 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-c402be79-08c5-40e9-b902-7f411398c163 tempest-AbsoluteLimitsTests-1441498327 None] Volume volume-7e35d3c6-3289-4fff-8839-d0a1adbb7cf7 (7e35d3c6-3289-4fff-8839-d0a1adbb7cf7): created successfully Aug 26 14:33:03 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-c402be79-08c5-40e9-b902-7f411398c163 tempest-AbsoluteLimitsTests-1441498327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ce481eb-3a7e-41f3-82bc-08bd116f91f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:33:03 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-c402be79-08c5-40e9-b902-7f411398c163 tempest-AbsoluteLimitsTests-1441498327 None] Flow 'volume_create_manager' (90632725-0d5a-426b-ad95-875fea7710c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:33:03 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-c402be79-08c5-40e9-b902-7f411398c163 tempest-AbsoluteLimitsTests-1441498327 None] Created volume successfully. Aug 26 14:33:04 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-a69a4303-b20e-4311-b24e-66d216796f13 tempest-VolumesExtendTest-1078351233 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:33:05 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-a69a4303-b20e-4311-b24e-66d216796f13 tempest-VolumesExtendTest-1078351233 None] Flow 'volume_create_manager' (ed8ad00f-fd1d-4adc-98cf-e4994e127545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:33:05 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-a69a4303-b20e-4311-b24e-66d216796f13 tempest-VolumesExtendTest-1078351233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93edcc6f-6f9c-4143-b48a-76a9d2a6b4e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:33:05 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-33be28f2-f6b7-4105-9990-2a2597fe179b tempest-AbsoluteLimitsTests-1441498327 None] Acquiring lock "cinder-7e35d3c6-3289-4fff-8839-d0a1adbb7cf7-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:33:05 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-a69a4303-b20e-4311-b24e-66d216796f13 tempest-VolumesExtendTest-1078351233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93edcc6f-6f9c-4143-b48a-76a9d2a6b4e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:33:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1236196383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d48c167a-0ffb-4ad7-82d1-f1825eb154b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d6dc6df74d442ea9f8607226675472c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:33:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:33:05Z,use_quota=True,user_id='b5eb6395fcc34962b2732c8a9f0e58c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:33:05 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-a69a4303-b20e-4311-b24e-66d216796f13 tempest-VolumesExtendTest-1078351233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5148a1ac-0e0d-4a35-8ca9-055471bbb32d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:33:05 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-a69a4303-b20e-4311-b24e-66d216796f13 tempest-VolumesExtendTest-1078351233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5148a1ac-0e0d-4a35-8ca9-055471bbb32d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:33:05 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-a69a4303-b20e-4311-b24e-66d216796f13 tempest-VolumesExtendTest-1078351233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49275c50-dc53-4037-a048-ec2a2708a6fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:33:05 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-a69a4303-b20e-4311-b24e-66d216796f13 tempest-VolumesExtendTest-1078351233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49275c50-dc53-4037-a048-ec2a2708a6fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd48c167a-0ffb-4ad7-82d1-f1825eb154b9', 'volume_name': 'volume-d48c167a-0ffb-4ad7-82d1-f1825eb154b9', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:33:05 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-a69a4303-b20e-4311-b24e-66d216796f13 tempest-VolumesExtendTest-1078351233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d026c80d-7d74-4e8c-9204-b5bcd8bc10f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:33:05 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-a69a4303-b20e-4311-b24e-66d216796f13 tempest-VolumesExtendTest-1078351233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d026c80d-7d74-4e8c-9204-b5bcd8bc10f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:33:05 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-a69a4303-b20e-4311-b24e-66d216796f13 tempest-VolumesExtendTest-1078351233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e37d2cbd-3d0b-40e6-a352-ce9da1209eb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:33:05 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-a69a4303-b20e-4311-b24e-66d216796f13 tempest-VolumesExtendTest-1078351233 None] Volume d48c167a-0ffb-4ad7-82d1-f1825eb154b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d48c167a-0ffb-4ad7-82d1-f1825eb154b9', 'volume_size': 1} Aug 26 14:33:05 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-a69a4303-b20e-4311-b24e-66d216796f13 tempest-VolumesExtendTest-1078351233 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:33:05 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-a69a4303-b20e-4311-b24e-66d216796f13 tempest-VolumesExtendTest-1078351233 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:33:05 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-a69a4303-b20e-4311-b24e-66d216796f13 tempest-VolumesExtendTest-1078351233 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:33:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1236196383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d48c167a-0ffb-4ad7-82d1-f1825eb154b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d6dc6df74d442ea9f8607226675472c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:33:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:33:05Z,use_quota=True,user_id='b5eb6395fcc34962b2732c8a9f0e58c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:33:05 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-a69a4303-b20e-4311-b24e-66d216796f13 tempest-VolumesExtendTest-1078351233 None] Creating volume d48c167a-0ffb-4ad7-82d1-f1825eb154b9 {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:33:05 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-a69a4303-b20e-4311-b24e-66d216796f13 tempest-VolumesExtendTest-1078351233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:33:05 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-a69a4303-b20e-4311-b24e-66d216796f13 tempest-VolumesExtendTest-1078351233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:33:05 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-a69a4303-b20e-4311-b24e-66d216796f13 tempest-VolumesExtendTest-1078351233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:33:05 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-a69a4303-b20e-4311-b24e-66d216796f13 tempest-VolumesExtendTest-1078351233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:33:05 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-a69a4303-b20e-4311-b24e-66d216796f13 tempest-VolumesExtendTest-1078351233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:33:05 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-a69a4303-b20e-4311-b24e-66d216796f13 tempest-VolumesExtendTest-1078351233 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:33:05 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-a69a4303-b20e-4311-b24e-66d216796f13 tempest-VolumesExtendTest-1078351233 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:33:05 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-a69a4303-b20e-4311-b24e-66d216796f13 tempest-VolumesExtendTest-1078351233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d48c167a-0ffb-4ad7-82d1-f1825eb154b9 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:33:05 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-33be28f2-f6b7-4105-9990-2a2597fe179b tempest-AbsoluteLimitsTests-1441498327 None] Lock "cinder-7e35d3c6-3289-4fff-8839-d0a1adbb7cf7-delete_volume" acquired by "delete_volume" :: waited 0.089s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:33:05 devstack sudo[107324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d48c167a-0ffb-4ad7-82d1-f1825eb154b9 1073741824 Aug 26 14:33:05 devstack sudo[107324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:33:05 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-33be28f2-f6b7-4105-9990-2a2597fe179b tempest-AbsoluteLimitsTests-1441498327 None] Acquiring lock "cinder-quobyte-7e35d3c6-3289-4fff-8839-d0a1adbb7cf7" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:33:05 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-33be28f2-f6b7-4105-9990-2a2597fe179b tempest-AbsoluteLimitsTests-1441498327 None] Lock "cinder-quobyte-7e35d3c6-3289-4fff-8839-d0a1adbb7cf7" acquired by "delete_volume" :: waited 0.026s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:33:05 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6ac87a4-a5ce-4a84-b4b7-9e6d2615eee2]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:33:05 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-33be28f2-f6b7-4105-9990-2a2597fe179b tempest-AbsoluteLimitsTests-1441498327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-7e35d3c6-3289-4fff-8839-d0a1adbb7cf7 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:33:05 devstack sudo[107326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-7e35d3c6-3289-4fff-8839-d0a1adbb7cf7 Aug 26 14:33:05 devstack sudo[107326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:33:05 devstack sudo[107324]: pam_unix(sudo:session): session closed for user root Aug 26 14:33:05 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-a69a4303-b20e-4311-b24e-66d216796f13 tempest-VolumesExtendTest-1078351233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d48c167a-0ffb-4ad7-82d1-f1825eb154b9 1073741824" returned: 0 in 0.650s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:33:05 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-a69a4303-b20e-4311-b24e-66d216796f13 tempest-VolumesExtendTest-1078351233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d48c167a-0ffb-4ad7-82d1-f1825eb154b9 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:33:05 devstack sudo[107326]: pam_unix(sudo:session): session closed for user root Aug 26 14:33:05 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-33be28f2-f6b7-4105-9990-2a2597fe179b tempest-AbsoluteLimitsTests-1441498327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-7e35d3c6-3289-4fff-8839-d0a1adbb7cf7" returned: 0 in 0.550s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:33:05 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-33be28f2-f6b7-4105-9990-2a2597fe179b tempest-AbsoluteLimitsTests-1441498327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-7e35d3c6-3289-4fff-8839-d0a1adbb7cf7 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:33:05 devstack sudo[107336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d48c167a-0ffb-4ad7-82d1-f1825eb154b9 Aug 26 14:33:05 devstack sudo[107336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:33:05 devstack sudo[107337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-7e35d3c6-3289-4fff-8839-d0a1adbb7cf7 Aug 26 14:33:05 devstack sudo[107337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:33:06 devstack sudo[107336]: pam_unix(sudo:session): session closed for user root Aug 26 14:33:06 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-a69a4303-b20e-4311-b24e-66d216796f13 tempest-VolumesExtendTest-1078351233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d48c167a-0ffb-4ad7-82d1-f1825eb154b9" returned: 0 in 0.370s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:33:06 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-a69a4303-b20e-4311-b24e-66d216796f13 tempest-VolumesExtendTest-1078351233 None] <== create_volume: return (1079ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:33:06 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-a69a4303-b20e-4311-b24e-66d216796f13 tempest-VolumesExtendTest-1078351233 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.084s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:33:06 devstack sudo[107337]: pam_unix(sudo:session): session closed for user root Aug 26 14:33:06 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-33be28f2-f6b7-4105-9990-2a2597fe179b tempest-AbsoluteLimitsTests-1441498327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-7e35d3c6-3289-4fff-8839-d0a1adbb7cf7" returned: 0 in 0.361s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:33:06 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-a69a4303-b20e-4311-b24e-66d216796f13 tempest-VolumesExtendTest-1078351233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e37d2cbd-3d0b-40e6-a352-ce9da1209eb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d48c167a-0ffb-4ad7-82d1-f1825eb154b9', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:33:06 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-a69a4303-b20e-4311-b24e-66d216796f13 tempest-VolumesExtendTest-1078351233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (434c439e-a681-44ac-89f9-93fc30141d09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:33:06 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-33be28f2-f6b7-4105-9990-2a2597fe179b tempest-AbsoluteLimitsTests-1441498327 None] Lock "cinder-quobyte-7e35d3c6-3289-4fff-8839-d0a1adbb7cf7" released by "delete_volume" :: held 0.995s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:33:06 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-a69a4303-b20e-4311-b24e-66d216796f13 tempest-VolumesExtendTest-1078351233 None] Volume volume-d48c167a-0ffb-4ad7-82d1-f1825eb154b9 (d48c167a-0ffb-4ad7-82d1-f1825eb154b9): created successfully Aug 26 14:33:06 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-a69a4303-b20e-4311-b24e-66d216796f13 tempest-VolumesExtendTest-1078351233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (434c439e-a681-44ac-89f9-93fc30141d09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:33:06 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-a69a4303-b20e-4311-b24e-66d216796f13 tempest-VolumesExtendTest-1078351233 None] Flow 'volume_create_manager' (ed8ad00f-fd1d-4adc-98cf-e4994e127545) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:33:06 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-a69a4303-b20e-4311-b24e-66d216796f13 tempest-VolumesExtendTest-1078351233 None] Created volume successfully. Aug 26 14:33:06 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-33be28f2-f6b7-4105-9990-2a2597fe179b tempest-AbsoluteLimitsTests-1441498327 None] Created reservations ['d668a47b-7555-4cce-a268-bc940a2ae924', '8ad839e0-b0eb-4388-becc-7ad65c6f8c99', '9e4dda16-739c-4995-a783-6a7cbe207014', '64d66477-b6f6-4ab1-8a82-b160ea68cd9a'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:33:06 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-33be28f2-f6b7-4105-9990-2a2597fe179b tempest-AbsoluteLimitsTests-1441498327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:33:06 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-33be28f2-f6b7-4105-9990-2a2597fe179b tempest-AbsoluteLimitsTests-1441498327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:33:06 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-33be28f2-f6b7-4105-9990-2a2597fe179b tempest-AbsoluteLimitsTests-1441498327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:33:06 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-33be28f2-f6b7-4105-9990-2a2597fe179b tempest-AbsoluteLimitsTests-1441498327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:33:06 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-33be28f2-f6b7-4105-9990-2a2597fe179b tempest-AbsoluteLimitsTests-1441498327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:33:06 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-33be28f2-f6b7-4105-9990-2a2597fe179b tempest-AbsoluteLimitsTests-1441498327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:33:06 devstack sudo[107342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:33:06 devstack sudo[107342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:33:06 devstack sudo[107342]: pam_unix(sudo:session): session closed for user root Aug 26 14:33:06 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-33be28f2-f6b7-4105-9990-2a2597fe179b tempest-AbsoluteLimitsTests-1441498327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.263s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:33:06 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-33be28f2-f6b7-4105-9990-2a2597fe179b tempest-AbsoluteLimitsTests-1441498327 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:33:06 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-33be28f2-f6b7-4105-9990-2a2597fe179b tempest-AbsoluteLimitsTests-1441498327 None] Deleted volume successfully. Aug 26 14:33:06 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-33be28f2-f6b7-4105-9990-2a2597fe179b tempest-AbsoluteLimitsTests-1441498327 None] Lock "cinder-7e35d3c6-3289-4fff-8839-d0a1adbb7cf7-delete_volume" released by "delete_volume" :: held 1.533s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:33:07 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-cc5db2d9-5d42-43cf-95cb-d605e71ec526 tempest-VolumesExtendTest-1078351233 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:33:07 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-cc5db2d9-5d42-43cf-95cb-d605e71ec526 tempest-VolumesExtendTest-1078351233 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:33:07 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-cc5db2d9-5d42-43cf-95cb-d605e71ec526 tempest-VolumesExtendTest-1078351233 None] Creating offline snapshot c89b90e8-287a-4ba5-91ea-2db217012e56 of volume d48c167a-0ffb-4ad7-82d1-f1825eb154b9 {{(pid=94394) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 14:33:07 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[bac3c033-1ad5-4243-b31b-1244e59a43e2]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:33:07 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-cc5db2d9-5d42-43cf-95cb-d605e71ec526 tempest-VolumesExtendTest-1078351233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d48c167a-0ffb-4ad7-82d1-f1825eb154b9 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:33:07 devstack sudo[107345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d48c167a-0ffb-4ad7-82d1-f1825eb154b9 Aug 26 14:33:07 devstack sudo[107345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:33:07 devstack sudo[107345]: pam_unix(sudo:session): session closed for user root Aug 26 14:33:07 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-cc5db2d9-5d42-43cf-95cb-d605e71ec526 tempest-VolumesExtendTest-1078351233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d48c167a-0ffb-4ad7-82d1-f1825eb154b9" returned: 0 in 0.512s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:33:07 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-cc5db2d9-5d42-43cf-95cb-d605e71ec526 tempest-VolumesExtendTest-1078351233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d48c167a-0ffb-4ad7-82d1-f1825eb154b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d48c167a-0ffb-4ad7-82d1-f1825eb154b9.c89b90e8-287a-4ba5-91ea-2db217012e56 1G {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:33:07 devstack sudo[107350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d48c167a-0ffb-4ad7-82d1-f1825eb154b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d48c167a-0ffb-4ad7-82d1-f1825eb154b9.c89b90e8-287a-4ba5-91ea-2db217012e56 1G Aug 26 14:33:07 devstack sudo[107350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:33:08 devstack sudo[107350]: pam_unix(sudo:session): session closed for user root Aug 26 14:33:08 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-cc5db2d9-5d42-43cf-95cb-d605e71ec526 tempest-VolumesExtendTest-1078351233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d48c167a-0ffb-4ad7-82d1-f1825eb154b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d48c167a-0ffb-4ad7-82d1-f1825eb154b9.c89b90e8-287a-4ba5-91ea-2db217012e56 1G" returned: 0 in 0.604s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:33:08 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-cc5db2d9-5d42-43cf-95cb-d605e71ec526 tempest-VolumesExtendTest-1078351233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d48c167a-0ffb-4ad7-82d1-f1825eb154b9 -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d48c167a-0ffb-4ad7-82d1-f1825eb154b9.c89b90e8-287a-4ba5-91ea-2db217012e56 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:33:08 devstack sudo[107356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d48c167a-0ffb-4ad7-82d1-f1825eb154b9 -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d48c167a-0ffb-4ad7-82d1-f1825eb154b9.c89b90e8-287a-4ba5-91ea-2db217012e56 Aug 26 14:33:08 devstack sudo[107356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:33:08 devstack sudo[107356]: pam_unix(sudo:session): session closed for user root Aug 26 14:33:08 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-cc5db2d9-5d42-43cf-95cb-d605e71ec526 tempest-VolumesExtendTest-1078351233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d48c167a-0ffb-4ad7-82d1-f1825eb154b9 -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d48c167a-0ffb-4ad7-82d1-f1825eb154b9.c89b90e8-287a-4ba5-91ea-2db217012e56" returned: 0 in 0.376s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:33:08 devstack cinder-volume[94394]: WARNING cinder.volume.drivers.remotefs [None req-cc5db2d9-5d42-43cf-95cb-d605e71ec526 tempest-VolumesExtendTest-1078351233 None] /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d48c167a-0ffb-4ad7-82d1-f1825eb154b9.c89b90e8-287a-4ba5-91ea-2db217012e56 is being set with open permissions: ugo+rw Aug 26 14:33:08 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-cc5db2d9-5d42-43cf-95cb-d605e71ec526 tempest-VolumesExtendTest-1078351233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d48c167a-0ffb-4ad7-82d1-f1825eb154b9.c89b90e8-287a-4ba5-91ea-2db217012e56 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:33:08 devstack sudo[107362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d48c167a-0ffb-4ad7-82d1-f1825eb154b9.c89b90e8-287a-4ba5-91ea-2db217012e56 Aug 26 14:33:08 devstack sudo[107362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:33:09 devstack sudo[107362]: pam_unix(sudo:session): session closed for user root Aug 26 14:33:09 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-cc5db2d9-5d42-43cf-95cb-d605e71ec526 tempest-VolumesExtendTest-1078351233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d48c167a-0ffb-4ad7-82d1-f1825eb154b9.c89b90e8-287a-4ba5-91ea-2db217012e56" returned: 0 in 0.287s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:33:09 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-cc5db2d9-5d42-43cf-95cb-d605e71ec526 tempest-VolumesExtendTest-1078351233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d48c167a-0ffb-4ad7-82d1-f1825eb154b9.info {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:33:09 devstack sudo[107365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d48c167a-0ffb-4ad7-82d1-f1825eb154b9.info Aug 26 14:33:09 devstack sudo[107365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:33:09 devstack sudo[107365]: pam_unix(sudo:session): session closed for user root Aug 26 14:33:09 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-cc5db2d9-5d42-43cf-95cb-d605e71ec526 tempest-VolumesExtendTest-1078351233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d48c167a-0ffb-4ad7-82d1-f1825eb154b9.info" returned: 0 in 0.305s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:33:09 devstack cinder-volume[94394]: WARNING cinder.volume.drivers.remotefs [None req-cc5db2d9-5d42-43cf-95cb-d605e71ec526 tempest-VolumesExtendTest-1078351233 None] /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d48c167a-0ffb-4ad7-82d1-f1825eb154b9.info is being set with open permissions: ugo+rw Aug 26 14:33:09 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-cc5db2d9-5d42-43cf-95cb-d605e71ec526 tempest-VolumesExtendTest-1078351233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d48c167a-0ffb-4ad7-82d1-f1825eb154b9.info {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:33:09 devstack sudo[107368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d48c167a-0ffb-4ad7-82d1-f1825eb154b9.info Aug 26 14:33:09 devstack sudo[107368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:33:09 devstack sudo[107368]: pam_unix(sudo:session): session closed for user root Aug 26 14:33:09 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-cc5db2d9-5d42-43cf-95cb-d605e71ec526 tempest-VolumesExtendTest-1078351233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d48c167a-0ffb-4ad7-82d1-f1825eb154b9.info" returned: 0 in 0.340s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:33:09 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-cc5db2d9-5d42-43cf-95cb-d605e71ec526 tempest-VolumesExtendTest-1078351233 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.559s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:33:09 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-cc5db2d9-5d42-43cf-95cb-d605e71ec526 tempest-VolumesExtendTest-1078351233 None] Create snapshot completed successfully Aug 26 14:33:10 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-54900bb2-fadd-491d-8c1b-9ff30180cdaa tempest-VolumesExtendTest-1078351233 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:33:10 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-54900bb2-fadd-491d-8c1b-9ff30180cdaa tempest-VolumesExtendTest-1078351233 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.002s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:33:10 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[134d4d1a-0a3c-4b0f-9136-4b3c4e00f5b7]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:33:10 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-54900bb2-fadd-491d-8c1b-9ff30180cdaa tempest-VolumesExtendTest-1078351233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d48c167a-0ffb-4ad7-82d1-f1825eb154b9 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:33:10 devstack sudo[107375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d48c167a-0ffb-4ad7-82d1-f1825eb154b9 Aug 26 14:33:10 devstack sudo[107375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:33:11 devstack sudo[107375]: pam_unix(sudo:session): session closed for user root Aug 26 14:33:11 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-54900bb2-fadd-491d-8c1b-9ff30180cdaa tempest-VolumesExtendTest-1078351233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d48c167a-0ffb-4ad7-82d1-f1825eb154b9" returned: 0 in 0.526s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:33:11 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-54900bb2-fadd-491d-8c1b-9ff30180cdaa tempest-VolumesExtendTest-1078351233 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d48c167a-0ffb-4ad7-82d1-f1825eb154b9.c89b90e8-287a-4ba5-91ea-2db217012e56 2G {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:33:11 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-54900bb2-fadd-491d-8c1b-9ff30180cdaa tempest-VolumesExtendTest-1078351233 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d48c167a-0ffb-4ad7-82d1-f1825eb154b9.c89b90e8-287a-4ba5-91ea-2db217012e56 2G" returned: 0 in 0.169s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:33:11 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-54900bb2-fadd-491d-8c1b-9ff30180cdaa tempest-VolumesExtendTest-1078351233 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.753s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:33:11 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-54900bb2-fadd-491d-8c1b-9ff30180cdaa tempest-VolumesExtendTest-1078351233 None] Extend volume completed successfully. Aug 26 14:33:12 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-95ddf624-7323-4b37-9e25-6fd5f2add8c2 tempest-VolumesExtendTest-1078351233 None] Acquiring lock "cinder-c89b90e8-287a-4ba5-91ea-2db217012e56-delete_snapshot" by "delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:33:12 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-95ddf624-7323-4b37-9e25-6fd5f2add8c2 tempest-VolumesExtendTest-1078351233 None] Lock "cinder-c89b90e8-287a-4ba5-91ea-2db217012e56-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:33:12 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-95ddf624-7323-4b37-9e25-6fd5f2add8c2 tempest-VolumesExtendTest-1078351233 None] Acquiring lock "cinder-quobyte-d48c167a-0ffb-4ad7-82d1-f1825eb154b9" by "delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:33:12 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-95ddf624-7323-4b37-9e25-6fd5f2add8c2 tempest-VolumesExtendTest-1078351233 None] Lock "cinder-quobyte-d48c167a-0ffb-4ad7-82d1-f1825eb154b9" acquired by "delete_snapshot" :: waited 0.026s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:33:12 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-95ddf624-7323-4b37-9e25-6fd5f2add8c2 tempest-VolumesExtendTest-1078351233 None] Acquiring lock "cinder-quobyte-c89b90e8-287a-4ba5-91ea-2db217012e56" by "_delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:33:12 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-95ddf624-7323-4b37-9e25-6fd5f2add8c2 tempest-VolumesExtendTest-1078351233 None] Lock "cinder-quobyte-c89b90e8-287a-4ba5-91ea-2db217012e56" acquired by "_delete_snapshot" :: waited 0.058s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:33:12 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-95ddf624-7323-4b37-9e25-6fd5f2add8c2 tempest-VolumesExtendTest-1078351233 None] Deleting offline snapshot c89b90e8-287a-4ba5-91ea-2db217012e56 of volume d48c167a-0ffb-4ad7-82d1-f1825eb154b9 {{(pid=94394) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 14:33:12 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-95ddf624-7323-4b37-9e25-6fd5f2add8c2 tempest-VolumesExtendTest-1078351233 None] snapshot_file for this snap is: volume-d48c167a-0ffb-4ad7-82d1-f1825eb154b9.c89b90e8-287a-4ba5-91ea-2db217012e56 {{(pid=94394) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 14:33:12 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b11ac4d-8efd-4002-bca4-c791ce2175c8]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:33:12 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-95ddf624-7323-4b37-9e25-6fd5f2add8c2 tempest-VolumesExtendTest-1078351233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d48c167a-0ffb-4ad7-82d1-f1825eb154b9.c89b90e8-287a-4ba5-91ea-2db217012e56 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:33:12 devstack sudo[107385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d48c167a-0ffb-4ad7-82d1-f1825eb154b9.c89b90e8-287a-4ba5-91ea-2db217012e56 Aug 26 14:33:12 devstack sudo[107385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:33:12 devstack sudo[107385]: pam_unix(sudo:session): session closed for user root Aug 26 14:33:12 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-95ddf624-7323-4b37-9e25-6fd5f2add8c2 tempest-VolumesExtendTest-1078351233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d48c167a-0ffb-4ad7-82d1-f1825eb154b9.c89b90e8-287a-4ba5-91ea-2db217012e56" returned: 0 in 0.549s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:33:12 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-95ddf624-7323-4b37-9e25-6fd5f2add8c2 tempest-VolumesExtendTest-1078351233 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d48c167a-0ffb-4ad7-82d1-f1825eb154b9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94394) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 14:33:12 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[42760eeb-eb42-4e54-a733-13b18b6939fe]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:33:12 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-95ddf624-7323-4b37-9e25-6fd5f2add8c2 tempest-VolumesExtendTest-1078351233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d48c167a-0ffb-4ad7-82d1-f1825eb154b9 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:33:13 devstack sudo[107399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d48c167a-0ffb-4ad7-82d1-f1825eb154b9 Aug 26 14:33:13 devstack sudo[107399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:33:13 devstack sudo[107399]: pam_unix(sudo:session): session closed for user root Aug 26 14:33:13 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-95ddf624-7323-4b37-9e25-6fd5f2add8c2 tempest-VolumesExtendTest-1078351233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d48c167a-0ffb-4ad7-82d1-f1825eb154b9" returned: 0 in 0.478s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:33:13 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-95ddf624-7323-4b37-9e25-6fd5f2add8c2 tempest-VolumesExtendTest-1078351233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d48c167a-0ffb-4ad7-82d1-f1825eb154b9.c89b90e8-287a-4ba5-91ea-2db217012e56 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:33:13 devstack sudo[107411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d48c167a-0ffb-4ad7-82d1-f1825eb154b9.c89b90e8-287a-4ba5-91ea-2db217012e56 Aug 26 14:33:13 devstack sudo[107411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:33:13 devstack sudo[107411]: pam_unix(sudo:session): session closed for user root Aug 26 14:33:13 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-95ddf624-7323-4b37-9e25-6fd5f2add8c2 tempest-VolumesExtendTest-1078351233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d48c167a-0ffb-4ad7-82d1-f1825eb154b9.c89b90e8-287a-4ba5-91ea-2db217012e56" returned: 0 in 0.525s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:33:13 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-95ddf624-7323-4b37-9e25-6fd5f2add8c2 tempest-VolumesExtendTest-1078351233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d48c167a-0ffb-4ad7-82d1-f1825eb154b9.c89b90e8-287a-4ba5-91ea-2db217012e56 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:33:13 devstack sudo[107417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d48c167a-0ffb-4ad7-82d1-f1825eb154b9.c89b90e8-287a-4ba5-91ea-2db217012e56 Aug 26 14:33:13 devstack sudo[107417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:33:14 devstack sudo[107417]: pam_unix(sudo:session): session closed for user root Aug 26 14:33:14 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-95ddf624-7323-4b37-9e25-6fd5f2add8c2 tempest-VolumesExtendTest-1078351233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d48c167a-0ffb-4ad7-82d1-f1825eb154b9.c89b90e8-287a-4ba5-91ea-2db217012e56" returned: 0 in 0.306s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:33:14 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-95ddf624-7323-4b37-9e25-6fd5f2add8c2 tempest-VolumesExtendTest-1078351233 None] Lock "cinder-quobyte-c89b90e8-287a-4ba5-91ea-2db217012e56" released by "_delete_snapshot" :: held 2.050s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:33:14 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-95ddf624-7323-4b37-9e25-6fd5f2add8c2 tempest-VolumesExtendTest-1078351233 None] Lock "cinder-quobyte-d48c167a-0ffb-4ad7-82d1-f1825eb154b9" released by "delete_snapshot" :: held 2.117s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:33:14 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-95ddf624-7323-4b37-9e25-6fd5f2add8c2 tempest-VolumesExtendTest-1078351233 None] Created reservations ['f19e8b2c-9fa7-45e0-8c48-967606a0814e', '9d182af8-8f87-4fb3-aa0a-1f4cb5b635d3', 'e1749a25-98a7-4541-b721-2a18a275711a', '9ada1f6c-ffdb-43ce-985c-1a63d51f0445'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:33:14 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-95ddf624-7323-4b37-9e25-6fd5f2add8c2 tempest-VolumesExtendTest-1078351233 None] Delete snapshot completed successfully. Aug 26 14:33:14 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-95ddf624-7323-4b37-9e25-6fd5f2add8c2 tempest-VolumesExtendTest-1078351233 None] Lock "cinder-c89b90e8-287a-4ba5-91ea-2db217012e56-delete_snapshot" released by "delete_snapshot" :: held 2.301s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:33:15 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-a439693b-070b-41da-bb86-09e4de4ac4ea tempest-VolumesExtendTest-1078351233 None] Acquiring lock "cinder-d48c167a-0ffb-4ad7-82d1-f1825eb154b9-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:33:15 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-a439693b-070b-41da-bb86-09e4de4ac4ea tempest-VolumesExtendTest-1078351233 None] Lock "cinder-d48c167a-0ffb-4ad7-82d1-f1825eb154b9-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:33:15 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-a439693b-070b-41da-bb86-09e4de4ac4ea tempest-VolumesExtendTest-1078351233 None] Acquiring lock "cinder-quobyte-d48c167a-0ffb-4ad7-82d1-f1825eb154b9" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:33:15 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-a439693b-070b-41da-bb86-09e4de4ac4ea tempest-VolumesExtendTest-1078351233 None] Lock "cinder-quobyte-d48c167a-0ffb-4ad7-82d1-f1825eb154b9" acquired by "delete_volume" :: waited 0.024s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:33:15 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b6cfb3f-b919-41c7-be3d-898160a9e3f2]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:33:15 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-a439693b-070b-41da-bb86-09e4de4ac4ea tempest-VolumesExtendTest-1078351233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d48c167a-0ffb-4ad7-82d1-f1825eb154b9 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:33:15 devstack sudo[107421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d48c167a-0ffb-4ad7-82d1-f1825eb154b9 Aug 26 14:33:15 devstack sudo[107421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:33:16 devstack sudo[107421]: pam_unix(sudo:session): session closed for user root Aug 26 14:33:16 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-a439693b-070b-41da-bb86-09e4de4ac4ea tempest-VolumesExtendTest-1078351233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d48c167a-0ffb-4ad7-82d1-f1825eb154b9" returned: 0 in 0.531s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:33:16 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-a439693b-070b-41da-bb86-09e4de4ac4ea tempest-VolumesExtendTest-1078351233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d48c167a-0ffb-4ad7-82d1-f1825eb154b9 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:33:16 devstack sudo[107427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d48c167a-0ffb-4ad7-82d1-f1825eb154b9 Aug 26 14:33:16 devstack sudo[107427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:33:16 devstack sudo[107427]: pam_unix(sudo:session): session closed for user root Aug 26 14:33:16 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-a439693b-070b-41da-bb86-09e4de4ac4ea tempest-VolumesExtendTest-1078351233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d48c167a-0ffb-4ad7-82d1-f1825eb154b9" returned: 0 in 0.562s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:33:16 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-a439693b-070b-41da-bb86-09e4de4ac4ea tempest-VolumesExtendTest-1078351233 None] Lock "cinder-quobyte-d48c167a-0ffb-4ad7-82d1-f1825eb154b9" released by "delete_volume" :: held 1.228s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:33:16 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-a439693b-070b-41da-bb86-09e4de4ac4ea tempest-VolumesExtendTest-1078351233 None] Created reservations ['f9c7dae9-044f-496a-b90a-53a6b9fde480', '34481572-2eae-4654-8675-a89a71c22ac0', '8c655b2d-80bd-4c4c-8f05-742499173084', 'f76e5fc2-469d-4521-bcca-524088610e32'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:33:17 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-a439693b-070b-41da-bb86-09e4de4ac4ea tempest-VolumesExtendTest-1078351233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:33:17 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-a439693b-070b-41da-bb86-09e4de4ac4ea tempest-VolumesExtendTest-1078351233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:33:17 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-a439693b-070b-41da-bb86-09e4de4ac4ea tempest-VolumesExtendTest-1078351233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:33:17 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-a439693b-070b-41da-bb86-09e4de4ac4ea tempest-VolumesExtendTest-1078351233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:33:17 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-a439693b-070b-41da-bb86-09e4de4ac4ea tempest-VolumesExtendTest-1078351233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:33:17 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-a439693b-070b-41da-bb86-09e4de4ac4ea tempest-VolumesExtendTest-1078351233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:33:17 devstack sudo[107467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:33:17 devstack sudo[107467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:33:17 devstack sudo[107467]: pam_unix(sudo:session): session closed for user root Aug 26 14:33:17 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-a439693b-070b-41da-bb86-09e4de4ac4ea tempest-VolumesExtendTest-1078351233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.552s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:33:17 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-a439693b-070b-41da-bb86-09e4de4ac4ea tempest-VolumesExtendTest-1078351233 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:33:17 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-a439693b-070b-41da-bb86-09e4de4ac4ea tempest-VolumesExtendTest-1078351233 None] Deleted volume successfully. Aug 26 14:33:17 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-a439693b-070b-41da-bb86-09e4de4ac4ea tempest-VolumesExtendTest-1078351233 None] Lock "cinder-d48c167a-0ffb-4ad7-82d1-f1825eb154b9-delete_volume" released by "delete_volume" :: held 2.275s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:33:18 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a529730-a6f6-4972-b2b4-2f2e81eab7be tempest-TestShelveInstance-576226965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:33:18 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-8a529730-a6f6-4972-b2b4-2f2e81eab7be tempest-TestShelveInstance-576226965 None] Flow 'volume_create_manager' (5d53e5ec-7b16-4439-b929-89811019583f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:33:18 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-8a529730-a6f6-4972-b2b4-2f2e81eab7be tempest-TestShelveInstance-576226965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc925f0d-5272-4d44-90c1-953c3c37664b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:33:18 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-8a529730-a6f6-4972-b2b4-2f2e81eab7be tempest-TestShelveInstance-576226965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc925f0d-5272-4d44-90c1-953c3c37664b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:33:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1808178822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b7c1dab-36c9-4a0a-a516-ee8e96311a19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83d1775456cb46ee82f545eb4b68206f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:33:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:33:19Z,use_quota=True,user_id='f54c084d5aa745e6ae421a072d48479d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:33:18 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-8a529730-a6f6-4972-b2b4-2f2e81eab7be tempest-TestShelveInstance-576226965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce0b9df7-f068-480e-b89d-b8f4030b52b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:33:18 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-8a529730-a6f6-4972-b2b4-2f2e81eab7be tempest-TestShelveInstance-576226965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce0b9df7-f068-480e-b89d-b8f4030b52b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:33:18 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-8a529730-a6f6-4972-b2b4-2f2e81eab7be tempest-TestShelveInstance-576226965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fc59067-376c-4d8e-8213-01cdd3d300c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:33:18 devstack cinder-volume[94394]: DEBUG cinder.image.glance [None req-8a529730-a6f6-4972-b2b4-2f2e81eab7be tempest-TestShelveInstance-576226965 None] Creating Keystone auth plugin from conf {{(pid=94394) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 26 14:33:19 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-8a529730-a6f6-4972-b2b4-2f2e81eab7be tempest-TestShelveInstance-576226965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fc59067-376c-4d8e-8213-01cdd3d300c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3b7c1dab-36c9-4a0a-a516-ee8e96311a19', 'volume_name': 'volume-3b7c1dab-36c9-4a0a-a516-ee8e96311a19', 'volume_size': 1, 'image_id': '2681f5d8-1c86-4dfd-86fb-c29aaed49dc6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2681f5d8-1c86-4dfd-86fb-c29aaed49dc6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cbf977c46caa48c18e414079bf75016d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2681f5d8-1c86-4dfd-86fb-c29aaed49dc6', 'created_at': datetime.datetime(2026, 8, 26, 12, 16, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 12, 16, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2681f5d8-1c86-4dfd-86fb-c29aaed49dc6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:33:19 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-8a529730-a6f6-4972-b2b4-2f2e81eab7be tempest-TestShelveInstance-576226965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4436fa51-bdcf-4380-80b9-197fca2a515b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:33:19 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-8a529730-a6f6-4972-b2b4-2f2e81eab7be tempest-TestShelveInstance-576226965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4436fa51-bdcf-4380-80b9-197fca2a515b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:33:19 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-8a529730-a6f6-4972-b2b4-2f2e81eab7be tempest-TestShelveInstance-576226965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a048b30-f25f-403b-b830-b8a46d60c735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:33:19 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-8a529730-a6f6-4972-b2b4-2f2e81eab7be tempest-TestShelveInstance-576226965 None] Volume 3b7c1dab-36c9-4a0a-a516-ee8e96311a19: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3b7c1dab-36c9-4a0a-a516-ee8e96311a19', 'volume_size': 1, 'image_id': '2681f5d8-1c86-4dfd-86fb-c29aaed49dc6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2681f5d8-1c86-4dfd-86fb-c29aaed49dc6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cbf977c46caa48c18e414079bf75016d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2681f5d8-1c86-4dfd-86fb-c29aaed49dc6', 'created_at': datetime.datetime(2026, 8, 26, 12, 16, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 12, 16, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2681f5d8-1c86-4dfd-86fb-c29aaed49dc6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 26 14:33:19 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a529730-a6f6-4972-b2b4-2f2e81eab7be tempest-TestShelveInstance-576226965 None] Trying to clone 3b7c1dab-36c9-4a0a-a516-ee8e96311a19 from image 2681f5d8-1c86-4dfd-86fb-c29aaed49dc6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/2681f5d8-1c86-4dfd-86fb-c29aaed49dc6', 'metadata': {}}]). {{(pid=94394) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 26 14:33:20 devstack cinder-volume[94394]: DEBUG cinder.image.image_utils [None req-8a529730-a6f6-4972-b2b4-2f2e81eab7be tempest-TestShelveInstance-576226965 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2681f5d8-1c86-4dfd-86fb-c29aaed49dc6_tef5yz9ndevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=94394) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 26 14:33:20 devstack cinder-volume[94394]: INFO cinder.image.image_utils [None req-8a529730-a6f6-4972-b2b4-2f2e81eab7be tempest-TestShelveInstance-576226965 None] Image download 20.69 MB at 20.69 MB/s Aug 26 14:33:20 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dc86a3e-fac4-4aa8-a7b4-58a6413a834d]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:33:20 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-8a529730-a6f6-4972-b2b4-2f2e81eab7be tempest-TestShelveInstance-576226965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2681f5d8-1c86-4dfd-86fb-c29aaed49dc6_tef5yz9ndevstack@QuobyteHD {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:33:20 devstack sudo[107521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2681f5d8-1c86-4dfd-86fb-c29aaed49dc6_tef5yz9ndevstack@QuobyteHD Aug 26 14:33:20 devstack sudo[107521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:33:20 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-d104b13b-9cca-4159-a2c2-8bd353d4dd2c tempest-VolumesTransfersTest-997634441 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:33:20 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-d104b13b-9cca-4159-a2c2-8bd353d4dd2c tempest-VolumesTransfersTest-997634441 None] Flow 'volume_create_manager' (79e6a9b8-751a-483c-8af6-7ac199ee7d4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:33:20 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-d104b13b-9cca-4159-a2c2-8bd353d4dd2c tempest-VolumesTransfersTest-997634441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ff1bd7e-3c84-42e5-8b84-1dac8a983f93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:33:20 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-d104b13b-9cca-4159-a2c2-8bd353d4dd2c tempest-VolumesTransfersTest-997634441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ff1bd7e-3c84-42e5-8b84-1dac8a983f93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:33:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1877310214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01532101-2034-4771-b0fb-d59783e6de1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9561983f520e4c848806cb89c3df4a88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:33:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:33:21Z,use_quota=True,user_id='62f6484aff15499781684b21ca39ca24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:33:20 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-d104b13b-9cca-4159-a2c2-8bd353d4dd2c tempest-VolumesTransfersTest-997634441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b358622b-036f-4cc7-a86d-4bf831e8944f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:33:20 devstack sudo[107521]: pam_unix(sudo:session): session closed for user root Aug 26 14:33:20 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-d104b13b-9cca-4159-a2c2-8bd353d4dd2c tempest-VolumesTransfersTest-997634441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b358622b-036f-4cc7-a86d-4bf831e8944f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:33:20 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-d104b13b-9cca-4159-a2c2-8bd353d4dd2c tempest-VolumesTransfersTest-997634441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c80f660f-a13e-4e70-917f-a8a97a27e64d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:33:20 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-d104b13b-9cca-4159-a2c2-8bd353d4dd2c tempest-VolumesTransfersTest-997634441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c80f660f-a13e-4e70-917f-a8a97a27e64d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01532101-2034-4771-b0fb-d59783e6de1e', 'volume_name': 'volume-01532101-2034-4771-b0fb-d59783e6de1e', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:33:20 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-d104b13b-9cca-4159-a2c2-8bd353d4dd2c tempest-VolumesTransfersTest-997634441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10108fd1-a9da-4859-a98b-ba3add6c858f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:33:20 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-d104b13b-9cca-4159-a2c2-8bd353d4dd2c tempest-VolumesTransfersTest-997634441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10108fd1-a9da-4859-a98b-ba3add6c858f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:33:20 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-d104b13b-9cca-4159-a2c2-8bd353d4dd2c tempest-VolumesTransfersTest-997634441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9708736-4000-42cd-8887-7ea99f2b3ee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:33:20 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-d104b13b-9cca-4159-a2c2-8bd353d4dd2c tempest-VolumesTransfersTest-997634441 None] Volume 01532101-2034-4771-b0fb-d59783e6de1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01532101-2034-4771-b0fb-d59783e6de1e', 'volume_size': 1} Aug 26 14:33:20 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-d104b13b-9cca-4159-a2c2-8bd353d4dd2c tempest-VolumesTransfersTest-997634441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:33:20 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-d104b13b-9cca-4159-a2c2-8bd353d4dd2c tempest-VolumesTransfersTest-997634441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:33:20 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-d104b13b-9cca-4159-a2c2-8bd353d4dd2c tempest-VolumesTransfersTest-997634441 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:33:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1877310214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01532101-2034-4771-b0fb-d59783e6de1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9561983f520e4c848806cb89c3df4a88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:33:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:33:21Z,use_quota=True,user_id='62f6484aff15499781684b21ca39ca24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:33:20 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-d104b13b-9cca-4159-a2c2-8bd353d4dd2c tempest-VolumesTransfersTest-997634441 None] Creating volume 01532101-2034-4771-b0fb-d59783e6de1e {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:33:20 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-d104b13b-9cca-4159-a2c2-8bd353d4dd2c tempest-VolumesTransfersTest-997634441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:33:20 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-d104b13b-9cca-4159-a2c2-8bd353d4dd2c tempest-VolumesTransfersTest-997634441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:33:20 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-d104b13b-9cca-4159-a2c2-8bd353d4dd2c tempest-VolumesTransfersTest-997634441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:33:20 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-d104b13b-9cca-4159-a2c2-8bd353d4dd2c tempest-VolumesTransfersTest-997634441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:33:20 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-d104b13b-9cca-4159-a2c2-8bd353d4dd2c tempest-VolumesTransfersTest-997634441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:33:20 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-d104b13b-9cca-4159-a2c2-8bd353d4dd2c tempest-VolumesTransfersTest-997634441 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:33:20 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-d104b13b-9cca-4159-a2c2-8bd353d4dd2c tempest-VolumesTransfersTest-997634441 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:33:20 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-d104b13b-9cca-4159-a2c2-8bd353d4dd2c tempest-VolumesTransfersTest-997634441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-01532101-2034-4771-b0fb-d59783e6de1e 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:33:20 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-8a529730-a6f6-4972-b2b4-2f2e81eab7be tempest-TestShelveInstance-576226965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2681f5d8-1c86-4dfd-86fb-c29aaed49dc6_tef5yz9ndevstack@QuobyteHD" returned: 0 in 0.595s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:33:20 devstack cinder-volume[94394]: DEBUG cinder.image.image_utils [None req-8a529730-a6f6-4972-b2b4-2f2e81eab7be tempest-TestShelveInstance-576226965 None] Temporary image 2681f5d8-1c86-4dfd-86fb-c29aaed49dc6 is fetched for user f54c084d5aa745e6ae421a072d48479d. {{(pid=94394) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 26 14:33:20 devstack sudo[107526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-01532101-2034-4771-b0fb-d59783e6de1e 1073741824 Aug 26 14:33:20 devstack sudo[107526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:33:21 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c1735f2-d901-4140-b795-932e3c1eab52]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:33:21 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-8a529730-a6f6-4972-b2b4-2f2e81eab7be tempest-TestShelveInstance-576226965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2681f5d8-1c86-4dfd-86fb-c29aaed49dc6_tef5yz9ndevstack@QuobyteHD {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:33:21 devstack sudo[107528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2681f5d8-1c86-4dfd-86fb-c29aaed49dc6_tef5yz9ndevstack@QuobyteHD Aug 26 14:33:21 devstack sudo[107528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:33:21 devstack sudo[107528]: pam_unix(sudo:session): session closed for user root Aug 26 14:33:21 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-8a529730-a6f6-4972-b2b4-2f2e81eab7be tempest-TestShelveInstance-576226965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2681f5d8-1c86-4dfd-86fb-c29aaed49dc6_tef5yz9ndevstack@QuobyteHD" returned: 0 in 0.582s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:33:21 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-8a529730-a6f6-4972-b2b4-2f2e81eab7be tempest-TestShelveInstance-576226965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:33:21 devstack sudo[107526]: pam_unix(sudo:session): session closed for user root Aug 26 14:33:21 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-d104b13b-9cca-4159-a2c2-8bd353d4dd2c tempest-VolumesTransfersTest-997634441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-01532101-2034-4771-b0fb-d59783e6de1e 1073741824" returned: 0 in 0.777s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:33:21 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-d104b13b-9cca-4159-a2c2-8bd353d4dd2c tempest-VolumesTransfersTest-997634441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-01532101-2034-4771-b0fb-d59783e6de1e {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:33:21 devstack sudo[107536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-01532101-2034-4771-b0fb-d59783e6de1e Aug 26 14:33:21 devstack sudo[107536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:33:22 devstack sudo[107536]: pam_unix(sudo:session): session closed for user root Aug 26 14:33:22 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-d104b13b-9cca-4159-a2c2-8bd353d4dd2c tempest-VolumesTransfersTest-997634441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-01532101-2034-4771-b0fb-d59783e6de1e" returned: 0 in 0.339s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:33:22 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-d104b13b-9cca-4159-a2c2-8bd353d4dd2c tempest-VolumesTransfersTest-997634441 None] <== create_volume: return (1191ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:33:22 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-d104b13b-9cca-4159-a2c2-8bd353d4dd2c tempest-VolumesTransfersTest-997634441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.199s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:33:22 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-8a529730-a6f6-4972-b2b4-2f2e81eab7be tempest-TestShelveInstance-576226965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.400s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:33:22 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-8a529730-a6f6-4972-b2b4-2f2e81eab7be tempest-TestShelveInstance-576226965 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:33:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1808178822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b7c1dab-36c9-4a0a-a516-ee8e96311a19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83d1775456cb46ee82f545eb4b68206f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:33:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:33:19Z,use_quota=True,user_id='f54c084d5aa745e6ae421a072d48479d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:33:22 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-8a529730-a6f6-4972-b2b4-2f2e81eab7be tempest-TestShelveInstance-576226965 None] Creating volume 3b7c1dab-36c9-4a0a-a516-ee8e96311a19 {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:33:22 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-8a529730-a6f6-4972-b2b4-2f2e81eab7be tempest-TestShelveInstance-576226965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:33:22 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-8a529730-a6f6-4972-b2b4-2f2e81eab7be tempest-TestShelveInstance-576226965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:33:22 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-8a529730-a6f6-4972-b2b4-2f2e81eab7be tempest-TestShelveInstance-576226965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:33:22 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-8a529730-a6f6-4972-b2b4-2f2e81eab7be tempest-TestShelveInstance-576226965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:33:22 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-8a529730-a6f6-4972-b2b4-2f2e81eab7be tempest-TestShelveInstance-576226965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:33:22 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-8a529730-a6f6-4972-b2b4-2f2e81eab7be tempest-TestShelveInstance-576226965 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:33:22 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-8a529730-a6f6-4972-b2b4-2f2e81eab7be tempest-TestShelveInstance-576226965 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:33:22 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-8a529730-a6f6-4972-b2b4-2f2e81eab7be tempest-TestShelveInstance-576226965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3b7c1dab-36c9-4a0a-a516-ee8e96311a19 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:33:22 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-d104b13b-9cca-4159-a2c2-8bd353d4dd2c tempest-VolumesTransfersTest-997634441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9708736-4000-42cd-8887-7ea99f2b3ee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01532101-2034-4771-b0fb-d59783e6de1e', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:33:22 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-d104b13b-9cca-4159-a2c2-8bd353d4dd2c tempest-VolumesTransfersTest-997634441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cf0e708-49c6-4347-b43f-a52ab8f194e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:33:22 devstack sudo[107539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3b7c1dab-36c9-4a0a-a516-ee8e96311a19 1073741824 Aug 26 14:33:22 devstack sudo[107539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:33:22 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-d104b13b-9cca-4159-a2c2-8bd353d4dd2c tempest-VolumesTransfersTest-997634441 None] Volume volume-01532101-2034-4771-b0fb-d59783e6de1e (01532101-2034-4771-b0fb-d59783e6de1e): created successfully Aug 26 14:33:22 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-d104b13b-9cca-4159-a2c2-8bd353d4dd2c tempest-VolumesTransfersTest-997634441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cf0e708-49c6-4347-b43f-a52ab8f194e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:33:22 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-d104b13b-9cca-4159-a2c2-8bd353d4dd2c tempest-VolumesTransfersTest-997634441 None] Flow 'volume_create_manager' (79e6a9b8-751a-483c-8af6-7ac199ee7d4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:33:22 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-d104b13b-9cca-4159-a2c2-8bd353d4dd2c tempest-VolumesTransfersTest-997634441 None] Created volume successfully. Aug 26 14:33:22 devstack sudo[107539]: pam_unix(sudo:session): session closed for user root Aug 26 14:33:22 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-8a529730-a6f6-4972-b2b4-2f2e81eab7be tempest-TestShelveInstance-576226965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3b7c1dab-36c9-4a0a-a516-ee8e96311a19 1073741824" returned: 0 in 0.851s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:33:22 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-8a529730-a6f6-4972-b2b4-2f2e81eab7be tempest-TestShelveInstance-576226965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3b7c1dab-36c9-4a0a-a516-ee8e96311a19 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:33:23 devstack sudo[107546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3b7c1dab-36c9-4a0a-a516-ee8e96311a19 Aug 26 14:33:23 devstack sudo[107546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:33:23 devstack sudo[107546]: pam_unix(sudo:session): session closed for user root Aug 26 14:33:23 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-8a529730-a6f6-4972-b2b4-2f2e81eab7be tempest-TestShelveInstance-576226965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3b7c1dab-36c9-4a0a-a516-ee8e96311a19" returned: 0 in 0.388s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:33:23 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-8a529730-a6f6-4972-b2b4-2f2e81eab7be tempest-TestShelveInstance-576226965 None] <== create_volume: return (1295ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:33:23 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-8a529730-a6f6-4972-b2b4-2f2e81eab7be tempest-TestShelveInstance-576226965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.304s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:33:23 devstack cinder-volume[94394]: DEBUG cinder.volume.volume_utils [None req-8a529730-a6f6-4972-b2b4-2f2e81eab7be tempest-TestShelveInstance-576226965 None] Attempting download of 2681f5d8-1c86-4dfd-86fb-c29aaed49dc6 ((None, [{'url': 'file:///opt/stack/data/glance/images/2681f5d8-1c86-4dfd-86fb-c29aaed49dc6', 'metadata': {}}])) to volume 3b7c1dab-36c9-4a0a-a516-ee8e96311a19. {{(pid=94394) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 26 14:33:23 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eb0c655-7b72-4ec7-889f-27383aec68a9]: (4, 'raw') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:33:23 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-8a529730-a6f6-4972-b2b4-2f2e81eab7be tempest-TestShelveInstance-576226965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2681f5d8-1c86-4dfd-86fb-c29aaed49dc6_t2qgajny {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:33:23 devstack sudo[107550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2681f5d8-1c86-4dfd-86fb-c29aaed49dc6_t2qgajny Aug 26 14:33:23 devstack sudo[107550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:33:23 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c366dd5-6c54-4e99-be57-212285aa460c tempest-VolumesSnapshotNegativeTestJSON-396039892 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:33:23 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-1c366dd5-6c54-4e99-be57-212285aa460c tempest-VolumesSnapshotNegativeTestJSON-396039892 None] Flow 'volume_create_manager' (904e7dc7-b800-479d-995d-36b52add53f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:33:23 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-1c366dd5-6c54-4e99-be57-212285aa460c tempest-VolumesSnapshotNegativeTestJSON-396039892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5f6c74b-86a0-48cd-92a6-2e4ef42f89a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:33:23 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-1c366dd5-6c54-4e99-be57-212285aa460c tempest-VolumesSnapshotNegativeTestJSON-396039892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5f6c74b-86a0-48cd-92a6-2e4ef42f89a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:33:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-652083370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=131f04e6-603a-4d47-9cdf-aa98fc326197,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b3179d89bb742bbbbcf541eac137612',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:33:24Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:33:24Z,use_quota=True,user_id='4e089c8447c0473f86e05ebeb8b147c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:33:23 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-1c366dd5-6c54-4e99-be57-212285aa460c tempest-VolumesSnapshotNegativeTestJSON-396039892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c22aa2da-9aed-4d88-bd4e-fc8283f7f5e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:33:23 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-1c366dd5-6c54-4e99-be57-212285aa460c tempest-VolumesSnapshotNegativeTestJSON-396039892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c22aa2da-9aed-4d88-bd4e-fc8283f7f5e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:33:23 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-1c366dd5-6c54-4e99-be57-212285aa460c tempest-VolumesSnapshotNegativeTestJSON-396039892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59d37757-9472-49c3-a186-ef436b80d521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:33:23 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-1c366dd5-6c54-4e99-be57-212285aa460c tempest-VolumesSnapshotNegativeTestJSON-396039892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59d37757-9472-49c3-a186-ef436b80d521) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '131f04e6-603a-4d47-9cdf-aa98fc326197', 'volume_name': 'volume-131f04e6-603a-4d47-9cdf-aa98fc326197', 'volume_size': 2}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:33:23 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-1c366dd5-6c54-4e99-be57-212285aa460c tempest-VolumesSnapshotNegativeTestJSON-396039892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (312c6b79-b905-4d6c-9157-e92c26472bbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:33:23 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-1c366dd5-6c54-4e99-be57-212285aa460c tempest-VolumesSnapshotNegativeTestJSON-396039892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (312c6b79-b905-4d6c-9157-e92c26472bbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:33:23 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-1c366dd5-6c54-4e99-be57-212285aa460c tempest-VolumesSnapshotNegativeTestJSON-396039892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (502d855f-f1fe-48e7-b8cf-722795ff6e28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:33:23 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-1c366dd5-6c54-4e99-be57-212285aa460c tempest-VolumesSnapshotNegativeTestJSON-396039892 None] Volume 131f04e6-603a-4d47-9cdf-aa98fc326197: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-131f04e6-603a-4d47-9cdf-aa98fc326197', 'volume_size': 2} Aug 26 14:33:23 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-1c366dd5-6c54-4e99-be57-212285aa460c tempest-VolumesSnapshotNegativeTestJSON-396039892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:33:23 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-1c366dd5-6c54-4e99-be57-212285aa460c tempest-VolumesSnapshotNegativeTestJSON-396039892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:33:23 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-1c366dd5-6c54-4e99-be57-212285aa460c tempest-VolumesSnapshotNegativeTestJSON-396039892 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:33:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-652083370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=131f04e6-603a-4d47-9cdf-aa98fc326197,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b3179d89bb742bbbbcf541eac137612',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:33:24Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:33:24Z,use_quota=True,user_id='4e089c8447c0473f86e05ebeb8b147c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:33:23 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-1c366dd5-6c54-4e99-be57-212285aa460c tempest-VolumesSnapshotNegativeTestJSON-396039892 None] Creating volume 131f04e6-603a-4d47-9cdf-aa98fc326197 {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:33:23 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-1c366dd5-6c54-4e99-be57-212285aa460c tempest-VolumesSnapshotNegativeTestJSON-396039892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:33:23 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-1c366dd5-6c54-4e99-be57-212285aa460c tempest-VolumesSnapshotNegativeTestJSON-396039892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:33:23 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-1c366dd5-6c54-4e99-be57-212285aa460c tempest-VolumesSnapshotNegativeTestJSON-396039892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:33:23 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-1c366dd5-6c54-4e99-be57-212285aa460c tempest-VolumesSnapshotNegativeTestJSON-396039892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:33:24 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-1c366dd5-6c54-4e99-be57-212285aa460c tempest-VolumesSnapshotNegativeTestJSON-396039892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:33:24 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-1c366dd5-6c54-4e99-be57-212285aa460c tempest-VolumesSnapshotNegativeTestJSON-396039892 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:33:24 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-1c366dd5-6c54-4e99-be57-212285aa460c tempest-VolumesSnapshotNegativeTestJSON-396039892 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:33:24 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-1c366dd5-6c54-4e99-be57-212285aa460c tempest-VolumesSnapshotNegativeTestJSON-396039892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-131f04e6-603a-4d47-9cdf-aa98fc326197 2147483648 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:33:24 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-023deda8-1ca8-4f54-92b0-21267a14d2b3 tempest-VolumesTransfersTest-681100409 None] Transfer volume completed successfully. Aug 26 14:33:24 devstack sudo[107552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-131f04e6-603a-4d47-9cdf-aa98fc326197 2147483648 Aug 26 14:33:24 devstack sudo[107552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:33:24 devstack sudo[107550]: pam_unix(sudo:session): session closed for user root Aug 26 14:33:24 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-8a529730-a6f6-4972-b2b4-2f2e81eab7be tempest-TestShelveInstance-576226965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2681f5d8-1c86-4dfd-86fb-c29aaed49dc6_t2qgajny" returned: 0 in 0.611s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:33:24 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-8a529730-a6f6-4972-b2b4-2f2e81eab7be tempest-TestShelveInstance-576226965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2681f5d8-1c86-4dfd-86fb-c29aaed49dc6_t2qgajny {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:33:24 devstack sudo[107556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2681f5d8-1c86-4dfd-86fb-c29aaed49dc6_t2qgajny Aug 26 14:33:24 devstack sudo[107556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:33:24 devstack sudo[107556]: pam_unix(sudo:session): session closed for user root Aug 26 14:33:24 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-8a529730-a6f6-4972-b2b4-2f2e81eab7be tempest-TestShelveInstance-576226965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2681f5d8-1c86-4dfd-86fb-c29aaed49dc6_t2qgajny" returned: 1 in 0.403s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:33:24 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-8a529730-a6f6-4972-b2b4-2f2e81eab7be tempest-TestShelveInstance-576226965 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2681f5d8-1c86-4dfd-86fb-c29aaed49dc6_t2qgajny' failed. Not Retrying. {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 14:33:24 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0734364-f442-48a7-8050-d5b7257a2aa0]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:33:24 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-8a529730-a6f6-4972-b2b4-2f2e81eab7be tempest-TestShelveInstance-576226965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2681f5d8-1c86-4dfd-86fb-c29aaed49dc6_tef5yz9ndevstack@QuobyteHD {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:33:24 devstack sudo[107552]: pam_unix(sudo:session): session closed for user root Aug 26 14:33:24 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-1c366dd5-6c54-4e99-be57-212285aa460c tempest-VolumesSnapshotNegativeTestJSON-396039892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-131f04e6-603a-4d47-9cdf-aa98fc326197 2147483648" returned: 0 in 0.603s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:33:24 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-1c366dd5-6c54-4e99-be57-212285aa460c tempest-VolumesSnapshotNegativeTestJSON-396039892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-131f04e6-603a-4d47-9cdf-aa98fc326197 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:33:24 devstack sudo[107566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2681f5d8-1c86-4dfd-86fb-c29aaed49dc6_tef5yz9ndevstack@QuobyteHD Aug 26 14:33:24 devstack sudo[107566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:33:24 devstack sudo[107567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-131f04e6-603a-4d47-9cdf-aa98fc326197 Aug 26 14:33:24 devstack sudo[107567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:33:24 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-880d37ed-93e0-4f72-b412-6975fee8d917 tempest-VolumesTransfersTest-1806614467 None] Acquiring lock "cinder-01532101-2034-4771-b0fb-d59783e6de1e-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:33:24 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-880d37ed-93e0-4f72-b412-6975fee8d917 tempest-VolumesTransfersTest-1806614467 None] Lock "cinder-01532101-2034-4771-b0fb-d59783e6de1e-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:33:24 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-880d37ed-93e0-4f72-b412-6975fee8d917 tempest-VolumesTransfersTest-1806614467 None] Acquiring lock "cinder-quobyte-01532101-2034-4771-b0fb-d59783e6de1e" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:33:24 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-880d37ed-93e0-4f72-b412-6975fee8d917 tempest-VolumesTransfersTest-1806614467 None] Lock "cinder-quobyte-01532101-2034-4771-b0fb-d59783e6de1e" acquired by "delete_volume" :: waited 0.021s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:33:24 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[50f9cc49-50f5-4f53-a307-17ab5776a491]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:33:24 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-880d37ed-93e0-4f72-b412-6975fee8d917 tempest-VolumesTransfersTest-1806614467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-01532101-2034-4771-b0fb-d59783e6de1e {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:33:25 devstack sudo[107570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-01532101-2034-4771-b0fb-d59783e6de1e Aug 26 14:33:25 devstack sudo[107570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:33:25 devstack sudo[107567]: pam_unix(sudo:session): session closed for user root Aug 26 14:33:25 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-1c366dd5-6c54-4e99-be57-212285aa460c tempest-VolumesSnapshotNegativeTestJSON-396039892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-131f04e6-603a-4d47-9cdf-aa98fc326197" returned: 0 in 0.368s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:33:25 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-1c366dd5-6c54-4e99-be57-212285aa460c tempest-VolumesSnapshotNegativeTestJSON-396039892 None] <== create_volume: return (1057ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:33:25 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-1c366dd5-6c54-4e99-be57-212285aa460c tempest-VolumesSnapshotNegativeTestJSON-396039892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.060s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:33:25 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-1c366dd5-6c54-4e99-be57-212285aa460c tempest-VolumesSnapshotNegativeTestJSON-396039892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (502d855f-f1fe-48e7-b8cf-722795ff6e28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-131f04e6-603a-4d47-9cdf-aa98fc326197', 'volume_size': 2}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:33:25 devstack sudo[107566]: pam_unix(sudo:session): session closed for user root Aug 26 14:33:25 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-1c366dd5-6c54-4e99-be57-212285aa460c tempest-VolumesSnapshotNegativeTestJSON-396039892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2833e51f-161c-43bf-97b1-2ee2d4dc9f41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:33:25 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-8a529730-a6f6-4972-b2b4-2f2e81eab7be tempest-TestShelveInstance-576226965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2681f5d8-1c86-4dfd-86fb-c29aaed49dc6_tef5yz9ndevstack@QuobyteHD" returned: 0 in 0.537s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:33:25 devstack cinder-volume[94394]: DEBUG cinder.image.image_utils [None req-8a529730-a6f6-4972-b2b4-2f2e81eab7be tempest-TestShelveInstance-576226965 None] 2681f5d8-1c86-4dfd-86fb-c29aaed49dc6 was qcow2, converting to qcow2 {{(pid=94394) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 26 14:33:25 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-8a529730-a6f6-4972-b2b4-2f2e81eab7be tempest-TestShelveInstance-576226965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2681f5d8-1c86-4dfd-86fb-c29aaed49dc6_tef5yz9ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3b7c1dab-36c9-4a0a-a516-ee8e96311a19 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:33:25 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-1c366dd5-6c54-4e99-be57-212285aa460c tempest-VolumesSnapshotNegativeTestJSON-396039892 None] Volume volume-131f04e6-603a-4d47-9cdf-aa98fc326197 (131f04e6-603a-4d47-9cdf-aa98fc326197): created successfully Aug 26 14:33:25 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-1c366dd5-6c54-4e99-be57-212285aa460c tempest-VolumesSnapshotNegativeTestJSON-396039892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2833e51f-161c-43bf-97b1-2ee2d4dc9f41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:33:25 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-1c366dd5-6c54-4e99-be57-212285aa460c tempest-VolumesSnapshotNegativeTestJSON-396039892 None] Flow 'volume_create_manager' (904e7dc7-b800-479d-995d-36b52add53f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:33:25 devstack sudo[107576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2681f5d8-1c86-4dfd-86fb-c29aaed49dc6_tef5yz9ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3b7c1dab-36c9-4a0a-a516-ee8e96311a19 Aug 26 14:33:25 devstack sudo[107576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:33:25 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-1c366dd5-6c54-4e99-be57-212285aa460c tempest-VolumesSnapshotNegativeTestJSON-396039892 None] Created volume successfully. Aug 26 14:33:25 devstack sudo[107570]: pam_unix(sudo:session): session closed for user root Aug 26 14:33:25 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-880d37ed-93e0-4f72-b412-6975fee8d917 tempest-VolumesTransfersTest-1806614467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-01532101-2034-4771-b0fb-d59783e6de1e" returned: 0 in 0.428s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:33:25 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-880d37ed-93e0-4f72-b412-6975fee8d917 tempest-VolumesTransfersTest-1806614467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-01532101-2034-4771-b0fb-d59783e6de1e {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:33:25 devstack sudo[107584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-01532101-2034-4771-b0fb-d59783e6de1e Aug 26 14:33:25 devstack sudo[107584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:33:25 devstack sudo[107584]: pam_unix(sudo:session): session closed for user root Aug 26 14:33:25 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-880d37ed-93e0-4f72-b412-6975fee8d917 tempest-VolumesTransfersTest-1806614467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-01532101-2034-4771-b0fb-d59783e6de1e" returned: 0 in 0.266s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:33:25 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-880d37ed-93e0-4f72-b412-6975fee8d917 tempest-VolumesTransfersTest-1806614467 None] Lock "cinder-quobyte-01532101-2034-4771-b0fb-d59783e6de1e" released by "delete_volume" :: held 0.742s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:33:25 devstack cinder-volume[94394]: DEBUG dbcounter [-] [94394] Writing DB stats cinder:UPDATE=138,cinder:SELECT=120,cinder:INSERT=37,cinder:DELETE=10 {{(pid=94394) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 14:33:25 devstack cinder-volume[94394]: DEBUG dbcounter [-] [94394] Writing DB stats cinder:UPDATE=136,cinder:SELECT=102,cinder:INSERT=46,cinder:DELETE=9 {{(pid=94394) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 14:33:25 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-880d37ed-93e0-4f72-b412-6975fee8d917 tempest-VolumesTransfersTest-1806614467 None] Created reservations ['fd21accd-e084-4ecc-8a3d-333e116a371f', '7e73e1ab-a17c-4aa8-85d5-32761779bdee', 'bbc33500-c4c6-4600-be32-64d9355ece63', 'b3e4ad4b-f814-4b33-afd0-d044875f7119'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:33:25 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-880d37ed-93e0-4f72-b412-6975fee8d917 tempest-VolumesTransfersTest-1806614467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:33:25 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-880d37ed-93e0-4f72-b412-6975fee8d917 tempest-VolumesTransfersTest-1806614467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:33:25 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-880d37ed-93e0-4f72-b412-6975fee8d917 tempest-VolumesTransfersTest-1806614467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:33:25 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-880d37ed-93e0-4f72-b412-6975fee8d917 tempest-VolumesTransfersTest-1806614467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:33:25 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-880d37ed-93e0-4f72-b412-6975fee8d917 tempest-VolumesTransfersTest-1806614467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:33:25 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-880d37ed-93e0-4f72-b412-6975fee8d917 tempest-VolumesTransfersTest-1806614467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:33:25 devstack sudo[107591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:33:25 devstack sudo[107591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:33:26 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-16ed6552-7ada-4058-8862-78fc87ec830a tempest-VolumesSnapshotNegativeTestJSON-396039892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:33:26 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-16ed6552-7ada-4058-8862-78fc87ec830a tempest-VolumesSnapshotNegativeTestJSON-396039892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:33:26 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-16ed6552-7ada-4058-8862-78fc87ec830a tempest-VolumesSnapshotNegativeTestJSON-396039892 None] Creating offline snapshot 5e5729dc-1a2a-475d-8c6f-b8c7f13f9bc6 of volume 131f04e6-603a-4d47-9cdf-aa98fc326197 {{(pid=94394) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 14:33:26 devstack sudo[107591]: pam_unix(sudo:session): session closed for user root Aug 26 14:33:26 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-880d37ed-93e0-4f72-b412-6975fee8d917 tempest-VolumesTransfersTest-1806614467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.513s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:33:26 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-880d37ed-93e0-4f72-b412-6975fee8d917 tempest-VolumesTransfersTest-1806614467 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:33:26 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-880d37ed-93e0-4f72-b412-6975fee8d917 tempest-VolumesTransfersTest-1806614467 None] Deleted volume successfully. Aug 26 14:33:26 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[54131e08-4c39-4f1d-940c-ce9cb80f9201]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:33:26 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-16ed6552-7ada-4058-8862-78fc87ec830a tempest-VolumesSnapshotNegativeTestJSON-396039892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-131f04e6-603a-4d47-9cdf-aa98fc326197 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:33:26 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-880d37ed-93e0-4f72-b412-6975fee8d917 tempest-VolumesTransfersTest-1806614467 None] Lock "cinder-01532101-2034-4771-b0fb-d59783e6de1e-delete_volume" released by "delete_volume" :: held 1.567s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:33:26 devstack sudo[107594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-131f04e6-603a-4d47-9cdf-aa98fc326197 Aug 26 14:33:26 devstack sudo[107594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:33:26 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-43df6ff8-3bc5-4be7-b602-900e766150db tempest-VolumesTransfersTest-997634441 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:33:26 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-43df6ff8-3bc5-4be7-b602-900e766150db tempest-VolumesTransfersTest-997634441 None] Flow 'volume_create_manager' (e1994d88-651d-4dff-a8d9-197df35e9596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:33:26 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-43df6ff8-3bc5-4be7-b602-900e766150db tempest-VolumesTransfersTest-997634441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d07cb1e-43df-4922-be02-764306fdc5e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:33:27 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-43df6ff8-3bc5-4be7-b602-900e766150db tempest-VolumesTransfersTest-997634441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d07cb1e-43df-4922-be02-764306fdc5e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:33:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1752955162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2117112-88a7-4180-aed3-444fc1cc1180,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9561983f520e4c848806cb89c3df4a88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:33:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:33:27Z,use_quota=True,user_id='62f6484aff15499781684b21ca39ca24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:33:27 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-43df6ff8-3bc5-4be7-b602-900e766150db tempest-VolumesTransfersTest-997634441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a86ce099-7ea3-4b5e-bd89-3e9b019175ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:33:27 devstack sudo[107594]: pam_unix(sudo:session): session closed for user root Aug 26 14:33:27 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-43df6ff8-3bc5-4be7-b602-900e766150db tempest-VolumesTransfersTest-997634441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a86ce099-7ea3-4b5e-bd89-3e9b019175ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:33:27 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-43df6ff8-3bc5-4be7-b602-900e766150db tempest-VolumesTransfersTest-997634441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d6df26b-35e8-4bc4-a60d-f1797840c997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:33:27 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-43df6ff8-3bc5-4be7-b602-900e766150db tempest-VolumesTransfersTest-997634441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d6df26b-35e8-4bc4-a60d-f1797840c997) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2117112-88a7-4180-aed3-444fc1cc1180', 'volume_name': 'volume-c2117112-88a7-4180-aed3-444fc1cc1180', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:33:27 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-43df6ff8-3bc5-4be7-b602-900e766150db tempest-VolumesTransfersTest-997634441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3afaa9da-0f06-4ff9-b888-b9acce975e35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:33:27 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-43df6ff8-3bc5-4be7-b602-900e766150db tempest-VolumesTransfersTest-997634441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3afaa9da-0f06-4ff9-b888-b9acce975e35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:33:27 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-43df6ff8-3bc5-4be7-b602-900e766150db tempest-VolumesTransfersTest-997634441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5a54047-942c-47c9-aa86-58c7738c488c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:33:27 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-43df6ff8-3bc5-4be7-b602-900e766150db tempest-VolumesTransfersTest-997634441 None] Volume c2117112-88a7-4180-aed3-444fc1cc1180: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2117112-88a7-4180-aed3-444fc1cc1180', 'volume_size': 1} Aug 26 14:33:27 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-43df6ff8-3bc5-4be7-b602-900e766150db tempest-VolumesTransfersTest-997634441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:33:27 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-16ed6552-7ada-4058-8862-78fc87ec830a tempest-VolumesSnapshotNegativeTestJSON-396039892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-131f04e6-603a-4d47-9cdf-aa98fc326197" returned: 0 in 0.728s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:33:27 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-16ed6552-7ada-4058-8862-78fc87ec830a tempest-VolumesSnapshotNegativeTestJSON-396039892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-131f04e6-603a-4d47-9cdf-aa98fc326197,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-131f04e6-603a-4d47-9cdf-aa98fc326197.5e5729dc-1a2a-475d-8c6f-b8c7f13f9bc6 2G {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:33:27 devstack sudo[107599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-131f04e6-603a-4d47-9cdf-aa98fc326197,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-131f04e6-603a-4d47-9cdf-aa98fc326197.5e5729dc-1a2a-475d-8c6f-b8c7f13f9bc6 2G Aug 26 14:33:27 devstack sudo[107599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:33:27 devstack sudo[107576]: pam_unix(sudo:session): session closed for user root Aug 26 14:33:27 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-8a529730-a6f6-4972-b2b4-2f2e81eab7be tempest-TestShelveInstance-576226965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2681f5d8-1c86-4dfd-86fb-c29aaed49dc6_tef5yz9ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3b7c1dab-36c9-4a0a-a516-ee8e96311a19" returned: 0 in 2.181s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:33:27 devstack cinder-volume[94394]: DEBUG cinder.image.image_utils [None req-8a529730-a6f6-4972-b2b4-2f2e81eab7be tempest-TestShelveInstance-576226965 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2681f5d8-1c86-4dfd-86fb-c29aaed49dc6_tef5yz9ndevstack@QuobyteHD, size 112.00 MB, duration 2.18 sec, destination /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3b7c1dab-36c9-4a0a-a516-ee8e96311a19 {{(pid=94394) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 14:33:27 devstack cinder-volume[94394]: INFO cinder.image.image_utils [None req-8a529730-a6f6-4972-b2b4-2f2e81eab7be tempest-TestShelveInstance-576226965 None] Converted 112.00 MB image at 51.31 MB/s Aug 26 14:33:27 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-8a529730-a6f6-4972-b2b4-2f2e81eab7be tempest-TestShelveInstance-576226965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3b7c1dab-36c9-4a0a-a516-ee8e96311a19 1G {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:33:27 devstack sudo[107601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3b7c1dab-36c9-4a0a-a516-ee8e96311a19 1G Aug 26 14:33:27 devstack sudo[107601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:33:27 devstack sudo[107599]: pam_unix(sudo:session): session closed for user root Aug 26 14:33:27 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-16ed6552-7ada-4058-8862-78fc87ec830a tempest-VolumesSnapshotNegativeTestJSON-396039892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-131f04e6-603a-4d47-9cdf-aa98fc326197,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-131f04e6-603a-4d47-9cdf-aa98fc326197.5e5729dc-1a2a-475d-8c6f-b8c7f13f9bc6 2G" returned: 0 in 0.463s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:33:27 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-16ed6552-7ada-4058-8862-78fc87ec830a tempest-VolumesSnapshotNegativeTestJSON-396039892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-131f04e6-603a-4d47-9cdf-aa98fc326197 -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-131f04e6-603a-4d47-9cdf-aa98fc326197.5e5729dc-1a2a-475d-8c6f-b8c7f13f9bc6 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:33:27 devstack sudo[107608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-131f04e6-603a-4d47-9cdf-aa98fc326197 -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-131f04e6-603a-4d47-9cdf-aa98fc326197.5e5729dc-1a2a-475d-8c6f-b8c7f13f9bc6 Aug 26 14:33:27 devstack sudo[107608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:33:27 devstack sudo[107601]: pam_unix(sudo:session): session closed for user root Aug 26 14:33:27 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-8a529730-a6f6-4972-b2b4-2f2e81eab7be tempest-TestShelveInstance-576226965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3b7c1dab-36c9-4a0a-a516-ee8e96311a19 1G" returned: 0 in 0.366s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:33:27 devstack cinder-volume[94394]: DEBUG cinder.volume.volume_utils [None req-8a529730-a6f6-4972-b2b4-2f2e81eab7be tempest-TestShelveInstance-576226965 None] Downloaded image 2681f5d8-1c86-4dfd-86fb-c29aaed49dc6 ((None, [{'url': 'file:///opt/stack/data/glance/images/2681f5d8-1c86-4dfd-86fb-c29aaed49dc6', 'metadata': {}}])) to volume 3b7c1dab-36c9-4a0a-a516-ee8e96311a19 successfully. {{(pid=94394) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 26 14:33:27 devstack cinder-volume[94394]: DEBUG cinder.image.image_utils [None req-8a529730-a6f6-4972-b2b4-2f2e81eab7be tempest-TestShelveInstance-576226965 None] Temporary image 2681f5d8-1c86-4dfd-86fb-c29aaed49dc6 for user f54c084d5aa745e6ae421a072d48479d is deleted. {{(pid=94394) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 26 14:33:27 devstack cinder-volume[94394]: DEBUG cinder.volume.volume_utils [None req-8a529730-a6f6-4972-b2b4-2f2e81eab7be tempest-TestShelveInstance-576226965 None] Marking volume 3b7c1dab-36c9-4a0a-a516-ee8e96311a19 as bootable. {{(pid=94394) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 26 14:33:27 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a529730-a6f6-4972-b2b4-2f2e81eab7be tempest-TestShelveInstance-576226965 None] Copying metadata from image 2681f5d8-1c86-4dfd-86fb-c29aaed49dc6 to 3b7c1dab-36c9-4a0a-a516-ee8e96311a19. {{(pid=94394) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 26 14:33:27 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a529730-a6f6-4972-b2b4-2f2e81eab7be tempest-TestShelveInstance-576226965 None] Creating volume glance metadata for volume 3b7c1dab-36c9-4a0a-a516-ee8e96311a19 backed by image 2681f5d8-1c86-4dfd-86fb-c29aaed49dc6 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '2681f5d8-1c86-4dfd-86fb-c29aaed49dc6', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=94394) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 26 14:33:27 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-8a529730-a6f6-4972-b2b4-2f2e81eab7be tempest-TestShelveInstance-576226965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a048b30-f25f-403b-b830-b8a46d60c735) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b7c1dab-36c9-4a0a-a516-ee8e96311a19', 'volume_size': 1, 'image_id': '2681f5d8-1c86-4dfd-86fb-c29aaed49dc6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2681f5d8-1c86-4dfd-86fb-c29aaed49dc6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cbf977c46caa48c18e414079bf75016d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2681f5d8-1c86-4dfd-86fb-c29aaed49dc6', 'created_at': datetime.datetime(2026, 8, 26, 12, 16, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 12, 16, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2681f5d8-1c86-4dfd-86fb-c29aaed49dc6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:33:27 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-8a529730-a6f6-4972-b2b4-2f2e81eab7be tempest-TestShelveInstance-576226965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c31add1a-3660-4ac9-944e-b11aeb75391b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:33:27 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-8a529730-a6f6-4972-b2b4-2f2e81eab7be tempest-TestShelveInstance-576226965 None] Volume volume-3b7c1dab-36c9-4a0a-a516-ee8e96311a19 (3b7c1dab-36c9-4a0a-a516-ee8e96311a19): created successfully Aug 26 14:33:27 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-8a529730-a6f6-4972-b2b4-2f2e81eab7be tempest-TestShelveInstance-576226965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c31add1a-3660-4ac9-944e-b11aeb75391b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:33:27 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-8a529730-a6f6-4972-b2b4-2f2e81eab7be tempest-TestShelveInstance-576226965 None] Flow 'volume_create_manager' (5d53e5ec-7b16-4439-b929-89811019583f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:33:27 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-8a529730-a6f6-4972-b2b4-2f2e81eab7be tempest-TestShelveInstance-576226965 None] Created volume successfully. Aug 26 14:33:27 devstack sudo[107608]: pam_unix(sudo:session): session closed for user root Aug 26 14:33:27 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-16ed6552-7ada-4058-8862-78fc87ec830a tempest-VolumesSnapshotNegativeTestJSON-396039892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-131f04e6-603a-4d47-9cdf-aa98fc326197 -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-131f04e6-603a-4d47-9cdf-aa98fc326197.5e5729dc-1a2a-475d-8c6f-b8c7f13f9bc6" returned: 0 in 0.336s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:33:27 devstack cinder-volume[94394]: WARNING cinder.volume.drivers.remotefs [None req-16ed6552-7ada-4058-8862-78fc87ec830a tempest-VolumesSnapshotNegativeTestJSON-396039892 None] /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-131f04e6-603a-4d47-9cdf-aa98fc326197.5e5729dc-1a2a-475d-8c6f-b8c7f13f9bc6 is being set with open permissions: ugo+rw Aug 26 14:33:27 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-16ed6552-7ada-4058-8862-78fc87ec830a tempest-VolumesSnapshotNegativeTestJSON-396039892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-131f04e6-603a-4d47-9cdf-aa98fc326197.5e5729dc-1a2a-475d-8c6f-b8c7f13f9bc6 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:33:27 devstack sudo[107614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-131f04e6-603a-4d47-9cdf-aa98fc326197.5e5729dc-1a2a-475d-8c6f-b8c7f13f9bc6 Aug 26 14:33:27 devstack sudo[107614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:33:28 devstack sudo[107614]: pam_unix(sudo:session): session closed for user root Aug 26 14:33:28 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-16ed6552-7ada-4058-8862-78fc87ec830a tempest-VolumesSnapshotNegativeTestJSON-396039892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-131f04e6-603a-4d47-9cdf-aa98fc326197.5e5729dc-1a2a-475d-8c6f-b8c7f13f9bc6" returned: 0 in 0.268s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:33:28 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-16ed6552-7ada-4058-8862-78fc87ec830a tempest-VolumesSnapshotNegativeTestJSON-396039892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-131f04e6-603a-4d47-9cdf-aa98fc326197.info {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:33:28 devstack sudo[107617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-131f04e6-603a-4d47-9cdf-aa98fc326197.info Aug 26 14:33:28 devstack sudo[107617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:33:28 devstack sudo[107617]: pam_unix(sudo:session): session closed for user root Aug 26 14:33:28 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-16ed6552-7ada-4058-8862-78fc87ec830a tempest-VolumesSnapshotNegativeTestJSON-396039892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-131f04e6-603a-4d47-9cdf-aa98fc326197.info" returned: 0 in 0.286s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:33:28 devstack cinder-volume[94394]: WARNING cinder.volume.drivers.remotefs [None req-16ed6552-7ada-4058-8862-78fc87ec830a tempest-VolumesSnapshotNegativeTestJSON-396039892 None] /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-131f04e6-603a-4d47-9cdf-aa98fc326197.info is being set with open permissions: ugo+rw Aug 26 14:33:28 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-16ed6552-7ada-4058-8862-78fc87ec830a tempest-VolumesSnapshotNegativeTestJSON-396039892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-131f04e6-603a-4d47-9cdf-aa98fc326197.info {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:33:28 devstack sudo[107620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-131f04e6-603a-4d47-9cdf-aa98fc326197.info Aug 26 14:33:28 devstack sudo[107620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:33:28 devstack sudo[107620]: pam_unix(sudo:session): session closed for user root Aug 26 14:33:28 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-16ed6552-7ada-4058-8862-78fc87ec830a tempest-VolumesSnapshotNegativeTestJSON-396039892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-131f04e6-603a-4d47-9cdf-aa98fc326197.info" returned: 0 in 0.298s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:33:28 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-16ed6552-7ada-4058-8862-78fc87ec830a tempest-VolumesSnapshotNegativeTestJSON-396039892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.513s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:33:28 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-43df6ff8-3bc5-4be7-b602-900e766150db tempest-VolumesTransfersTest-997634441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.734s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:33:28 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-43df6ff8-3bc5-4be7-b602-900e766150db tempest-VolumesTransfersTest-997634441 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:33:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1752955162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2117112-88a7-4180-aed3-444fc1cc1180,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9561983f520e4c848806cb89c3df4a88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:33:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:33:27Z,use_quota=True,user_id='62f6484aff15499781684b21ca39ca24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:33:28 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-43df6ff8-3bc5-4be7-b602-900e766150db tempest-VolumesTransfersTest-997634441 None] Creating volume c2117112-88a7-4180-aed3-444fc1cc1180 {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:33:28 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-43df6ff8-3bc5-4be7-b602-900e766150db tempest-VolumesTransfersTest-997634441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:33:28 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-43df6ff8-3bc5-4be7-b602-900e766150db tempest-VolumesTransfersTest-997634441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:33:28 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-43df6ff8-3bc5-4be7-b602-900e766150db tempest-VolumesTransfersTest-997634441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:33:28 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-43df6ff8-3bc5-4be7-b602-900e766150db tempest-VolumesTransfersTest-997634441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:33:28 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-43df6ff8-3bc5-4be7-b602-900e766150db tempest-VolumesTransfersTest-997634441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:33:28 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-43df6ff8-3bc5-4be7-b602-900e766150db tempest-VolumesTransfersTest-997634441 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:33:28 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-43df6ff8-3bc5-4be7-b602-900e766150db tempest-VolumesTransfersTest-997634441 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:33:28 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-43df6ff8-3bc5-4be7-b602-900e766150db tempest-VolumesTransfersTest-997634441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c2117112-88a7-4180-aed3-444fc1cc1180 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:33:28 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-16ed6552-7ada-4058-8862-78fc87ec830a tempest-VolumesSnapshotNegativeTestJSON-396039892 None] Create snapshot completed successfully Aug 26 14:33:28 devstack sudo[107657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c2117112-88a7-4180-aed3-444fc1cc1180 1073741824 Aug 26 14:33:28 devstack sudo[107657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:33:29 devstack sudo[107657]: pam_unix(sudo:session): session closed for user root Aug 26 14:33:29 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-43df6ff8-3bc5-4be7-b602-900e766150db tempest-VolumesTransfersTest-997634441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c2117112-88a7-4180-aed3-444fc1cc1180 1073741824" returned: 0 in 0.679s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:33:29 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-43df6ff8-3bc5-4be7-b602-900e766150db tempest-VolumesTransfersTest-997634441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c2117112-88a7-4180-aed3-444fc1cc1180 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:33:29 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-4976888e-17ea-459b-be19-bce2da61ab01 tempest-VolumesSnapshotNegativeTestJSON-396039892 None] Acquiring lock "cinder-5e5729dc-1a2a-475d-8c6f-b8c7f13f9bc6-delete_snapshot" by "delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:33:29 devstack sudo[107668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c2117112-88a7-4180-aed3-444fc1cc1180 Aug 26 14:33:29 devstack sudo[107668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:33:29 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-4976888e-17ea-459b-be19-bce2da61ab01 tempest-VolumesSnapshotNegativeTestJSON-396039892 None] Lock "cinder-5e5729dc-1a2a-475d-8c6f-b8c7f13f9bc6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:33:29 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-4976888e-17ea-459b-be19-bce2da61ab01 tempest-VolumesSnapshotNegativeTestJSON-396039892 None] Acquiring lock "cinder-quobyte-131f04e6-603a-4d47-9cdf-aa98fc326197" by "delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:33:29 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-4976888e-17ea-459b-be19-bce2da61ab01 tempest-VolumesSnapshotNegativeTestJSON-396039892 None] Lock "cinder-quobyte-131f04e6-603a-4d47-9cdf-aa98fc326197" acquired by "delete_snapshot" :: waited 0.021s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:33:29 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-4976888e-17ea-459b-be19-bce2da61ab01 tempest-VolumesSnapshotNegativeTestJSON-396039892 None] Acquiring lock "cinder-quobyte-5e5729dc-1a2a-475d-8c6f-b8c7f13f9bc6" by "_delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:33:29 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-4976888e-17ea-459b-be19-bce2da61ab01 tempest-VolumesSnapshotNegativeTestJSON-396039892 None] Lock "cinder-quobyte-5e5729dc-1a2a-475d-8c6f-b8c7f13f9bc6" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:33:29 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-4976888e-17ea-459b-be19-bce2da61ab01 tempest-VolumesSnapshotNegativeTestJSON-396039892 None] Deleting offline snapshot 5e5729dc-1a2a-475d-8c6f-b8c7f13f9bc6 of volume 131f04e6-603a-4d47-9cdf-aa98fc326197 {{(pid=94394) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 14:33:29 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-4976888e-17ea-459b-be19-bce2da61ab01 tempest-VolumesSnapshotNegativeTestJSON-396039892 None] snapshot_file for this snap is: volume-131f04e6-603a-4d47-9cdf-aa98fc326197.5e5729dc-1a2a-475d-8c6f-b8c7f13f9bc6 {{(pid=94394) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 14:33:29 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f53f59b-83a8-492c-8c48-1bdecfdfabc4]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:33:29 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4976888e-17ea-459b-be19-bce2da61ab01 tempest-VolumesSnapshotNegativeTestJSON-396039892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-131f04e6-603a-4d47-9cdf-aa98fc326197.5e5729dc-1a2a-475d-8c6f-b8c7f13f9bc6 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:33:29 devstack sudo[107670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-131f04e6-603a-4d47-9cdf-aa98fc326197.5e5729dc-1a2a-475d-8c6f-b8c7f13f9bc6 Aug 26 14:33:29 devstack sudo[107670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:33:29 devstack sudo[107668]: pam_unix(sudo:session): session closed for user root Aug 26 14:33:29 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-43df6ff8-3bc5-4be7-b602-900e766150db tempest-VolumesTransfersTest-997634441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c2117112-88a7-4180-aed3-444fc1cc1180" returned: 0 in 0.379s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:33:29 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-43df6ff8-3bc5-4be7-b602-900e766150db tempest-VolumesTransfersTest-997634441 None] <== create_volume: return (1126ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:33:29 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-43df6ff8-3bc5-4be7-b602-900e766150db tempest-VolumesTransfersTest-997634441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.132s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:33:29 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-43df6ff8-3bc5-4be7-b602-900e766150db tempest-VolumesTransfersTest-997634441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5a54047-942c-47c9-aa86-58c7738c488c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2117112-88a7-4180-aed3-444fc1cc1180', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:33:29 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-43df6ff8-3bc5-4be7-b602-900e766150db tempest-VolumesTransfersTest-997634441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90ce2837-14cf-4f9e-a64a-e749f754897b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:33:29 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-43df6ff8-3bc5-4be7-b602-900e766150db tempest-VolumesTransfersTest-997634441 None] Volume volume-c2117112-88a7-4180-aed3-444fc1cc1180 (c2117112-88a7-4180-aed3-444fc1cc1180): created successfully Aug 26 14:33:29 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-43df6ff8-3bc5-4be7-b602-900e766150db tempest-VolumesTransfersTest-997634441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90ce2837-14cf-4f9e-a64a-e749f754897b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:33:29 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-43df6ff8-3bc5-4be7-b602-900e766150db tempest-VolumesTransfersTest-997634441 None] Flow 'volume_create_manager' (e1994d88-651d-4dff-a8d9-197df35e9596) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:33:30 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-43df6ff8-3bc5-4be7-b602-900e766150db tempest-VolumesTransfersTest-997634441 None] Created volume successfully. Aug 26 14:33:30 devstack sudo[107670]: pam_unix(sudo:session): session closed for user root Aug 26 14:33:30 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4976888e-17ea-459b-be19-bce2da61ab01 tempest-VolumesSnapshotNegativeTestJSON-396039892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-131f04e6-603a-4d47-9cdf-aa98fc326197.5e5729dc-1a2a-475d-8c6f-b8c7f13f9bc6" returned: 0 in 0.631s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:33:30 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-4976888e-17ea-459b-be19-bce2da61ab01 tempest-VolumesSnapshotNegativeTestJSON-396039892 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-131f04e6-603a-4d47-9cdf-aa98fc326197(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94394) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 14:33:30 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[650384a5-1299-4972-8730-d1d709a222e6]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:33:30 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4976888e-17ea-459b-be19-bce2da61ab01 tempest-VolumesSnapshotNegativeTestJSON-396039892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-131f04e6-603a-4d47-9cdf-aa98fc326197 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:33:30 devstack sudo[107677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-131f04e6-603a-4d47-9cdf-aa98fc326197 Aug 26 14:33:30 devstack sudo[107677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:33:30 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-0fb2fd2a-8b05-4590-8085-5beb53f49adb tempest-VolumesTransfersTest-1806614467 None] Acquiring lock "cinder-c2117112-88a7-4180-aed3-444fc1cc1180-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:33:30 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-0fb2fd2a-8b05-4590-8085-5beb53f49adb tempest-VolumesTransfersTest-1806614467 None] Lock "cinder-c2117112-88a7-4180-aed3-444fc1cc1180-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:33:30 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-0fb2fd2a-8b05-4590-8085-5beb53f49adb tempest-VolumesTransfersTest-1806614467 None] Acquiring lock "cinder-quobyte-c2117112-88a7-4180-aed3-444fc1cc1180" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:33:30 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-0fb2fd2a-8b05-4590-8085-5beb53f49adb tempest-VolumesTransfersTest-1806614467 None] Lock "cinder-quobyte-c2117112-88a7-4180-aed3-444fc1cc1180" acquired by "delete_volume" :: waited 0.025s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:33:30 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f0ae4c9-c971-4531-b1b3-505782968a79]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:33:30 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-0fb2fd2a-8b05-4590-8085-5beb53f49adb tempest-VolumesTransfersTest-1806614467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c2117112-88a7-4180-aed3-444fc1cc1180 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:33:30 devstack sudo[107679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c2117112-88a7-4180-aed3-444fc1cc1180 Aug 26 14:33:30 devstack sudo[107679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:33:31 devstack sudo[107677]: pam_unix(sudo:session): session closed for user root Aug 26 14:33:31 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4976888e-17ea-459b-be19-bce2da61ab01 tempest-VolumesSnapshotNegativeTestJSON-396039892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-131f04e6-603a-4d47-9cdf-aa98fc326197" returned: 0 in 0.704s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:33:31 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4976888e-17ea-459b-be19-bce2da61ab01 tempest-VolumesSnapshotNegativeTestJSON-396039892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-131f04e6-603a-4d47-9cdf-aa98fc326197.5e5729dc-1a2a-475d-8c6f-b8c7f13f9bc6 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:33:31 devstack sudo[107684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-131f04e6-603a-4d47-9cdf-aa98fc326197.5e5729dc-1a2a-475d-8c6f-b8c7f13f9bc6 Aug 26 14:33:31 devstack sudo[107684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:33:31 devstack sudo[107679]: pam_unix(sudo:session): session closed for user root Aug 26 14:33:31 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-0fb2fd2a-8b05-4590-8085-5beb53f49adb tempest-VolumesTransfersTest-1806614467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c2117112-88a7-4180-aed3-444fc1cc1180" returned: 0 in 0.601s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:33:31 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-0fb2fd2a-8b05-4590-8085-5beb53f49adb tempest-VolumesTransfersTest-1806614467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c2117112-88a7-4180-aed3-444fc1cc1180 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:33:31 devstack sudo[107694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c2117112-88a7-4180-aed3-444fc1cc1180 Aug 26 14:33:31 devstack sudo[107694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:33:31 devstack sudo[107684]: pam_unix(sudo:session): session closed for user root Aug 26 14:33:31 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4976888e-17ea-459b-be19-bce2da61ab01 tempest-VolumesSnapshotNegativeTestJSON-396039892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-131f04e6-603a-4d47-9cdf-aa98fc326197.5e5729dc-1a2a-475d-8c6f-b8c7f13f9bc6" returned: 0 in 0.689s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:33:31 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4976888e-17ea-459b-be19-bce2da61ab01 tempest-VolumesSnapshotNegativeTestJSON-396039892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-131f04e6-603a-4d47-9cdf-aa98fc326197.5e5729dc-1a2a-475d-8c6f-b8c7f13f9bc6 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:33:31 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [req-c46b0d25-9f51-46b1-ba5d-7e3fd8084fac req-18bc8d22-8d5c-4fd3-b2d8-610378bc1db2 tempest-TestShelveInstance-576226965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:33:31 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [req-c46b0d25-9f51-46b1-ba5d-7e3fd8084fac req-18bc8d22-8d5c-4fd3-b2d8-610378bc1db2 tempest-TestShelveInstance-576226965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:33:31 devstack sudo[107703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-131f04e6-603a-4d47-9cdf-aa98fc326197.5e5729dc-1a2a-475d-8c6f-b8c7f13f9bc6 Aug 26 14:33:31 devstack sudo[107703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:33:31 devstack sudo[107694]: pam_unix(sudo:session): session closed for user root Aug 26 14:33:31 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-0fb2fd2a-8b05-4590-8085-5beb53f49adb tempest-VolumesTransfersTest-1806614467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-c2117112-88a7-4180-aed3-444fc1cc1180" returned: 0 in 0.455s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:33:31 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [req-c46b0d25-9f51-46b1-ba5d-7e3fd8084fac req-18bc8d22-8d5c-4fd3-b2d8-610378bc1db2 tempest-TestShelveInstance-576226965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.055s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:33:31 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-0fb2fd2a-8b05-4590-8085-5beb53f49adb tempest-VolumesTransfersTest-1806614467 None] Lock "cinder-quobyte-c2117112-88a7-4180-aed3-444fc1cc1180" released by "delete_volume" :: held 1.128s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:33:31 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [req-c46b0d25-9f51-46b1-ba5d-7e3fd8084fac req-18bc8d22-8d5c-4fd3-b2d8-610378bc1db2 tempest-TestShelveInstance-576226965 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b', 'name': 'volume-3b7c1dab-36c9-4a0a-a516-ee8e96311a19', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '65b02d95-8e3b-4363-b433-4b511ab94dcf', 'enforce_multipath': True} {{(pid=94394) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 14:33:32 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-0fb2fd2a-8b05-4590-8085-5beb53f49adb tempest-VolumesTransfersTest-1806614467 None] Created reservations ['ebe30b17-7069-4b0d-9f4b-4e4e8bd57c94', 'abb99583-1c8f-4ed4-99e9-b13328470277', 'bc44449b-f801-446a-a9f5-42f9d577f9dd', 'a7224b67-60e4-4df0-8027-16555345e40c'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:33:32 devstack cinder-volume[94394]: INFO cinder.volume.manager [req-c46b0d25-9f51-46b1-ba5d-7e3fd8084fac req-18bc8d22-8d5c-4fd3-b2d8-610378bc1db2 tempest-TestShelveInstance-576226965 None] attachment_update completed successfully. Aug 26 14:33:32 devstack sudo[107703]: pam_unix(sudo:session): session closed for user root Aug 26 14:33:32 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4976888e-17ea-459b-be19-bce2da61ab01 tempest-VolumesSnapshotNegativeTestJSON-396039892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-131f04e6-603a-4d47-9cdf-aa98fc326197.5e5729dc-1a2a-475d-8c6f-b8c7f13f9bc6" returned: 0 in 0.359s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:33:32 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-4976888e-17ea-459b-be19-bce2da61ab01 tempest-VolumesSnapshotNegativeTestJSON-396039892 None] Lock "cinder-quobyte-5e5729dc-1a2a-475d-8c6f-b8c7f13f9bc6" released by "_delete_snapshot" :: held 2.562s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:33:32 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-4976888e-17ea-459b-be19-bce2da61ab01 tempest-VolumesSnapshotNegativeTestJSON-396039892 None] Lock "cinder-quobyte-131f04e6-603a-4d47-9cdf-aa98fc326197" released by "delete_snapshot" :: held 2.597s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:33:32 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-0fb2fd2a-8b05-4590-8085-5beb53f49adb tempest-VolumesTransfersTest-1806614467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:33:32 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-0fb2fd2a-8b05-4590-8085-5beb53f49adb tempest-VolumesTransfersTest-1806614467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:33:32 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-0fb2fd2a-8b05-4590-8085-5beb53f49adb tempest-VolumesTransfersTest-1806614467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:33:32 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-0fb2fd2a-8b05-4590-8085-5beb53f49adb tempest-VolumesTransfersTest-1806614467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:33:32 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-0fb2fd2a-8b05-4590-8085-5beb53f49adb tempest-VolumesTransfersTest-1806614467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:33:32 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-0fb2fd2a-8b05-4590-8085-5beb53f49adb tempest-VolumesTransfersTest-1806614467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:33:32 devstack sudo[107711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:33:32 devstack sudo[107711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:33:32 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-4976888e-17ea-459b-be19-bce2da61ab01 tempest-VolumesSnapshotNegativeTestJSON-396039892 None] Created reservations ['655dcf43-6c66-4f60-b6f6-8f329190014d', 'd7afb650-1d3a-472f-bed6-e03b4d061fb9', '1efd7fc5-6797-4c1b-83cf-d822bbb50c21', '59281f85-da2b-4f27-934d-03a1c517fdfd'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:33:32 devstack sudo[107711]: pam_unix(sudo:session): session closed for user root Aug 26 14:33:32 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-0fb2fd2a-8b05-4590-8085-5beb53f49adb tempest-VolumesTransfersTest-1806614467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.380s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:33:32 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-0fb2fd2a-8b05-4590-8085-5beb53f49adb tempest-VolumesTransfersTest-1806614467 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:33:32 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-0fb2fd2a-8b05-4590-8085-5beb53f49adb tempest-VolumesTransfersTest-1806614467 None] Deleted volume successfully. Aug 26 14:33:32 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-0fb2fd2a-8b05-4590-8085-5beb53f49adb tempest-VolumesTransfersTest-1806614467 None] Lock "cinder-c2117112-88a7-4180-aed3-444fc1cc1180-delete_volume" released by "delete_volume" :: held 2.028s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:33:32 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-4976888e-17ea-459b-be19-bce2da61ab01 tempest-VolumesSnapshotNegativeTestJSON-396039892 None] Delete snapshot completed successfully. Aug 26 14:33:32 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-4976888e-17ea-459b-be19-bce2da61ab01 tempest-VolumesSnapshotNegativeTestJSON-396039892 None] Lock "cinder-5e5729dc-1a2a-475d-8c6f-b8c7f13f9bc6-delete_snapshot" released by "delete_snapshot" :: held 3.108s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:33:32 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-a5c7ba7a-0c83-4187-8edf-ab6f4c6ff964 tempest-VolumesSnapshotNegativeTestJSON-396039892 None] Acquiring lock "cinder-131f04e6-603a-4d47-9cdf-aa98fc326197-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:33:33 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-a5c7ba7a-0c83-4187-8edf-ab6f4c6ff964 tempest-VolumesSnapshotNegativeTestJSON-396039892 None] Lock "cinder-131f04e6-603a-4d47-9cdf-aa98fc326197-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:33:33 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-a5c7ba7a-0c83-4187-8edf-ab6f4c6ff964 tempest-VolumesSnapshotNegativeTestJSON-396039892 None] Acquiring lock "cinder-quobyte-131f04e6-603a-4d47-9cdf-aa98fc326197" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:33:33 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-a5c7ba7a-0c83-4187-8edf-ab6f4c6ff964 tempest-VolumesSnapshotNegativeTestJSON-396039892 None] Lock "cinder-quobyte-131f04e6-603a-4d47-9cdf-aa98fc326197" acquired by "delete_volume" :: waited 0.016s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:33:33 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[3465b460-b5da-43b3-a4c0-d8175a00dbcd]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:33:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-a5c7ba7a-0c83-4187-8edf-ab6f4c6ff964 tempest-VolumesSnapshotNegativeTestJSON-396039892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-131f04e6-603a-4d47-9cdf-aa98fc326197 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:33:33 devstack sudo[107730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-131f04e6-603a-4d47-9cdf-aa98fc326197 Aug 26 14:33:33 devstack sudo[107730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:33:33 devstack sudo[107730]: pam_unix(sudo:session): session closed for user root Aug 26 14:33:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-a5c7ba7a-0c83-4187-8edf-ab6f4c6ff964 tempest-VolumesSnapshotNegativeTestJSON-396039892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-131f04e6-603a-4d47-9cdf-aa98fc326197" returned: 0 in 0.425s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:33:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-a5c7ba7a-0c83-4187-8edf-ab6f4c6ff964 tempest-VolumesSnapshotNegativeTestJSON-396039892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-131f04e6-603a-4d47-9cdf-aa98fc326197 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:33:33 devstack cinder-volume[94394]: DEBUG oslo_service.periodic_task [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94394) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 14:33:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:33:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:33:33 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:33:33 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:33:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:33:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:33:33 devstack sudo[107735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-131f04e6-603a-4d47-9cdf-aa98fc326197 Aug 26 14:33:33 devstack sudo[107735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:33:33 devstack sudo[107736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:33:33 devstack sudo[107736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:33:33 devstack sudo[107736]: pam_unix(sudo:session): session closed for user root Aug 26 14:33:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.339s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:33:33 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:33:33 devstack cinder-volume[94394]: DEBUG oslo_service.periodic_task [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Running periodic task VolumeManager._thread_info {{(pid=94394) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 14:33:33 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] thread count: 28 {{(pid=94394) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 14:33:33 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] thread info: [<_MainThread(MainThread, started 126600738033792)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94394) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 14:33:33 devstack sudo[107735]: pam_unix(sudo:session): session closed for user root Aug 26 14:33:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-a5c7ba7a-0c83-4187-8edf-ab6f4c6ff964 tempest-VolumesSnapshotNegativeTestJSON-396039892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-131f04e6-603a-4d47-9cdf-aa98fc326197" returned: 0 in 0.391s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:33:33 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-a5c7ba7a-0c83-4187-8edf-ab6f4c6ff964 tempest-VolumesSnapshotNegativeTestJSON-396039892 None] Lock "cinder-quobyte-131f04e6-603a-4d47-9cdf-aa98fc326197" released by "delete_volume" :: held 0.892s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:33:34 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-a5c7ba7a-0c83-4187-8edf-ab6f4c6ff964 tempest-VolumesSnapshotNegativeTestJSON-396039892 None] Created reservations ['cda85fce-a7b5-4525-94e5-a940e1ae5ca5', 'e95d2ab1-225b-48cc-8ffa-33eb363f5289', '8252239f-1689-46d8-9cfe-6ce7153f5d92', '817564dc-aac5-455e-9094-bc57b7855626'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:33:34 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-a5c7ba7a-0c83-4187-8edf-ab6f4c6ff964 tempest-VolumesSnapshotNegativeTestJSON-396039892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:33:34 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-a5c7ba7a-0c83-4187-8edf-ab6f4c6ff964 tempest-VolumesSnapshotNegativeTestJSON-396039892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:33:34 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-a5c7ba7a-0c83-4187-8edf-ab6f4c6ff964 tempest-VolumesSnapshotNegativeTestJSON-396039892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:33:34 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-a5c7ba7a-0c83-4187-8edf-ab6f4c6ff964 tempest-VolumesSnapshotNegativeTestJSON-396039892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:33:34 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-a5c7ba7a-0c83-4187-8edf-ab6f4c6ff964 tempest-VolumesSnapshotNegativeTestJSON-396039892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:33:34 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-a5c7ba7a-0c83-4187-8edf-ab6f4c6ff964 tempest-VolumesSnapshotNegativeTestJSON-396039892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:33:34 devstack sudo[107742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:33:34 devstack sudo[107742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:33:34 devstack sudo[107742]: pam_unix(sudo:session): session closed for user root Aug 26 14:33:34 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-a5c7ba7a-0c83-4187-8edf-ab6f4c6ff964 tempest-VolumesSnapshotNegativeTestJSON-396039892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.380s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:33:34 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-a5c7ba7a-0c83-4187-8edf-ab6f4c6ff964 tempest-VolumesSnapshotNegativeTestJSON-396039892 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:33:34 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-a5c7ba7a-0c83-4187-8edf-ab6f4c6ff964 tempest-VolumesSnapshotNegativeTestJSON-396039892 None] Deleted volume successfully. Aug 26 14:33:34 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-a5c7ba7a-0c83-4187-8edf-ab6f4c6ff964 tempest-VolumesSnapshotNegativeTestJSON-396039892 None] Lock "cinder-131f04e6-603a-4d47-9cdf-aa98fc326197-delete_volume" released by "delete_volume" :: held 1.616s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:33:44 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-e19020fb-b8bb-4827-ac3b-4464386391c2 tempest-VolumesTransfersV355Test-567713619 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:33:44 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-e19020fb-b8bb-4827-ac3b-4464386391c2 tempest-VolumesTransfersV355Test-567713619 None] Flow 'volume_create_manager' (3c394540-ecaf-4565-a593-013505dd3ec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:33:44 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-e19020fb-b8bb-4827-ac3b-4464386391c2 tempest-VolumesTransfersV355Test-567713619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d09ab475-cd7f-47c7-91cb-56587a41f20e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:33:44 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-e19020fb-b8bb-4827-ac3b-4464386391c2 tempest-VolumesTransfersV355Test-567713619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d09ab475-cd7f-47c7-91cb-56587a41f20e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:33:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-909943090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3769f8b6-891e-4e0e-a1c8-412b05fa97c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a49327d674054401b90ce4171482145a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:33:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:33:45Z,use_quota=True,user_id='c071c80062d6404da55f4371f8be208f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:33:44 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-e19020fb-b8bb-4827-ac3b-4464386391c2 tempest-VolumesTransfersV355Test-567713619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9528f0a9-cf77-4e91-925d-917cd0a270c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:33:44 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-e19020fb-b8bb-4827-ac3b-4464386391c2 tempest-VolumesTransfersV355Test-567713619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9528f0a9-cf77-4e91-925d-917cd0a270c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:33:44 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-e19020fb-b8bb-4827-ac3b-4464386391c2 tempest-VolumesTransfersV355Test-567713619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e165caa-0015-4c8e-ae29-52fd24f1d7dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:33:44 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-e19020fb-b8bb-4827-ac3b-4464386391c2 tempest-VolumesTransfersV355Test-567713619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e165caa-0015-4c8e-ae29-52fd24f1d7dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3769f8b6-891e-4e0e-a1c8-412b05fa97c2', 'volume_name': 'volume-3769f8b6-891e-4e0e-a1c8-412b05fa97c2', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:33:44 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-e19020fb-b8bb-4827-ac3b-4464386391c2 tempest-VolumesTransfersV355Test-567713619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9b37770-0684-4d4c-bfb3-da8150098070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:33:44 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-e19020fb-b8bb-4827-ac3b-4464386391c2 tempest-VolumesTransfersV355Test-567713619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9b37770-0684-4d4c-bfb3-da8150098070) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:33:44 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-e19020fb-b8bb-4827-ac3b-4464386391c2 tempest-VolumesTransfersV355Test-567713619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54639e6a-5891-40a0-b865-184c6eb69f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:33:44 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-e19020fb-b8bb-4827-ac3b-4464386391c2 tempest-VolumesTransfersV355Test-567713619 None] Volume 3769f8b6-891e-4e0e-a1c8-412b05fa97c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3769f8b6-891e-4e0e-a1c8-412b05fa97c2', 'volume_size': 1} Aug 26 14:33:44 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e19020fb-b8bb-4827-ac3b-4464386391c2 tempest-VolumesTransfersV355Test-567713619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:33:44 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e19020fb-b8bb-4827-ac3b-4464386391c2 tempest-VolumesTransfersV355Test-567713619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:33:44 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-e19020fb-b8bb-4827-ac3b-4464386391c2 tempest-VolumesTransfersV355Test-567713619 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:33:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-909943090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3769f8b6-891e-4e0e-a1c8-412b05fa97c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a49327d674054401b90ce4171482145a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:33:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:33:45Z,use_quota=True,user_id='c071c80062d6404da55f4371f8be208f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:33:44 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-e19020fb-b8bb-4827-ac3b-4464386391c2 tempest-VolumesTransfersV355Test-567713619 None] Creating volume 3769f8b6-891e-4e0e-a1c8-412b05fa97c2 {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:33:44 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e19020fb-b8bb-4827-ac3b-4464386391c2 tempest-VolumesTransfersV355Test-567713619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:33:44 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e19020fb-b8bb-4827-ac3b-4464386391c2 tempest-VolumesTransfersV355Test-567713619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:33:44 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-e19020fb-b8bb-4827-ac3b-4464386391c2 tempest-VolumesTransfersV355Test-567713619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:33:44 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-e19020fb-b8bb-4827-ac3b-4464386391c2 tempest-VolumesTransfersV355Test-567713619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:33:44 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e19020fb-b8bb-4827-ac3b-4464386391c2 tempest-VolumesTransfersV355Test-567713619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:33:44 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-e19020fb-b8bb-4827-ac3b-4464386391c2 tempest-VolumesTransfersV355Test-567713619 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:33:44 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-e19020fb-b8bb-4827-ac3b-4464386391c2 tempest-VolumesTransfersV355Test-567713619 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:33:44 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e19020fb-b8bb-4827-ac3b-4464386391c2 tempest-VolumesTransfersV355Test-567713619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3769f8b6-891e-4e0e-a1c8-412b05fa97c2 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:33:44 devstack sudo[108223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3769f8b6-891e-4e0e-a1c8-412b05fa97c2 1073741824 Aug 26 14:33:44 devstack sudo[108223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:33:45 devstack sudo[108223]: pam_unix(sudo:session): session closed for user root Aug 26 14:33:45 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e19020fb-b8bb-4827-ac3b-4464386391c2 tempest-VolumesTransfersV355Test-567713619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3769f8b6-891e-4e0e-a1c8-412b05fa97c2 1073741824" returned: 0 in 0.783s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:33:45 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e19020fb-b8bb-4827-ac3b-4464386391c2 tempest-VolumesTransfersV355Test-567713619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3769f8b6-891e-4e0e-a1c8-412b05fa97c2 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:33:45 devstack sudo[108229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3769f8b6-891e-4e0e-a1c8-412b05fa97c2 Aug 26 14:33:45 devstack sudo[108229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:33:45 devstack sudo[108229]: pam_unix(sudo:session): session closed for user root Aug 26 14:33:45 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e19020fb-b8bb-4827-ac3b-4464386391c2 tempest-VolumesTransfersV355Test-567713619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3769f8b6-891e-4e0e-a1c8-412b05fa97c2" returned: 0 in 0.355s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:33:45 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-e19020fb-b8bb-4827-ac3b-4464386391c2 tempest-VolumesTransfersV355Test-567713619 None] <== create_volume: return (1210ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:33:45 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e19020fb-b8bb-4827-ac3b-4464386391c2 tempest-VolumesTransfersV355Test-567713619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.214s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:33:45 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-e19020fb-b8bb-4827-ac3b-4464386391c2 tempest-VolumesTransfersV355Test-567713619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54639e6a-5891-40a0-b865-184c6eb69f55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3769f8b6-891e-4e0e-a1c8-412b05fa97c2', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:33:45 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-e19020fb-b8bb-4827-ac3b-4464386391c2 tempest-VolumesTransfersV355Test-567713619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85038433-dad7-4cd2-8ac0-d8364a5ca213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:33:45 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-e19020fb-b8bb-4827-ac3b-4464386391c2 tempest-VolumesTransfersV355Test-567713619 None] Volume volume-3769f8b6-891e-4e0e-a1c8-412b05fa97c2 (3769f8b6-891e-4e0e-a1c8-412b05fa97c2): created successfully Aug 26 14:33:45 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-e19020fb-b8bb-4827-ac3b-4464386391c2 tempest-VolumesTransfersV355Test-567713619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85038433-dad7-4cd2-8ac0-d8364a5ca213) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:33:45 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-e19020fb-b8bb-4827-ac3b-4464386391c2 tempest-VolumesTransfersV355Test-567713619 None] Flow 'volume_create_manager' (3c394540-ecaf-4565-a593-013505dd3ec4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:33:45 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-e19020fb-b8bb-4827-ac3b-4464386391c2 tempest-VolumesTransfersV355Test-567713619 None] Created volume successfully. Aug 26 14:33:47 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-abff7a7b-1c87-4da5-abd9-6f92c2026a52 tempest-VolumesTransfersV355Test-1546957525 None] Transfer volume completed successfully. Aug 26 14:33:48 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-778cf2f6-2c94-45bd-804f-e412bf5b6499 tempest-TestServerVolumeAttachScenarioOldVersion-234107580 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:33:48 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-778cf2f6-2c94-45bd-804f-e412bf5b6499 tempest-TestServerVolumeAttachScenarioOldVersion-234107580 None] Flow 'volume_create_manager' (bbb6ec9b-5555-4ed4-9467-5683219dfb6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:33:48 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-778cf2f6-2c94-45bd-804f-e412bf5b6499 tempest-TestServerVolumeAttachScenarioOldVersion-234107580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ef3fdee-3bf5-4a56-94fa-a12368dbae39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:33:48 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-778cf2f6-2c94-45bd-804f-e412bf5b6499 tempest-TestServerVolumeAttachScenarioOldVersion-234107580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ef3fdee-3bf5-4a56-94fa-a12368dbae39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:33:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1500187091',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=deafb135-1234-4eba-8ba6-1aef94ba3e4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a14346b75bc14ad38df8b5cf1db0013b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:33:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:33:48Z,use_quota=True,user_id='e67f2f1c0ec94638869e0d3812fe9458',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:33:48 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-778cf2f6-2c94-45bd-804f-e412bf5b6499 tempest-TestServerVolumeAttachScenarioOldVersion-234107580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1779d3aa-c4a0-409c-b195-80d761432d83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:33:48 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-778cf2f6-2c94-45bd-804f-e412bf5b6499 tempest-TestServerVolumeAttachScenarioOldVersion-234107580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1779d3aa-c4a0-409c-b195-80d761432d83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:33:48 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-778cf2f6-2c94-45bd-804f-e412bf5b6499 tempest-TestServerVolumeAttachScenarioOldVersion-234107580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7838a5ca-4fb2-45f4-8eaf-5d970d308be7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:33:48 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-778cf2f6-2c94-45bd-804f-e412bf5b6499 tempest-TestServerVolumeAttachScenarioOldVersion-234107580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7838a5ca-4fb2-45f4-8eaf-5d970d308be7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'deafb135-1234-4eba-8ba6-1aef94ba3e4e', 'volume_name': 'volume-deafb135-1234-4eba-8ba6-1aef94ba3e4e', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:33:48 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-778cf2f6-2c94-45bd-804f-e412bf5b6499 tempest-TestServerVolumeAttachScenarioOldVersion-234107580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e209c5a-e1b4-4bf2-bf2e-a2d07f9c432b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:33:48 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-778cf2f6-2c94-45bd-804f-e412bf5b6499 tempest-TestServerVolumeAttachScenarioOldVersion-234107580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e209c5a-e1b4-4bf2-bf2e-a2d07f9c432b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:33:48 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-778cf2f6-2c94-45bd-804f-e412bf5b6499 tempest-TestServerVolumeAttachScenarioOldVersion-234107580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a862d755-c445-4d91-b6a3-aa5433f8f75b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:33:48 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-778cf2f6-2c94-45bd-804f-e412bf5b6499 tempest-TestServerVolumeAttachScenarioOldVersion-234107580 None] Volume deafb135-1234-4eba-8ba6-1aef94ba3e4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-deafb135-1234-4eba-8ba6-1aef94ba3e4e', 'volume_size': 1} Aug 26 14:33:48 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-778cf2f6-2c94-45bd-804f-e412bf5b6499 tempest-TestServerVolumeAttachScenarioOldVersion-234107580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:33:48 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-778cf2f6-2c94-45bd-804f-e412bf5b6499 tempest-TestServerVolumeAttachScenarioOldVersion-234107580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:33:48 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-778cf2f6-2c94-45bd-804f-e412bf5b6499 tempest-TestServerVolumeAttachScenarioOldVersion-234107580 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:33:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1500187091',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=deafb135-1234-4eba-8ba6-1aef94ba3e4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a14346b75bc14ad38df8b5cf1db0013b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:33:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:33:48Z,use_quota=True,user_id='e67f2f1c0ec94638869e0d3812fe9458',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:33:48 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-778cf2f6-2c94-45bd-804f-e412bf5b6499 tempest-TestServerVolumeAttachScenarioOldVersion-234107580 None] Creating volume deafb135-1234-4eba-8ba6-1aef94ba3e4e {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:33:48 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-778cf2f6-2c94-45bd-804f-e412bf5b6499 tempest-TestServerVolumeAttachScenarioOldVersion-234107580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:33:48 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-778cf2f6-2c94-45bd-804f-e412bf5b6499 tempest-TestServerVolumeAttachScenarioOldVersion-234107580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:33:48 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-778cf2f6-2c94-45bd-804f-e412bf5b6499 tempest-TestServerVolumeAttachScenarioOldVersion-234107580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:33:48 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-778cf2f6-2c94-45bd-804f-e412bf5b6499 tempest-TestServerVolumeAttachScenarioOldVersion-234107580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:33:48 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-778cf2f6-2c94-45bd-804f-e412bf5b6499 tempest-TestServerVolumeAttachScenarioOldVersion-234107580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:33:48 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-778cf2f6-2c94-45bd-804f-e412bf5b6499 tempest-TestServerVolumeAttachScenarioOldVersion-234107580 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:33:48 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-778cf2f6-2c94-45bd-804f-e412bf5b6499 tempest-TestServerVolumeAttachScenarioOldVersion-234107580 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:33:48 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-778cf2f6-2c94-45bd-804f-e412bf5b6499 tempest-TestServerVolumeAttachScenarioOldVersion-234107580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-deafb135-1234-4eba-8ba6-1aef94ba3e4e 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:33:48 devstack sudo[108234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-deafb135-1234-4eba-8ba6-1aef94ba3e4e 1073741824 Aug 26 14:33:48 devstack sudo[108234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:33:48 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-d5b7c52e-3cca-438f-aa5a-920ba9c1c631 tempest-VolumesTransfersV355Test-2023512288 None] Acquiring lock "cinder-3769f8b6-891e-4e0e-a1c8-412b05fa97c2-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:33:48 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-d5b7c52e-3cca-438f-aa5a-920ba9c1c631 tempest-VolumesTransfersV355Test-2023512288 None] Lock "cinder-3769f8b6-891e-4e0e-a1c8-412b05fa97c2-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:33:48 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-d5b7c52e-3cca-438f-aa5a-920ba9c1c631 tempest-VolumesTransfersV355Test-2023512288 None] Acquiring lock "cinder-quobyte-3769f8b6-891e-4e0e-a1c8-412b05fa97c2" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:33:48 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-d5b7c52e-3cca-438f-aa5a-920ba9c1c631 tempest-VolumesTransfersV355Test-2023512288 None] Lock "cinder-quobyte-3769f8b6-891e-4e0e-a1c8-412b05fa97c2" acquired by "delete_volume" :: waited 0.018s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:33:48 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7e0687c-3de5-4972-a7bf-0ea3e33fd6d3]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:33:48 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-d5b7c52e-3cca-438f-aa5a-920ba9c1c631 tempest-VolumesTransfersV355Test-2023512288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3769f8b6-891e-4e0e-a1c8-412b05fa97c2 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:33:49 devstack sudo[108239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3769f8b6-891e-4e0e-a1c8-412b05fa97c2 Aug 26 14:33:49 devstack sudo[108239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:33:49 devstack sudo[108234]: pam_unix(sudo:session): session closed for user root Aug 26 14:33:49 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-778cf2f6-2c94-45bd-804f-e412bf5b6499 tempest-TestServerVolumeAttachScenarioOldVersion-234107580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-deafb135-1234-4eba-8ba6-1aef94ba3e4e 1073741824" returned: 0 in 0.727s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:33:49 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-778cf2f6-2c94-45bd-804f-e412bf5b6499 tempest-TestServerVolumeAttachScenarioOldVersion-234107580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-deafb135-1234-4eba-8ba6-1aef94ba3e4e {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:33:49 devstack sudo[108242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-deafb135-1234-4eba-8ba6-1aef94ba3e4e Aug 26 14:33:49 devstack sudo[108242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:33:49 devstack sudo[108239]: pam_unix(sudo:session): session closed for user root Aug 26 14:33:49 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-d5b7c52e-3cca-438f-aa5a-920ba9c1c631 tempest-VolumesTransfersV355Test-2023512288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3769f8b6-891e-4e0e-a1c8-412b05fa97c2" returned: 0 in 0.610s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:33:49 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-d5b7c52e-3cca-438f-aa5a-920ba9c1c631 tempest-VolumesTransfersV355Test-2023512288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3769f8b6-891e-4e0e-a1c8-412b05fa97c2 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:33:49 devstack sudo[108247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3769f8b6-891e-4e0e-a1c8-412b05fa97c2 Aug 26 14:33:49 devstack sudo[108247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:33:49 devstack sudo[108242]: pam_unix(sudo:session): session closed for user root Aug 26 14:33:49 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-778cf2f6-2c94-45bd-804f-e412bf5b6499 tempest-TestServerVolumeAttachScenarioOldVersion-234107580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-deafb135-1234-4eba-8ba6-1aef94ba3e4e" returned: 0 in 0.469s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:33:49 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-778cf2f6-2c94-45bd-804f-e412bf5b6499 tempest-TestServerVolumeAttachScenarioOldVersion-234107580 None] <== create_volume: return (1275ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:33:49 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-778cf2f6-2c94-45bd-804f-e412bf5b6499 tempest-TestServerVolumeAttachScenarioOldVersion-234107580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.281s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:33:49 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-778cf2f6-2c94-45bd-804f-e412bf5b6499 tempest-TestServerVolumeAttachScenarioOldVersion-234107580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a862d755-c445-4d91-b6a3-aa5433f8f75b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-deafb135-1234-4eba-8ba6-1aef94ba3e4e', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:33:49 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-778cf2f6-2c94-45bd-804f-e412bf5b6499 tempest-TestServerVolumeAttachScenarioOldVersion-234107580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39d0e415-cf80-4c63-a941-2f4c39c8a85f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:33:49 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-778cf2f6-2c94-45bd-804f-e412bf5b6499 tempest-TestServerVolumeAttachScenarioOldVersion-234107580 None] Volume volume-deafb135-1234-4eba-8ba6-1aef94ba3e4e (deafb135-1234-4eba-8ba6-1aef94ba3e4e): created successfully Aug 26 14:33:49 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-778cf2f6-2c94-45bd-804f-e412bf5b6499 tempest-TestServerVolumeAttachScenarioOldVersion-234107580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39d0e415-cf80-4c63-a941-2f4c39c8a85f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:33:49 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-778cf2f6-2c94-45bd-804f-e412bf5b6499 tempest-TestServerVolumeAttachScenarioOldVersion-234107580 None] Flow 'volume_create_manager' (bbb6ec9b-5555-4ed4-9467-5683219dfb6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:33:49 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-778cf2f6-2c94-45bd-804f-e412bf5b6499 tempest-TestServerVolumeAttachScenarioOldVersion-234107580 None] Created volume successfully. Aug 26 14:33:50 devstack sudo[108247]: pam_unix(sudo:session): session closed for user root Aug 26 14:33:50 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-d5b7c52e-3cca-438f-aa5a-920ba9c1c631 tempest-VolumesTransfersV355Test-2023512288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3769f8b6-891e-4e0e-a1c8-412b05fa97c2" returned: 0 in 0.704s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:33:50 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-d5b7c52e-3cca-438f-aa5a-920ba9c1c631 tempest-VolumesTransfersV355Test-2023512288 None] Lock "cinder-quobyte-3769f8b6-891e-4e0e-a1c8-412b05fa97c2" released by "delete_volume" :: held 1.397s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:33:50 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-d5b7c52e-3cca-438f-aa5a-920ba9c1c631 tempest-VolumesTransfersV355Test-2023512288 None] Created reservations ['6afea80d-463e-4c6e-b03e-f706db4cf083', 'ffa41519-6038-4ca1-8b58-2ed9ba2f31ef', '99156602-620c-4c6a-8940-d52b308dfe5f', '4380c41f-20eb-4607-b03a-2981b53262f8'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:33:50 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-d5b7c52e-3cca-438f-aa5a-920ba9c1c631 tempest-VolumesTransfersV355Test-2023512288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:33:50 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-d5b7c52e-3cca-438f-aa5a-920ba9c1c631 tempest-VolumesTransfersV355Test-2023512288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:33:50 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-d5b7c52e-3cca-438f-aa5a-920ba9c1c631 tempest-VolumesTransfersV355Test-2023512288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:33:50 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-d5b7c52e-3cca-438f-aa5a-920ba9c1c631 tempest-VolumesTransfersV355Test-2023512288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:33:50 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-d5b7c52e-3cca-438f-aa5a-920ba9c1c631 tempest-VolumesTransfersV355Test-2023512288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:33:50 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-d5b7c52e-3cca-438f-aa5a-920ba9c1c631 tempest-VolumesTransfersV355Test-2023512288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:33:50 devstack sudo[108252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:33:50 devstack sudo[108252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:33:51 devstack sudo[108252]: pam_unix(sudo:session): session closed for user root Aug 26 14:33:51 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-d5b7c52e-3cca-438f-aa5a-920ba9c1c631 tempest-VolumesTransfersV355Test-2023512288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.767s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:33:51 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-d5b7c52e-3cca-438f-aa5a-920ba9c1c631 tempest-VolumesTransfersV355Test-2023512288 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:33:51 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-d5b7c52e-3cca-438f-aa5a-920ba9c1c631 tempest-VolumesTransfersV355Test-2023512288 None] Deleted volume successfully. Aug 26 14:33:51 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-d5b7c52e-3cca-438f-aa5a-920ba9c1c631 tempest-VolumesTransfersV355Test-2023512288 None] Lock "cinder-3769f8b6-891e-4e0e-a1c8-412b05fa97c2-delete_volume" released by "delete_volume" :: held 2.742s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:33:52 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [req-86cd952c-f197-4676-b044-18675c240e86 req-05c3892e-b8f3-4210-bd9a-1efedeb19554 tempest-TestServerVolumeAttachScenarioOldVersion-234107580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:33:52 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [req-86cd952c-f197-4676-b044-18675c240e86 req-05c3892e-b8f3-4210-bd9a-1efedeb19554 tempest-TestServerVolumeAttachScenarioOldVersion-234107580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:33:52 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [req-86cd952c-f197-4676-b044-18675c240e86 req-05c3892e-b8f3-4210-bd9a-1efedeb19554 tempest-TestServerVolumeAttachScenarioOldVersion-234107580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:33:52 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [req-86cd952c-f197-4676-b044-18675c240e86 req-05c3892e-b8f3-4210-bd9a-1efedeb19554 tempest-TestServerVolumeAttachScenarioOldVersion-234107580 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b', 'name': 'volume-deafb135-1234-4eba-8ba6-1aef94ba3e4e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c9f3baa4-7dc0-49aa-b2fc-acde834fcd52', 'enforce_multipath': True} {{(pid=94394) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 14:33:52 devstack cinder-volume[94394]: INFO cinder.volume.manager [req-86cd952c-f197-4676-b044-18675c240e86 req-05c3892e-b8f3-4210-bd9a-1efedeb19554 tempest-TestServerVolumeAttachScenarioOldVersion-234107580 None] attachment_update completed successfully. Aug 26 14:33:52 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-f618271a-11b3-4f69-91e4-4470bb926a4a tempest-VolumesTransfersV355Test-567713619 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:33:52 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-f618271a-11b3-4f69-91e4-4470bb926a4a tempest-VolumesTransfersV355Test-567713619 None] Flow 'volume_create_manager' (55234571-2d91-4870-985f-0e93abba72e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:33:52 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-f618271a-11b3-4f69-91e4-4470bb926a4a tempest-VolumesTransfersV355Test-567713619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0879f0c-bdd1-44f1-aeff-258a47fc1558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:33:52 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-f618271a-11b3-4f69-91e4-4470bb926a4a tempest-VolumesTransfersV355Test-567713619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0879f0c-bdd1-44f1-aeff-258a47fc1558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:33:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-60532408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2db97e5a-dd0c-42c0-8fad-622438d43f1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a49327d674054401b90ce4171482145a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:33:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:33:52Z,use_quota=True,user_id='c071c80062d6404da55f4371f8be208f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:33:52 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-f618271a-11b3-4f69-91e4-4470bb926a4a tempest-VolumesTransfersV355Test-567713619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e21cb56-6a3f-4c42-9888-4fac95d9b028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:33:52 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-f618271a-11b3-4f69-91e4-4470bb926a4a tempest-VolumesTransfersV355Test-567713619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e21cb56-6a3f-4c42-9888-4fac95d9b028) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:33:52 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-f618271a-11b3-4f69-91e4-4470bb926a4a tempest-VolumesTransfersV355Test-567713619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23dcf079-6055-4265-86ef-bd6c8dd1b7d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:33:52 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-f618271a-11b3-4f69-91e4-4470bb926a4a tempest-VolumesTransfersV355Test-567713619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23dcf079-6055-4265-86ef-bd6c8dd1b7d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2db97e5a-dd0c-42c0-8fad-622438d43f1d', 'volume_name': 'volume-2db97e5a-dd0c-42c0-8fad-622438d43f1d', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:33:52 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-f618271a-11b3-4f69-91e4-4470bb926a4a tempest-VolumesTransfersV355Test-567713619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (895e4f6a-b2f6-4b4c-900c-4f4917ea9686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:33:52 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-f618271a-11b3-4f69-91e4-4470bb926a4a tempest-VolumesTransfersV355Test-567713619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (895e4f6a-b2f6-4b4c-900c-4f4917ea9686) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:33:52 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-f618271a-11b3-4f69-91e4-4470bb926a4a tempest-VolumesTransfersV355Test-567713619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1f3df9e-859c-4edf-8042-4e3f60ec66ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:33:52 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-f618271a-11b3-4f69-91e4-4470bb926a4a tempest-VolumesTransfersV355Test-567713619 None] Volume 2db97e5a-dd0c-42c0-8fad-622438d43f1d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2db97e5a-dd0c-42c0-8fad-622438d43f1d', 'volume_size': 1} Aug 26 14:33:52 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-f618271a-11b3-4f69-91e4-4470bb926a4a tempest-VolumesTransfersV355Test-567713619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:33:52 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-f618271a-11b3-4f69-91e4-4470bb926a4a tempest-VolumesTransfersV355Test-567713619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:33:52 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-f618271a-11b3-4f69-91e4-4470bb926a4a tempest-VolumesTransfersV355Test-567713619 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:33:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-60532408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2db97e5a-dd0c-42c0-8fad-622438d43f1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a49327d674054401b90ce4171482145a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:33:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:33:52Z,use_quota=True,user_id='c071c80062d6404da55f4371f8be208f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:33:52 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-f618271a-11b3-4f69-91e4-4470bb926a4a tempest-VolumesTransfersV355Test-567713619 None] Creating volume 2db97e5a-dd0c-42c0-8fad-622438d43f1d {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:33:52 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-f618271a-11b3-4f69-91e4-4470bb926a4a tempest-VolumesTransfersV355Test-567713619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:33:52 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-f618271a-11b3-4f69-91e4-4470bb926a4a tempest-VolumesTransfersV355Test-567713619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:33:52 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-f618271a-11b3-4f69-91e4-4470bb926a4a tempest-VolumesTransfersV355Test-567713619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:33:52 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-f618271a-11b3-4f69-91e4-4470bb926a4a tempest-VolumesTransfersV355Test-567713619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:33:52 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-f618271a-11b3-4f69-91e4-4470bb926a4a tempest-VolumesTransfersV355Test-567713619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:33:52 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-f618271a-11b3-4f69-91e4-4470bb926a4a tempest-VolumesTransfersV355Test-567713619 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:33:52 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-f618271a-11b3-4f69-91e4-4470bb926a4a tempest-VolumesTransfersV355Test-567713619 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:33:52 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-f618271a-11b3-4f69-91e4-4470bb926a4a tempest-VolumesTransfersV355Test-567713619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2db97e5a-dd0c-42c0-8fad-622438d43f1d 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:33:52 devstack sudo[108271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2db97e5a-dd0c-42c0-8fad-622438d43f1d 1073741824 Aug 26 14:33:52 devstack sudo[108271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:33:53 devstack sudo[108271]: pam_unix(sudo:session): session closed for user root Aug 26 14:33:53 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-f618271a-11b3-4f69-91e4-4470bb926a4a tempest-VolumesTransfersV355Test-567713619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2db97e5a-dd0c-42c0-8fad-622438d43f1d 1073741824" returned: 0 in 0.661s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:33:53 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-f618271a-11b3-4f69-91e4-4470bb926a4a tempest-VolumesTransfersV355Test-567713619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2db97e5a-dd0c-42c0-8fad-622438d43f1d {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:33:53 devstack sudo[108278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2db97e5a-dd0c-42c0-8fad-622438d43f1d Aug 26 14:33:53 devstack sudo[108278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:33:53 devstack sudo[108278]: pam_unix(sudo:session): session closed for user root Aug 26 14:33:53 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-f618271a-11b3-4f69-91e4-4470bb926a4a tempest-VolumesTransfersV355Test-567713619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2db97e5a-dd0c-42c0-8fad-622438d43f1d" returned: 0 in 0.408s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:33:53 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-f618271a-11b3-4f69-91e4-4470bb926a4a tempest-VolumesTransfersV355Test-567713619 None] <== create_volume: return (1129ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:33:53 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-f618271a-11b3-4f69-91e4-4470bb926a4a tempest-VolumesTransfersV355Test-567713619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.133s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:33:53 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-f618271a-11b3-4f69-91e4-4470bb926a4a tempest-VolumesTransfersV355Test-567713619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1f3df9e-859c-4edf-8042-4e3f60ec66ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2db97e5a-dd0c-42c0-8fad-622438d43f1d', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:33:53 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-f618271a-11b3-4f69-91e4-4470bb926a4a tempest-VolumesTransfersV355Test-567713619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d7e46da-d59b-431f-b854-0336ecb943a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:33:53 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-f618271a-11b3-4f69-91e4-4470bb926a4a tempest-VolumesTransfersV355Test-567713619 None] Volume volume-2db97e5a-dd0c-42c0-8fad-622438d43f1d (2db97e5a-dd0c-42c0-8fad-622438d43f1d): created successfully Aug 26 14:33:53 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-f618271a-11b3-4f69-91e4-4470bb926a4a tempest-VolumesTransfersV355Test-567713619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d7e46da-d59b-431f-b854-0336ecb943a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:33:53 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-f618271a-11b3-4f69-91e4-4470bb926a4a tempest-VolumesTransfersV355Test-567713619 None] Flow 'volume_create_manager' (55234571-2d91-4870-985f-0e93abba72e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:33:53 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-f618271a-11b3-4f69-91e4-4470bb926a4a tempest-VolumesTransfersV355Test-567713619 None] Created volume successfully. Aug 26 14:33:55 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-133e95f9-dcf6-4385-86bb-51da411ad858 tempest-VolumesTransfersV355Test-2023512288 None] Acquiring lock "cinder-2db97e5a-dd0c-42c0-8fad-622438d43f1d-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:33:55 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-133e95f9-dcf6-4385-86bb-51da411ad858 tempest-VolumesTransfersV355Test-2023512288 None] Lock "cinder-2db97e5a-dd0c-42c0-8fad-622438d43f1d-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:33:55 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-133e95f9-dcf6-4385-86bb-51da411ad858 tempest-VolumesTransfersV355Test-2023512288 None] Acquiring lock "cinder-quobyte-2db97e5a-dd0c-42c0-8fad-622438d43f1d" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:33:55 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-133e95f9-dcf6-4385-86bb-51da411ad858 tempest-VolumesTransfersV355Test-2023512288 None] Lock "cinder-quobyte-2db97e5a-dd0c-42c0-8fad-622438d43f1d" acquired by "delete_volume" :: waited 0.024s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:33:55 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b65b64e-6bdb-4609-a0ed-c865cf47450a]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:33:55 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-133e95f9-dcf6-4385-86bb-51da411ad858 tempest-VolumesTransfersV355Test-2023512288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2db97e5a-dd0c-42c0-8fad-622438d43f1d {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:33:55 devstack sudo[108309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2db97e5a-dd0c-42c0-8fad-622438d43f1d Aug 26 14:33:55 devstack sudo[108309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:33:55 devstack sudo[108309]: pam_unix(sudo:session): session closed for user root Aug 26 14:33:55 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-133e95f9-dcf6-4385-86bb-51da411ad858 tempest-VolumesTransfersV355Test-2023512288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2db97e5a-dd0c-42c0-8fad-622438d43f1d" returned: 0 in 0.526s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:33:55 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-133e95f9-dcf6-4385-86bb-51da411ad858 tempest-VolumesTransfersV355Test-2023512288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2db97e5a-dd0c-42c0-8fad-622438d43f1d {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:33:55 devstack sudo[108314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2db97e5a-dd0c-42c0-8fad-622438d43f1d Aug 26 14:33:55 devstack sudo[108314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:33:56 devstack sudo[108314]: pam_unix(sudo:session): session closed for user root Aug 26 14:33:56 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-133e95f9-dcf6-4385-86bb-51da411ad858 tempest-VolumesTransfersV355Test-2023512288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2db97e5a-dd0c-42c0-8fad-622438d43f1d" returned: 0 in 0.354s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:33:56 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-133e95f9-dcf6-4385-86bb-51da411ad858 tempest-VolumesTransfersV355Test-2023512288 None] Lock "cinder-quobyte-2db97e5a-dd0c-42c0-8fad-622438d43f1d" released by "delete_volume" :: held 0.943s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:33:56 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-133e95f9-dcf6-4385-86bb-51da411ad858 tempest-VolumesTransfersV355Test-2023512288 None] Created reservations ['cc7ca67d-ce82-4cd2-accd-3701b728df59', '939b0a40-5c32-46a7-be97-583ba828449b', '3a0ce2d4-2abe-4396-a645-75860630fba5', '97cde310-2e89-4ad9-bb02-a9f4e4b1c43d'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:33:56 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-133e95f9-dcf6-4385-86bb-51da411ad858 tempest-VolumesTransfersV355Test-2023512288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:33:56 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-133e95f9-dcf6-4385-86bb-51da411ad858 tempest-VolumesTransfersV355Test-2023512288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:33:56 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-133e95f9-dcf6-4385-86bb-51da411ad858 tempest-VolumesTransfersV355Test-2023512288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:33:56 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-133e95f9-dcf6-4385-86bb-51da411ad858 tempest-VolumesTransfersV355Test-2023512288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:33:56 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-133e95f9-dcf6-4385-86bb-51da411ad858 tempest-VolumesTransfersV355Test-2023512288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:33:56 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-133e95f9-dcf6-4385-86bb-51da411ad858 tempest-VolumesTransfersV355Test-2023512288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:33:56 devstack sudo[108329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:33:56 devstack sudo[108329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:33:56 devstack cinder-volume[94394]: INFO cinder.volume.manager [req-07286750-20b0-40ed-be30-3103fff7bcfc req-5b17f207-3a7f-4660-8968-fdbb40b83496 tempest-TestServerVolumeAttachScenarioOldVersion-234107580 None] Terminate volume connection completed successfully. Aug 26 14:33:56 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [req-07286750-20b0-40ed-be30-3103fff7bcfc req-5b17f207-3a7f-4660-8968-fdbb40b83496 tempest-TestServerVolumeAttachScenarioOldVersion-234107580 None] Deleting attachment c9f3baa4-7dc0-49aa-b2fc-acde834fcd52. {{(pid=94394) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 14:33:56 devstack sudo[108329]: pam_unix(sudo:session): session closed for user root Aug 26 14:33:56 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-133e95f9-dcf6-4385-86bb-51da411ad858 tempest-VolumesTransfersV355Test-2023512288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.318s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:33:56 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-133e95f9-dcf6-4385-86bb-51da411ad858 tempest-VolumesTransfersV355Test-2023512288 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:33:56 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-133e95f9-dcf6-4385-86bb-51da411ad858 tempest-VolumesTransfersV355Test-2023512288 None] Deleted volume successfully. Aug 26 14:33:56 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-133e95f9-dcf6-4385-86bb-51da411ad858 tempest-VolumesTransfersV355Test-2023512288 None] Lock "cinder-2db97e5a-dd0c-42c0-8fad-622438d43f1d-delete_volume" released by "delete_volume" :: held 1.568s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:33:56 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-a4621588-ffd5-485c-b2a3-bda677f09647 tempest-TestServerVolumeAttachScenarioOldVersion-234107580 None] Acquiring lock "cinder-deafb135-1234-4eba-8ba6-1aef94ba3e4e-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:33:56 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-a4621588-ffd5-485c-b2a3-bda677f09647 tempest-TestServerVolumeAttachScenarioOldVersion-234107580 None] Lock "cinder-deafb135-1234-4eba-8ba6-1aef94ba3e4e-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:33:56 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-a4621588-ffd5-485c-b2a3-bda677f09647 tempest-TestServerVolumeAttachScenarioOldVersion-234107580 None] Acquiring lock "cinder-quobyte-deafb135-1234-4eba-8ba6-1aef94ba3e4e" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:33:57 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-a4621588-ffd5-485c-b2a3-bda677f09647 tempest-TestServerVolumeAttachScenarioOldVersion-234107580 None] Lock "cinder-quobyte-deafb135-1234-4eba-8ba6-1aef94ba3e4e" acquired by "delete_volume" :: waited 0.025s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:33:57 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[6923e71a-6900-4418-883c-168d45c414f4]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:33:57 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-a4621588-ffd5-485c-b2a3-bda677f09647 tempest-TestServerVolumeAttachScenarioOldVersion-234107580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-deafb135-1234-4eba-8ba6-1aef94ba3e4e {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:33:57 devstack sudo[108333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-deafb135-1234-4eba-8ba6-1aef94ba3e4e Aug 26 14:33:57 devstack sudo[108333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:33:57 devstack sudo[108333]: pam_unix(sudo:session): session closed for user root Aug 26 14:33:57 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-a4621588-ffd5-485c-b2a3-bda677f09647 tempest-TestServerVolumeAttachScenarioOldVersion-234107580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-deafb135-1234-4eba-8ba6-1aef94ba3e4e" returned: 0 in 0.442s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:33:57 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-a4621588-ffd5-485c-b2a3-bda677f09647 tempest-TestServerVolumeAttachScenarioOldVersion-234107580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-deafb135-1234-4eba-8ba6-1aef94ba3e4e {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:33:57 devstack sudo[108338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-deafb135-1234-4eba-8ba6-1aef94ba3e4e Aug 26 14:33:57 devstack sudo[108338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:33:57 devstack sudo[108338]: pam_unix(sudo:session): session closed for user root Aug 26 14:33:57 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-a4621588-ffd5-485c-b2a3-bda677f09647 tempest-TestServerVolumeAttachScenarioOldVersion-234107580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-deafb135-1234-4eba-8ba6-1aef94ba3e4e" returned: 0 in 0.272s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:33:57 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-a4621588-ffd5-485c-b2a3-bda677f09647 tempest-TestServerVolumeAttachScenarioOldVersion-234107580 None] Lock "cinder-quobyte-deafb135-1234-4eba-8ba6-1aef94ba3e4e" released by "delete_volume" :: held 0.762s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:33:57 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-a4621588-ffd5-485c-b2a3-bda677f09647 tempest-TestServerVolumeAttachScenarioOldVersion-234107580 None] Created reservations ['a5c7340c-a67a-4e0f-b82a-504b5c39bf52', '9d27bea1-bcc0-45a1-951d-02879dbb6cfb', 'a6edd939-fd7a-4ca7-8fab-53fa1a24fa8b', 'f2dbf563-9452-4324-89c9-a565f8df832c'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:33:57 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-a4621588-ffd5-485c-b2a3-bda677f09647 tempest-TestServerVolumeAttachScenarioOldVersion-234107580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:33:57 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-a4621588-ffd5-485c-b2a3-bda677f09647 tempest-TestServerVolumeAttachScenarioOldVersion-234107580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:33:57 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-a4621588-ffd5-485c-b2a3-bda677f09647 tempest-TestServerVolumeAttachScenarioOldVersion-234107580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:33:57 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-a4621588-ffd5-485c-b2a3-bda677f09647 tempest-TestServerVolumeAttachScenarioOldVersion-234107580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:33:57 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-a4621588-ffd5-485c-b2a3-bda677f09647 tempest-TestServerVolumeAttachScenarioOldVersion-234107580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:33:57 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-a4621588-ffd5-485c-b2a3-bda677f09647 tempest-TestServerVolumeAttachScenarioOldVersion-234107580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:33:57 devstack sudo[108341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:33:57 devstack sudo[108341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:33:58 devstack sudo[108341]: pam_unix(sudo:session): session closed for user root Aug 26 14:33:58 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-a4621588-ffd5-485c-b2a3-bda677f09647 tempest-TestServerVolumeAttachScenarioOldVersion-234107580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.357s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:33:58 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-a4621588-ffd5-485c-b2a3-bda677f09647 tempest-TestServerVolumeAttachScenarioOldVersion-234107580 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:33:58 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-a4621588-ffd5-485c-b2a3-bda677f09647 tempest-TestServerVolumeAttachScenarioOldVersion-234107580 None] Deleted volume successfully. Aug 26 14:33:58 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-a4621588-ffd5-485c-b2a3-bda677f09647 tempest-TestServerVolumeAttachScenarioOldVersion-234107580 None] Lock "cinder-deafb135-1234-4eba-8ba6-1aef94ba3e4e-delete_volume" released by "delete_volume" :: held 1.384s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:34:07 devstack cinder-volume[94394]: DEBUG dbcounter [-] [94394] Writing DB stats cinder:SELECT=75,cinder:INSERT=16,cinder:UPDATE=75,cinder:DELETE=6 {{(pid=94394) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 14:34:08 devstack cinder-volume[94394]: DEBUG dbcounter [-] [94394] Writing DB stats cinder:UPDATE=69,cinder:SELECT=58,cinder:DELETE=6,cinder:INSERT=29 {{(pid=94394) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 14:34:10 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-1293e311-03f9-4646-854b-198aee82b1e7 tempest-TestInstancesWithCinderVolumes-1323272046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:34:10 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-1293e311-03f9-4646-854b-198aee82b1e7 tempest-TestInstancesWithCinderVolumes-1323272046 None] Flow 'volume_create_manager' (9dc98bff-e719-4057-b2e4-8cdd4d15d856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:34:10 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-1293e311-03f9-4646-854b-198aee82b1e7 tempest-TestInstancesWithCinderVolumes-1323272046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0447dd3-9bc6-4106-840e-079284d77a94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:34:10 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-1293e311-03f9-4646-854b-198aee82b1e7 tempest-TestInstancesWithCinderVolumes-1323272046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0447dd3-9bc6-4106-840e-079284d77a94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:34:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1400122751',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66ce87d3-338e-48f9-843f-fe55e4d24e3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='743edc005b1441c49743742ee2697e4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:34:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:34:10Z,use_quota=True,user_id='4e24be3a172c4ecc984f442014758496',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30d98a37-0753-4dd1-8eb6-e85cdb5eefa9),volume_type_id=30d98a37-0753-4dd1-8eb6-e85cdb5eefa9)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:34:10 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-1293e311-03f9-4646-854b-198aee82b1e7 tempest-TestInstancesWithCinderVolumes-1323272046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e67e68b-5107-4b09-8154-ac7f27de5c7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:34:10 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-1293e311-03f9-4646-854b-198aee82b1e7 tempest-TestInstancesWithCinderVolumes-1323272046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e67e68b-5107-4b09-8154-ac7f27de5c7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:34:10 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-1293e311-03f9-4646-854b-198aee82b1e7 tempest-TestInstancesWithCinderVolumes-1323272046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e20d53e6-dbc3-401a-b3cc-72fdbff8ecac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:34:10 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-1293e311-03f9-4646-854b-198aee82b1e7 tempest-TestInstancesWithCinderVolumes-1323272046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e20d53e6-dbc3-401a-b3cc-72fdbff8ecac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66ce87d3-338e-48f9-843f-fe55e4d24e3c', 'volume_name': 'volume-66ce87d3-338e-48f9-843f-fe55e4d24e3c', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:34:10 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-1293e311-03f9-4646-854b-198aee82b1e7 tempest-TestInstancesWithCinderVolumes-1323272046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e70ded6-81a9-400a-a294-87e48d26e4bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:34:10 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-1293e311-03f9-4646-854b-198aee82b1e7 tempest-TestInstancesWithCinderVolumes-1323272046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e70ded6-81a9-400a-a294-87e48d26e4bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:34:10 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-1293e311-03f9-4646-854b-198aee82b1e7 tempest-TestInstancesWithCinderVolumes-1323272046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3212230-15c0-492c-a12d-d100b84f5eff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:34:10 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-1293e311-03f9-4646-854b-198aee82b1e7 tempest-TestInstancesWithCinderVolumes-1323272046 None] Volume 66ce87d3-338e-48f9-843f-fe55e4d24e3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66ce87d3-338e-48f9-843f-fe55e4d24e3c', 'volume_size': 1} Aug 26 14:34:10 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-1293e311-03f9-4646-854b-198aee82b1e7 tempest-TestInstancesWithCinderVolumes-1323272046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:34:10 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-1293e311-03f9-4646-854b-198aee82b1e7 tempest-TestInstancesWithCinderVolumes-1323272046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:34:10 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-1293e311-03f9-4646-854b-198aee82b1e7 tempest-TestInstancesWithCinderVolumes-1323272046 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:34:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1400122751',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66ce87d3-338e-48f9-843f-fe55e4d24e3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='743edc005b1441c49743742ee2697e4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:34:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:34:10Z,use_quota=True,user_id='4e24be3a172c4ecc984f442014758496',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30d98a37-0753-4dd1-8eb6-e85cdb5eefa9),volume_type_id=30d98a37-0753-4dd1-8eb6-e85cdb5eefa9)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:34:10 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-1293e311-03f9-4646-854b-198aee82b1e7 tempest-TestInstancesWithCinderVolumes-1323272046 None] Creating volume 66ce87d3-338e-48f9-843f-fe55e4d24e3c {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:34:10 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-1293e311-03f9-4646-854b-198aee82b1e7 tempest-TestInstancesWithCinderVolumes-1323272046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:34:10 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-1293e311-03f9-4646-854b-198aee82b1e7 tempest-TestInstancesWithCinderVolumes-1323272046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:34:10 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-1293e311-03f9-4646-854b-198aee82b1e7 tempest-TestInstancesWithCinderVolumes-1323272046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:34:10 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-1293e311-03f9-4646-854b-198aee82b1e7 tempest-TestInstancesWithCinderVolumes-1323272046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:34:10 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-1293e311-03f9-4646-854b-198aee82b1e7 tempest-TestInstancesWithCinderVolumes-1323272046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:34:10 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-1293e311-03f9-4646-854b-198aee82b1e7 tempest-TestInstancesWithCinderVolumes-1323272046 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:34:10 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-1293e311-03f9-4646-854b-198aee82b1e7 tempest-TestInstancesWithCinderVolumes-1323272046 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:34:10 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-1293e311-03f9-4646-854b-198aee82b1e7 tempest-TestInstancesWithCinderVolumes-1323272046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-66ce87d3-338e-48f9-843f-fe55e4d24e3c 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:34:10 devstack sudo[108395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-66ce87d3-338e-48f9-843f-fe55e4d24e3c 1073741824 Aug 26 14:34:10 devstack sudo[108395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:34:10 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb3089d4-bdf5-47d1-8e4d-6dd87e2adcae tempest-TestInstancesWithCinderVolumes-1323272046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:34:10 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-bb3089d4-bdf5-47d1-8e4d-6dd87e2adcae tempest-TestInstancesWithCinderVolumes-1323272046 None] Flow 'volume_create_manager' (82e1f516-51ff-4889-ad7e-a1b65435fdc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:34:10 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-bb3089d4-bdf5-47d1-8e4d-6dd87e2adcae tempest-TestInstancesWithCinderVolumes-1323272046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (236f97bd-74c3-4470-88a5-2b4f69054c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:34:10 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-bb3089d4-bdf5-47d1-8e4d-6dd87e2adcae tempest-TestInstancesWithCinderVolumes-1323272046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (236f97bd-74c3-4470-88a5-2b4f69054c3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:34:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-605616151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c9fe106-7525-49da-9ba9-6b2bb78ddb19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='743edc005b1441c49743742ee2697e4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:34:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:34:11Z,use_quota=True,user_id='4e24be3a172c4ecc984f442014758496',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a85ad6a-b8cc-4c6e-9f87-d8b040d0b6c9),volume_type_id=7a85ad6a-b8cc-4c6e-9f87-d8b040d0b6c9)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:34:10 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-bb3089d4-bdf5-47d1-8e4d-6dd87e2adcae tempest-TestInstancesWithCinderVolumes-1323272046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b94d5d32-4b0e-4d45-97de-ee72ffe1d647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:34:10 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-bb3089d4-bdf5-47d1-8e4d-6dd87e2adcae tempest-TestInstancesWithCinderVolumes-1323272046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b94d5d32-4b0e-4d45-97de-ee72ffe1d647) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:34:10 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-bb3089d4-bdf5-47d1-8e4d-6dd87e2adcae tempest-TestInstancesWithCinderVolumes-1323272046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6404c73-9a2e-4acf-8efc-780f4ad0ba18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:34:10 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-bb3089d4-bdf5-47d1-8e4d-6dd87e2adcae tempest-TestInstancesWithCinderVolumes-1323272046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6404c73-9a2e-4acf-8efc-780f4ad0ba18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c9fe106-7525-49da-9ba9-6b2bb78ddb19', 'volume_name': 'volume-3c9fe106-7525-49da-9ba9-6b2bb78ddb19', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:34:10 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-bb3089d4-bdf5-47d1-8e4d-6dd87e2adcae tempest-TestInstancesWithCinderVolumes-1323272046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0391a47e-bac7-4a21-8ac7-b2409d46bdd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:34:10 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-bb3089d4-bdf5-47d1-8e4d-6dd87e2adcae tempest-TestInstancesWithCinderVolumes-1323272046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0391a47e-bac7-4a21-8ac7-b2409d46bdd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:34:10 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-bb3089d4-bdf5-47d1-8e4d-6dd87e2adcae tempest-TestInstancesWithCinderVolumes-1323272046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (638da85e-940d-44a2-b89a-bafd3de82267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:34:10 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-bb3089d4-bdf5-47d1-8e4d-6dd87e2adcae tempest-TestInstancesWithCinderVolumes-1323272046 None] Volume 3c9fe106-7525-49da-9ba9-6b2bb78ddb19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c9fe106-7525-49da-9ba9-6b2bb78ddb19', 'volume_size': 1} Aug 26 14:34:10 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-bb3089d4-bdf5-47d1-8e4d-6dd87e2adcae tempest-TestInstancesWithCinderVolumes-1323272046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:34:11 devstack sudo[108395]: pam_unix(sudo:session): session closed for user root Aug 26 14:34:11 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-1293e311-03f9-4646-854b-198aee82b1e7 tempest-TestInstancesWithCinderVolumes-1323272046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-66ce87d3-338e-48f9-843f-fe55e4d24e3c 1073741824" returned: 0 in 0.729s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:34:11 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-1293e311-03f9-4646-854b-198aee82b1e7 tempest-TestInstancesWithCinderVolumes-1323272046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-66ce87d3-338e-48f9-843f-fe55e4d24e3c {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:34:11 devstack sudo[108402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-66ce87d3-338e-48f9-843f-fe55e4d24e3c Aug 26 14:34:11 devstack sudo[108402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:34:11 devstack sudo[108402]: pam_unix(sudo:session): session closed for user root Aug 26 14:34:11 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-1293e311-03f9-4646-854b-198aee82b1e7 tempest-TestInstancesWithCinderVolumes-1323272046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-66ce87d3-338e-48f9-843f-fe55e4d24e3c" returned: 0 in 0.399s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:34:11 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-1293e311-03f9-4646-854b-198aee82b1e7 tempest-TestInstancesWithCinderVolumes-1323272046 None] <== create_volume: return (1193ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:34:11 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-1293e311-03f9-4646-854b-198aee82b1e7 tempest-TestInstancesWithCinderVolumes-1323272046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.196s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:34:11 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-bb3089d4-bdf5-47d1-8e4d-6dd87e2adcae tempest-TestInstancesWithCinderVolumes-1323272046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.672s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:34:11 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-bb3089d4-bdf5-47d1-8e4d-6dd87e2adcae tempest-TestInstancesWithCinderVolumes-1323272046 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:34:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-605616151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c9fe106-7525-49da-9ba9-6b2bb78ddb19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='743edc005b1441c49743742ee2697e4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:34:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:34:11Z,use_quota=True,user_id='4e24be3a172c4ecc984f442014758496',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a85ad6a-b8cc-4c6e-9f87-d8b040d0b6c9),volume_type_id=7a85ad6a-b8cc-4c6e-9f87-d8b040d0b6c9)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:34:11 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-bb3089d4-bdf5-47d1-8e4d-6dd87e2adcae tempest-TestInstancesWithCinderVolumes-1323272046 None] Creating volume 3c9fe106-7525-49da-9ba9-6b2bb78ddb19 {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:34:11 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-bb3089d4-bdf5-47d1-8e4d-6dd87e2adcae tempest-TestInstancesWithCinderVolumes-1323272046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:34:11 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-bb3089d4-bdf5-47d1-8e4d-6dd87e2adcae tempest-TestInstancesWithCinderVolumes-1323272046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:34:11 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-bb3089d4-bdf5-47d1-8e4d-6dd87e2adcae tempest-TestInstancesWithCinderVolumes-1323272046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:34:11 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-bb3089d4-bdf5-47d1-8e4d-6dd87e2adcae tempest-TestInstancesWithCinderVolumes-1323272046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:34:11 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-bb3089d4-bdf5-47d1-8e4d-6dd87e2adcae tempest-TestInstancesWithCinderVolumes-1323272046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:34:11 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-bb3089d4-bdf5-47d1-8e4d-6dd87e2adcae tempest-TestInstancesWithCinderVolumes-1323272046 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:34:11 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-bb3089d4-bdf5-47d1-8e4d-6dd87e2adcae tempest-TestInstancesWithCinderVolumes-1323272046 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:34:11 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-bb3089d4-bdf5-47d1-8e4d-6dd87e2adcae tempest-TestInstancesWithCinderVolumes-1323272046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3c9fe106-7525-49da-9ba9-6b2bb78ddb19 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:34:11 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-1293e311-03f9-4646-854b-198aee82b1e7 tempest-TestInstancesWithCinderVolumes-1323272046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3212230-15c0-492c-a12d-d100b84f5eff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66ce87d3-338e-48f9-843f-fe55e4d24e3c', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:34:11 devstack sudo[108405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3c9fe106-7525-49da-9ba9-6b2bb78ddb19 1073741824 Aug 26 14:34:11 devstack sudo[108405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:34:11 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-1293e311-03f9-4646-854b-198aee82b1e7 tempest-TestInstancesWithCinderVolumes-1323272046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad64c9ed-425a-43c6-b1ee-67252e131e94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:34:11 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-1293e311-03f9-4646-854b-198aee82b1e7 tempest-TestInstancesWithCinderVolumes-1323272046 None] Volume volume-66ce87d3-338e-48f9-843f-fe55e4d24e3c (66ce87d3-338e-48f9-843f-fe55e4d24e3c): created successfully Aug 26 14:34:11 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-1293e311-03f9-4646-854b-198aee82b1e7 tempest-TestInstancesWithCinderVolumes-1323272046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad64c9ed-425a-43c6-b1ee-67252e131e94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:34:11 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-1293e311-03f9-4646-854b-198aee82b1e7 tempest-TestInstancesWithCinderVolumes-1323272046 None] Flow 'volume_create_manager' (9dc98bff-e719-4057-b2e4-8cdd4d15d856) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:34:11 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-1293e311-03f9-4646-854b-198aee82b1e7 tempest-TestInstancesWithCinderVolumes-1323272046 None] Created volume successfully. Aug 26 14:34:11 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5c662ba-c44e-4c24-a32e-733cb0ed2266 tempest-TestInstancesWithCinderVolumes-1323272046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:34:11 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-c5c662ba-c44e-4c24-a32e-733cb0ed2266 tempest-TestInstancesWithCinderVolumes-1323272046 None] Flow 'volume_create_manager' (efaed9aa-2213-488a-9c1e-5c0f5f78e21d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:34:11 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-c5c662ba-c44e-4c24-a32e-733cb0ed2266 tempest-TestInstancesWithCinderVolumes-1323272046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e1af95a-7f2b-4665-85a1-a340a04e1442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:34:12 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-c5c662ba-c44e-4c24-a32e-733cb0ed2266 tempest-TestInstancesWithCinderVolumes-1323272046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e1af95a-7f2b-4665-85a1-a340a04e1442) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:34:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-933228948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3327fcec-61cf-41e8-a232-406225c2640b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='743edc005b1441c49743742ee2697e4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:34:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:34:12Z,use_quota=True,user_id='4e24be3a172c4ecc984f442014758496',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9f35cab9-166e-4185-8e2f-9076a8558d01),volume_type_id=9f35cab9-166e-4185-8e2f-9076a8558d01)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:34:12 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-c5c662ba-c44e-4c24-a32e-733cb0ed2266 tempest-TestInstancesWithCinderVolumes-1323272046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59ec3852-4594-473e-b867-0f3e914e0cbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:34:12 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-c5c662ba-c44e-4c24-a32e-733cb0ed2266 tempest-TestInstancesWithCinderVolumes-1323272046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59ec3852-4594-473e-b867-0f3e914e0cbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:34:12 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-c5c662ba-c44e-4c24-a32e-733cb0ed2266 tempest-TestInstancesWithCinderVolumes-1323272046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09e72619-7650-46d8-90ec-1651b5fd591e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:34:12 devstack cinder-volume[94394]: DEBUG cinder.image.glance [None req-c5c662ba-c44e-4c24-a32e-733cb0ed2266 tempest-TestInstancesWithCinderVolumes-1323272046 None] Creating Keystone auth plugin from conf {{(pid=94394) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 26 14:34:12 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-c5c662ba-c44e-4c24-a32e-733cb0ed2266 tempest-TestInstancesWithCinderVolumes-1323272046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09e72619-7650-46d8-90ec-1651b5fd591e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3327fcec-61cf-41e8-a232-406225c2640b', 'volume_name': 'volume-3327fcec-61cf-41e8-a232-406225c2640b', 'volume_size': 1, 'image_id': 'f1bec7d0-6326-4ed2-add2-21016ed2dce8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f1bec7d0-6326-4ed2-add2-21016ed2dce8', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1249375358', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '743edc005b1441c49743742ee2697e4a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f1bec7d0-6326-4ed2-add2-21016ed2dce8', 'created_at': datetime.datetime(2026, 8, 26, 12, 34, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 12, 34, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f1bec7d0-6326-4ed2-add2-21016ed2dce8/file', 'properties': {}}, 'image_service': }' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:34:12 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-c5c662ba-c44e-4c24-a32e-733cb0ed2266 tempest-TestInstancesWithCinderVolumes-1323272046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa49f4af-8531-4d54-9fa5-1367183762c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:34:12 devstack sudo[108405]: pam_unix(sudo:session): session closed for user root Aug 26 14:34:12 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-c5c662ba-c44e-4c24-a32e-733cb0ed2266 tempest-TestInstancesWithCinderVolumes-1323272046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa49f4af-8531-4d54-9fa5-1367183762c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:34:12 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-c5c662ba-c44e-4c24-a32e-733cb0ed2266 tempest-TestInstancesWithCinderVolumes-1323272046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5c9171a-824b-498b-819b-28ecc9654f2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:34:12 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-c5c662ba-c44e-4c24-a32e-733cb0ed2266 tempest-TestInstancesWithCinderVolumes-1323272046 None] Volume 3327fcec-61cf-41e8-a232-406225c2640b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3327fcec-61cf-41e8-a232-406225c2640b', 'volume_size': 1, 'image_id': 'f1bec7d0-6326-4ed2-add2-21016ed2dce8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f1bec7d0-6326-4ed2-add2-21016ed2dce8', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1249375358', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '743edc005b1441c49743742ee2697e4a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f1bec7d0-6326-4ed2-add2-21016ed2dce8', 'created_at': datetime.datetime(2026, 8, 26, 12, 34, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 12, 34, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f1bec7d0-6326-4ed2-add2-21016ed2dce8/file', 'properties': {}}, 'image_service': } Aug 26 14:34:12 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5c662ba-c44e-4c24-a32e-733cb0ed2266 tempest-TestInstancesWithCinderVolumes-1323272046 None] Trying to clone 3327fcec-61cf-41e8-a232-406225c2640b from image f1bec7d0-6326-4ed2-add2-21016ed2dce8 at location (None, [{'url': 'file:///opt/stack/data/glance/images/f1bec7d0-6326-4ed2-add2-21016ed2dce8', 'metadata': {}}]). {{(pid=94394) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 26 14:34:12 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-bb3089d4-bdf5-47d1-8e4d-6dd87e2adcae tempest-TestInstancesWithCinderVolumes-1323272046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3c9fe106-7525-49da-9ba9-6b2bb78ddb19 1073741824" returned: 0 in 0.679s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:34:12 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-bb3089d4-bdf5-47d1-8e4d-6dd87e2adcae tempest-TestInstancesWithCinderVolumes-1323272046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3c9fe106-7525-49da-9ba9-6b2bb78ddb19 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:34:12 devstack sudo[108412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3c9fe106-7525-49da-9ba9-6b2bb78ddb19 Aug 26 14:34:12 devstack sudo[108412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:34:12 devstack sudo[108412]: pam_unix(sudo:session): session closed for user root Aug 26 14:34:12 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-bb3089d4-bdf5-47d1-8e4d-6dd87e2adcae tempest-TestInstancesWithCinderVolumes-1323272046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3c9fe106-7525-49da-9ba9-6b2bb78ddb19" returned: 0 in 0.340s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:34:12 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-bb3089d4-bdf5-47d1-8e4d-6dd87e2adcae tempest-TestInstancesWithCinderVolumes-1323272046 None] <== create_volume: return (1089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:34:12 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-bb3089d4-bdf5-47d1-8e4d-6dd87e2adcae tempest-TestInstancesWithCinderVolumes-1323272046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.096s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:34:12 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-bb3089d4-bdf5-47d1-8e4d-6dd87e2adcae tempest-TestInstancesWithCinderVolumes-1323272046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (638da85e-940d-44a2-b89a-bafd3de82267) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c9fe106-7525-49da-9ba9-6b2bb78ddb19', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:34:12 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-bb3089d4-bdf5-47d1-8e4d-6dd87e2adcae tempest-TestInstancesWithCinderVolumes-1323272046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e99b18a-7b38-4f81-a24d-3a2e6cc06940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:34:12 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-bb3089d4-bdf5-47d1-8e4d-6dd87e2adcae tempest-TestInstancesWithCinderVolumes-1323272046 None] Volume volume-3c9fe106-7525-49da-9ba9-6b2bb78ddb19 (3c9fe106-7525-49da-9ba9-6b2bb78ddb19): created successfully Aug 26 14:34:12 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-bb3089d4-bdf5-47d1-8e4d-6dd87e2adcae tempest-TestInstancesWithCinderVolumes-1323272046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e99b18a-7b38-4f81-a24d-3a2e6cc06940) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:34:12 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-bb3089d4-bdf5-47d1-8e4d-6dd87e2adcae tempest-TestInstancesWithCinderVolumes-1323272046 None] Flow 'volume_create_manager' (82e1f516-51ff-4889-ad7e-a1b65435fdc0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:34:12 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-bb3089d4-bdf5-47d1-8e4d-6dd87e2adcae tempest-TestInstancesWithCinderVolumes-1323272046 None] Created volume successfully. Aug 26 14:34:16 devstack cinder-volume[94394]: DEBUG cinder.image.image_utils [None req-c5c662ba-c44e-4c24-a32e-733cb0ed2266 tempest-TestInstancesWithCinderVolumes-1323272046 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f1bec7d0-6326-4ed2-add2-21016ed2dce8_y51s_xqydevstack@QuobyteHD, size 20.69 MB, duration 4.04 sec {{(pid=94394) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 26 14:34:16 devstack cinder-volume[94394]: INFO cinder.image.image_utils [None req-c5c662ba-c44e-4c24-a32e-733cb0ed2266 tempest-TestInstancesWithCinderVolumes-1323272046 None] Image download 20.69 MB at 5.12 MB/s Aug 26 14:34:16 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[128a4996-8970-47a1-b2bc-cf1001a8eea9]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:34:16 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-c5c662ba-c44e-4c24-a32e-733cb0ed2266 tempest-TestInstancesWithCinderVolumes-1323272046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f1bec7d0-6326-4ed2-add2-21016ed2dce8_y51s_xqydevstack@QuobyteHD {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:34:16 devstack sudo[108417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f1bec7d0-6326-4ed2-add2-21016ed2dce8_y51s_xqydevstack@QuobyteHD Aug 26 14:34:16 devstack sudo[108417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:34:16 devstack sudo[108417]: pam_unix(sudo:session): session closed for user root Aug 26 14:34:16 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-c5c662ba-c44e-4c24-a32e-733cb0ed2266 tempest-TestInstancesWithCinderVolumes-1323272046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f1bec7d0-6326-4ed2-add2-21016ed2dce8_y51s_xqydevstack@QuobyteHD" returned: 0 in 0.385s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:34:16 devstack cinder-volume[94394]: DEBUG cinder.image.image_utils [None req-c5c662ba-c44e-4c24-a32e-733cb0ed2266 tempest-TestInstancesWithCinderVolumes-1323272046 None] Temporary image f1bec7d0-6326-4ed2-add2-21016ed2dce8 is fetched for user 4e24be3a172c4ecc984f442014758496. {{(pid=94394) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 26 14:34:16 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[654800ea-0a2c-47bd-abee-3c1de6766e87]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:34:16 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-c5c662ba-c44e-4c24-a32e-733cb0ed2266 tempest-TestInstancesWithCinderVolumes-1323272046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f1bec7d0-6326-4ed2-add2-21016ed2dce8_y51s_xqydevstack@QuobyteHD {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:34:17 devstack sudo[108423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f1bec7d0-6326-4ed2-add2-21016ed2dce8_y51s_xqydevstack@QuobyteHD Aug 26 14:34:17 devstack sudo[108423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:34:17 devstack sudo[108423]: pam_unix(sudo:session): session closed for user root Aug 26 14:34:17 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-c5c662ba-c44e-4c24-a32e-733cb0ed2266 tempest-TestInstancesWithCinderVolumes-1323272046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f1bec7d0-6326-4ed2-add2-21016ed2dce8_y51s_xqydevstack@QuobyteHD" returned: 0 in 0.437s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:34:17 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-c5c662ba-c44e-4c24-a32e-733cb0ed2266 tempest-TestInstancesWithCinderVolumes-1323272046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:34:17 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-c5c662ba-c44e-4c24-a32e-733cb0ed2266 tempest-TestInstancesWithCinderVolumes-1323272046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:34:17 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-c5c662ba-c44e-4c24-a32e-733cb0ed2266 tempest-TestInstancesWithCinderVolumes-1323272046 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:34:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-933228948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3327fcec-61cf-41e8-a232-406225c2640b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='743edc005b1441c49743742ee2697e4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:34:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:34:12Z,use_quota=True,user_id='4e24be3a172c4ecc984f442014758496',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9f35cab9-166e-4185-8e2f-9076a8558d01),volume_type_id=9f35cab9-166e-4185-8e2f-9076a8558d01)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:34:17 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-c5c662ba-c44e-4c24-a32e-733cb0ed2266 tempest-TestInstancesWithCinderVolumes-1323272046 None] Creating volume 3327fcec-61cf-41e8-a232-406225c2640b {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:34:17 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-c5c662ba-c44e-4c24-a32e-733cb0ed2266 tempest-TestInstancesWithCinderVolumes-1323272046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:34:17 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-c5c662ba-c44e-4c24-a32e-733cb0ed2266 tempest-TestInstancesWithCinderVolumes-1323272046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:34:17 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-c5c662ba-c44e-4c24-a32e-733cb0ed2266 tempest-TestInstancesWithCinderVolumes-1323272046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:34:17 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-c5c662ba-c44e-4c24-a32e-733cb0ed2266 tempest-TestInstancesWithCinderVolumes-1323272046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:34:17 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-c5c662ba-c44e-4c24-a32e-733cb0ed2266 tempest-TestInstancesWithCinderVolumes-1323272046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:34:17 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-c5c662ba-c44e-4c24-a32e-733cb0ed2266 tempest-TestInstancesWithCinderVolumes-1323272046 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:34:17 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-c5c662ba-c44e-4c24-a32e-733cb0ed2266 tempest-TestInstancesWithCinderVolumes-1323272046 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:34:17 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-c5c662ba-c44e-4c24-a32e-733cb0ed2266 tempest-TestInstancesWithCinderVolumes-1323272046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3327fcec-61cf-41e8-a232-406225c2640b 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:34:17 devstack sudo[108429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3327fcec-61cf-41e8-a232-406225c2640b 1073741824 Aug 26 14:34:17 devstack sudo[108429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:34:18 devstack sudo[108429]: pam_unix(sudo:session): session closed for user root Aug 26 14:34:18 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-c5c662ba-c44e-4c24-a32e-733cb0ed2266 tempest-TestInstancesWithCinderVolumes-1323272046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3327fcec-61cf-41e8-a232-406225c2640b 1073741824" returned: 0 in 0.695s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:34:18 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-c5c662ba-c44e-4c24-a32e-733cb0ed2266 tempest-TestInstancesWithCinderVolumes-1323272046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3327fcec-61cf-41e8-a232-406225c2640b {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:34:18 devstack sudo[108434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3327fcec-61cf-41e8-a232-406225c2640b Aug 26 14:34:18 devstack sudo[108434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:34:18 devstack sudo[108434]: pam_unix(sudo:session): session closed for user root Aug 26 14:34:18 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-c5c662ba-c44e-4c24-a32e-733cb0ed2266 tempest-TestInstancesWithCinderVolumes-1323272046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3327fcec-61cf-41e8-a232-406225c2640b" returned: 0 in 0.331s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:34:18 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-c5c662ba-c44e-4c24-a32e-733cb0ed2266 tempest-TestInstancesWithCinderVolumes-1323272046 None] <== create_volume: return (1093ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:34:18 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-c5c662ba-c44e-4c24-a32e-733cb0ed2266 tempest-TestInstancesWithCinderVolumes-1323272046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.101s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:34:18 devstack cinder-volume[94394]: DEBUG cinder.volume.volume_utils [None req-c5c662ba-c44e-4c24-a32e-733cb0ed2266 tempest-TestInstancesWithCinderVolumes-1323272046 None] Attempting download of f1bec7d0-6326-4ed2-add2-21016ed2dce8 ((None, [{'url': 'file:///opt/stack/data/glance/images/f1bec7d0-6326-4ed2-add2-21016ed2dce8', 'metadata': {}}])) to volume 3327fcec-61cf-41e8-a232-406225c2640b. {{(pid=94394) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 26 14:34:18 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[7acee6b3-1ffe-4192-8281-0df15eb865e7]: (4, 'raw') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:34:18 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-c5c662ba-c44e-4c24-a32e-733cb0ed2266 tempest-TestInstancesWithCinderVolumes-1323272046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f1bec7d0-6326-4ed2-add2-21016ed2dce8_i_bgpmbg {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:34:18 devstack sudo[108438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f1bec7d0-6326-4ed2-add2-21016ed2dce8_i_bgpmbg Aug 26 14:34:18 devstack sudo[108438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:34:19 devstack sudo[108438]: pam_unix(sudo:session): session closed for user root Aug 26 14:34:19 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-c5c662ba-c44e-4c24-a32e-733cb0ed2266 tempest-TestInstancesWithCinderVolumes-1323272046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f1bec7d0-6326-4ed2-add2-21016ed2dce8_i_bgpmbg" returned: 0 in 0.504s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:34:19 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-c5c662ba-c44e-4c24-a32e-733cb0ed2266 tempest-TestInstancesWithCinderVolumes-1323272046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f1bec7d0-6326-4ed2-add2-21016ed2dce8_i_bgpmbg {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:34:19 devstack sudo[108452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f1bec7d0-6326-4ed2-add2-21016ed2dce8_i_bgpmbg Aug 26 14:34:19 devstack sudo[108452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:34:19 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-962f6c1f-d9d0-47d9-a635-39b97203211a tempest-VolumesSnapshotTestJSON-1776725678 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:34:19 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-962f6c1f-d9d0-47d9-a635-39b97203211a tempest-VolumesSnapshotTestJSON-1776725678 None] Flow 'volume_create_manager' (7be34dab-f9e7-4594-a078-791b07a84e39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:34:19 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-962f6c1f-d9d0-47d9-a635-39b97203211a tempest-VolumesSnapshotTestJSON-1776725678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c2ea503-14f7-4167-948a-abb2a0828eae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:34:19 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-962f6c1f-d9d0-47d9-a635-39b97203211a tempest-VolumesSnapshotTestJSON-1776725678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c2ea503-14f7-4167-948a-abb2a0828eae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:34:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1483010396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e956e503-1b64-4c95-8307-ab2ec29a69b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc1b419887b643c28cb952dc5c7fb2ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:34:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:34:20Z,use_quota=True,user_id='2966ecf31f2b4b26bb6de6eabe29590f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:34:19 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-962f6c1f-d9d0-47d9-a635-39b97203211a tempest-VolumesSnapshotTestJSON-1776725678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa73a55a-64f2-404b-add7-f90db6ce9953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:34:19 devstack sudo[108452]: pam_unix(sudo:session): session closed for user root Aug 26 14:34:19 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-962f6c1f-d9d0-47d9-a635-39b97203211a tempest-VolumesSnapshotTestJSON-1776725678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa73a55a-64f2-404b-add7-f90db6ce9953) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:34:19 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-962f6c1f-d9d0-47d9-a635-39b97203211a tempest-VolumesSnapshotTestJSON-1776725678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b93cddba-6ea6-4dff-b01d-07f92873d227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:34:19 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-962f6c1f-d9d0-47d9-a635-39b97203211a tempest-VolumesSnapshotTestJSON-1776725678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b93cddba-6ea6-4dff-b01d-07f92873d227) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e956e503-1b64-4c95-8307-ab2ec29a69b8', 'volume_name': 'volume-e956e503-1b64-4c95-8307-ab2ec29a69b8', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:34:19 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-962f6c1f-d9d0-47d9-a635-39b97203211a tempest-VolumesSnapshotTestJSON-1776725678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d26228f-3bb2-43bb-b596-3d1a6631fb08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:34:19 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-962f6c1f-d9d0-47d9-a635-39b97203211a tempest-VolumesSnapshotTestJSON-1776725678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d26228f-3bb2-43bb-b596-3d1a6631fb08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:34:19 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-962f6c1f-d9d0-47d9-a635-39b97203211a tempest-VolumesSnapshotTestJSON-1776725678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0d369c8-5506-4e29-9563-657b36c6bb08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:34:19 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-962f6c1f-d9d0-47d9-a635-39b97203211a tempest-VolumesSnapshotTestJSON-1776725678 None] Volume e956e503-1b64-4c95-8307-ab2ec29a69b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e956e503-1b64-4c95-8307-ab2ec29a69b8', 'volume_size': 1} Aug 26 14:34:19 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-962f6c1f-d9d0-47d9-a635-39b97203211a tempest-VolumesSnapshotTestJSON-1776725678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:34:19 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-962f6c1f-d9d0-47d9-a635-39b97203211a tempest-VolumesSnapshotTestJSON-1776725678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:34:19 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-962f6c1f-d9d0-47d9-a635-39b97203211a tempest-VolumesSnapshotTestJSON-1776725678 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:34:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1483010396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e956e503-1b64-4c95-8307-ab2ec29a69b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc1b419887b643c28cb952dc5c7fb2ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:34:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:34:20Z,use_quota=True,user_id='2966ecf31f2b4b26bb6de6eabe29590f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:34:19 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-962f6c1f-d9d0-47d9-a635-39b97203211a tempest-VolumesSnapshotTestJSON-1776725678 None] Creating volume e956e503-1b64-4c95-8307-ab2ec29a69b8 {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:34:19 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-962f6c1f-d9d0-47d9-a635-39b97203211a tempest-VolumesSnapshotTestJSON-1776725678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:34:19 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-962f6c1f-d9d0-47d9-a635-39b97203211a tempest-VolumesSnapshotTestJSON-1776725678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:34:19 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-962f6c1f-d9d0-47d9-a635-39b97203211a tempest-VolumesSnapshotTestJSON-1776725678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:34:19 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-962f6c1f-d9d0-47d9-a635-39b97203211a tempest-VolumesSnapshotTestJSON-1776725678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:34:19 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-962f6c1f-d9d0-47d9-a635-39b97203211a tempest-VolumesSnapshotTestJSON-1776725678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:34:19 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-962f6c1f-d9d0-47d9-a635-39b97203211a tempest-VolumesSnapshotTestJSON-1776725678 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:34:19 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-962f6c1f-d9d0-47d9-a635-39b97203211a tempest-VolumesSnapshotTestJSON-1776725678 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:34:19 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-962f6c1f-d9d0-47d9-a635-39b97203211a tempest-VolumesSnapshotTestJSON-1776725678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-e956e503-1b64-4c95-8307-ab2ec29a69b8 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:34:19 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-c5c662ba-c44e-4c24-a32e-733cb0ed2266 tempest-TestInstancesWithCinderVolumes-1323272046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f1bec7d0-6326-4ed2-add2-21016ed2dce8_i_bgpmbg" returned: 1 in 0.857s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:34:19 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-c5c662ba-c44e-4c24-a32e-733cb0ed2266 tempest-TestInstancesWithCinderVolumes-1323272046 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f1bec7d0-6326-4ed2-add2-21016ed2dce8_i_bgpmbg' failed. Not Retrying. {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 14:34:19 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[eae67791-5c41-4c05-8201-8a06a7bd4b05]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:34:19 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-c5c662ba-c44e-4c24-a32e-733cb0ed2266 tempest-TestInstancesWithCinderVolumes-1323272046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f1bec7d0-6326-4ed2-add2-21016ed2dce8_y51s_xqydevstack@QuobyteHD {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:34:19 devstack sudo[108467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-e956e503-1b64-4c95-8307-ab2ec29a69b8 1073741824 Aug 26 14:34:19 devstack sudo[108467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:34:19 devstack cinder-volume[94394]: INFO cinder.volume.manager [req-c32a39c1-3c53-445e-8ee0-1a9affa68ecb req-36e63e98-dbf7-4b9e-a087-362453c94946 tempest-TestShelveInstance-576226965 None] Terminate volume connection completed successfully. Aug 26 14:34:20 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [req-c32a39c1-3c53-445e-8ee0-1a9affa68ecb req-36e63e98-dbf7-4b9e-a087-362453c94946 tempest-TestShelveInstance-576226965 None] Deleting attachment 65b02d95-8e3b-4363-b433-4b511ab94dcf. {{(pid=94394) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 14:34:20 devstack sudo[108469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f1bec7d0-6326-4ed2-add2-21016ed2dce8_y51s_xqydevstack@QuobyteHD Aug 26 14:34:20 devstack sudo[108469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:34:20 devstack sudo[108469]: pam_unix(sudo:session): session closed for user root Aug 26 14:34:20 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-c5c662ba-c44e-4c24-a32e-733cb0ed2266 tempest-TestInstancesWithCinderVolumes-1323272046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f1bec7d0-6326-4ed2-add2-21016ed2dce8_y51s_xqydevstack@QuobyteHD" returned: 0 in 0.495s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:34:20 devstack cinder-volume[94394]: DEBUG cinder.image.image_utils [None req-c5c662ba-c44e-4c24-a32e-733cb0ed2266 tempest-TestInstancesWithCinderVolumes-1323272046 None] f1bec7d0-6326-4ed2-add2-21016ed2dce8 was qcow2, converting to qcow2 {{(pid=94394) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 26 14:34:20 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-c5c662ba-c44e-4c24-a32e-733cb0ed2266 tempest-TestInstancesWithCinderVolumes-1323272046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f1bec7d0-6326-4ed2-add2-21016ed2dce8_y51s_xqydevstack@QuobyteHD /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3327fcec-61cf-41e8-a232-406225c2640b {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:34:20 devstack sudo[108478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f1bec7d0-6326-4ed2-add2-21016ed2dce8_y51s_xqydevstack@QuobyteHD /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3327fcec-61cf-41e8-a232-406225c2640b Aug 26 14:34:20 devstack sudo[108478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:34:20 devstack sudo[108467]: pam_unix(sudo:session): session closed for user root Aug 26 14:34:20 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-962f6c1f-d9d0-47d9-a635-39b97203211a tempest-VolumesSnapshotTestJSON-1776725678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-e956e503-1b64-4c95-8307-ab2ec29a69b8 1073741824" returned: 0 in 0.686s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:34:20 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-962f6c1f-d9d0-47d9-a635-39b97203211a tempest-VolumesSnapshotTestJSON-1776725678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-e956e503-1b64-4c95-8307-ab2ec29a69b8 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:34:20 devstack sudo[108480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-e956e503-1b64-4c95-8307-ab2ec29a69b8 Aug 26 14:34:20 devstack sudo[108480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:34:20 devstack sudo[108480]: pam_unix(sudo:session): session closed for user root Aug 26 14:34:20 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-962f6c1f-d9d0-47d9-a635-39b97203211a tempest-VolumesSnapshotTestJSON-1776725678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-e956e503-1b64-4c95-8307-ab2ec29a69b8" returned: 0 in 0.292s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:34:20 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-962f6c1f-d9d0-47d9-a635-39b97203211a tempest-VolumesSnapshotTestJSON-1776725678 None] <== create_volume: return (1044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:34:20 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-962f6c1f-d9d0-47d9-a635-39b97203211a tempest-VolumesSnapshotTestJSON-1776725678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.047s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:34:20 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-962f6c1f-d9d0-47d9-a635-39b97203211a tempest-VolumesSnapshotTestJSON-1776725678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0d369c8-5506-4e29-9563-657b36c6bb08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e956e503-1b64-4c95-8307-ab2ec29a69b8', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:34:20 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-962f6c1f-d9d0-47d9-a635-39b97203211a tempest-VolumesSnapshotTestJSON-1776725678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a8ccc31-6545-44e1-b693-5cd3f3898f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:34:21 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-962f6c1f-d9d0-47d9-a635-39b97203211a tempest-VolumesSnapshotTestJSON-1776725678 None] Volume volume-e956e503-1b64-4c95-8307-ab2ec29a69b8 (e956e503-1b64-4c95-8307-ab2ec29a69b8): created successfully Aug 26 14:34:21 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-962f6c1f-d9d0-47d9-a635-39b97203211a tempest-VolumesSnapshotTestJSON-1776725678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a8ccc31-6545-44e1-b693-5cd3f3898f74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:34:21 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-962f6c1f-d9d0-47d9-a635-39b97203211a tempest-VolumesSnapshotTestJSON-1776725678 None] Flow 'volume_create_manager' (7be34dab-f9e7-4594-a078-791b07a84e39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:34:21 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-962f6c1f-d9d0-47d9-a635-39b97203211a tempest-VolumesSnapshotTestJSON-1776725678 None] Created volume successfully. Aug 26 14:34:22 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-1900ccd5-6ed7-4015-9d4c-296cbe507553 tempest-VolumesSnapshotTestJSON-1776725678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:34:22 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-1900ccd5-6ed7-4015-9d4c-296cbe507553 tempest-VolumesSnapshotTestJSON-1776725678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:34:22 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-1900ccd5-6ed7-4015-9d4c-296cbe507553 tempest-VolumesSnapshotTestJSON-1776725678 None] Creating offline snapshot 6bc633c5-ad5f-40c5-9a34-df82740e417f of volume e956e503-1b64-4c95-8307-ab2ec29a69b8 {{(pid=94394) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 14:34:22 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0f7348d-3ae8-435d-8926-4bbac750df00]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:34:22 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-1900ccd5-6ed7-4015-9d4c-296cbe507553 tempest-VolumesSnapshotTestJSON-1776725678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-e956e503-1b64-4c95-8307-ab2ec29a69b8 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:34:22 devstack sudo[108491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-e956e503-1b64-4c95-8307-ab2ec29a69b8 Aug 26 14:34:22 devstack sudo[108491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:34:22 devstack sudo[108491]: pam_unix(sudo:session): session closed for user root Aug 26 14:34:22 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-1900ccd5-6ed7-4015-9d4c-296cbe507553 tempest-VolumesSnapshotTestJSON-1776725678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-e956e503-1b64-4c95-8307-ab2ec29a69b8" returned: 0 in 0.538s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:34:22 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-1900ccd5-6ed7-4015-9d4c-296cbe507553 tempest-VolumesSnapshotTestJSON-1776725678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-e956e503-1b64-4c95-8307-ab2ec29a69b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-e956e503-1b64-4c95-8307-ab2ec29a69b8.6bc633c5-ad5f-40c5-9a34-df82740e417f 1G {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:34:22 devstack sudo[108498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-e956e503-1b64-4c95-8307-ab2ec29a69b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-e956e503-1b64-4c95-8307-ab2ec29a69b8.6bc633c5-ad5f-40c5-9a34-df82740e417f 1G Aug 26 14:34:22 devstack sudo[108498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:34:22 devstack sudo[108478]: pam_unix(sudo:session): session closed for user root Aug 26 14:34:22 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-c5c662ba-c44e-4c24-a32e-733cb0ed2266 tempest-TestInstancesWithCinderVolumes-1323272046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f1bec7d0-6326-4ed2-add2-21016ed2dce8_y51s_xqydevstack@QuobyteHD /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3327fcec-61cf-41e8-a232-406225c2640b" returned: 0 in 2.387s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:34:22 devstack cinder-volume[94394]: DEBUG cinder.image.image_utils [None req-c5c662ba-c44e-4c24-a32e-733cb0ed2266 tempest-TestInstancesWithCinderVolumes-1323272046 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f1bec7d0-6326-4ed2-add2-21016ed2dce8_y51s_xqydevstack@QuobyteHD, size 112.00 MB, duration 2.39 sec, destination /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3327fcec-61cf-41e8-a232-406225c2640b {{(pid=94394) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 14:34:22 devstack cinder-volume[94394]: INFO cinder.image.image_utils [None req-c5c662ba-c44e-4c24-a32e-733cb0ed2266 tempest-TestInstancesWithCinderVolumes-1323272046 None] Converted 112.00 MB image at 46.88 MB/s Aug 26 14:34:22 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-c5c662ba-c44e-4c24-a32e-733cb0ed2266 tempest-TestInstancesWithCinderVolumes-1323272046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3327fcec-61cf-41e8-a232-406225c2640b 1G {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:34:22 devstack sudo[108500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3327fcec-61cf-41e8-a232-406225c2640b 1G Aug 26 14:34:22 devstack sudo[108500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:34:23 devstack sudo[108498]: pam_unix(sudo:session): session closed for user root Aug 26 14:34:23 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-1900ccd5-6ed7-4015-9d4c-296cbe507553 tempest-VolumesSnapshotTestJSON-1776725678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-e956e503-1b64-4c95-8307-ab2ec29a69b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-e956e503-1b64-4c95-8307-ab2ec29a69b8.6bc633c5-ad5f-40c5-9a34-df82740e417f 1G" returned: 0 in 0.528s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:34:23 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-1900ccd5-6ed7-4015-9d4c-296cbe507553 tempest-VolumesSnapshotTestJSON-1776725678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e956e503-1b64-4c95-8307-ab2ec29a69b8 -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-e956e503-1b64-4c95-8307-ab2ec29a69b8.6bc633c5-ad5f-40c5-9a34-df82740e417f {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:34:23 devstack sudo[108510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e956e503-1b64-4c95-8307-ab2ec29a69b8 -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-e956e503-1b64-4c95-8307-ab2ec29a69b8.6bc633c5-ad5f-40c5-9a34-df82740e417f Aug 26 14:34:23 devstack sudo[108510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:34:23 devstack sudo[108500]: pam_unix(sudo:session): session closed for user root Aug 26 14:34:23 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-c5c662ba-c44e-4c24-a32e-733cb0ed2266 tempest-TestInstancesWithCinderVolumes-1323272046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3327fcec-61cf-41e8-a232-406225c2640b 1G" returned: 0 in 0.519s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:34:23 devstack cinder-volume[94394]: DEBUG cinder.volume.volume_utils [None req-c5c662ba-c44e-4c24-a32e-733cb0ed2266 tempest-TestInstancesWithCinderVolumes-1323272046 None] Downloaded image f1bec7d0-6326-4ed2-add2-21016ed2dce8 ((None, [{'url': 'file:///opt/stack/data/glance/images/f1bec7d0-6326-4ed2-add2-21016ed2dce8', 'metadata': {}}])) to volume 3327fcec-61cf-41e8-a232-406225c2640b successfully. {{(pid=94394) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 26 14:34:23 devstack cinder-volume[94394]: DEBUG cinder.image.image_utils [None req-c5c662ba-c44e-4c24-a32e-733cb0ed2266 tempest-TestInstancesWithCinderVolumes-1323272046 None] Temporary image f1bec7d0-6326-4ed2-add2-21016ed2dce8 for user 4e24be3a172c4ecc984f442014758496 is deleted. {{(pid=94394) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 26 14:34:23 devstack cinder-volume[94394]: DEBUG cinder.volume.volume_utils [None req-c5c662ba-c44e-4c24-a32e-733cb0ed2266 tempest-TestInstancesWithCinderVolumes-1323272046 None] Marking volume 3327fcec-61cf-41e8-a232-406225c2640b as bootable. {{(pid=94394) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 26 14:34:23 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5c662ba-c44e-4c24-a32e-733cb0ed2266 tempest-TestInstancesWithCinderVolumes-1323272046 None] Copying metadata from image f1bec7d0-6326-4ed2-add2-21016ed2dce8 to 3327fcec-61cf-41e8-a232-406225c2640b. {{(pid=94394) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 26 14:34:23 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5c662ba-c44e-4c24-a32e-733cb0ed2266 tempest-TestInstancesWithCinderVolumes-1323272046 None] Creating volume glance metadata for volume 3327fcec-61cf-41e8-a232-406225c2640b backed by image f1bec7d0-6326-4ed2-add2-21016ed2dce8 with: {'image_id': 'f1bec7d0-6326-4ed2-add2-21016ed2dce8', 'image_name': 'tempest-scenario-img--1249375358', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=94394) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 26 14:34:23 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-c5c662ba-c44e-4c24-a32e-733cb0ed2266 tempest-TestInstancesWithCinderVolumes-1323272046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5c9171a-824b-498b-819b-28ecc9654f2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3327fcec-61cf-41e8-a232-406225c2640b', 'volume_size': 1, 'image_id': 'f1bec7d0-6326-4ed2-add2-21016ed2dce8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f1bec7d0-6326-4ed2-add2-21016ed2dce8', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1249375358', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '743edc005b1441c49743742ee2697e4a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f1bec7d0-6326-4ed2-add2-21016ed2dce8', 'created_at': datetime.datetime(2026, 8, 26, 12, 34, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 12, 34, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f1bec7d0-6326-4ed2-add2-21016ed2dce8/file', 'properties': {}}, 'image_service': }' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:34:23 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-c5c662ba-c44e-4c24-a32e-733cb0ed2266 tempest-TestInstancesWithCinderVolumes-1323272046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e70d6ade-a615-4ff2-a352-1bb89a2b0e8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:34:23 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-c5c662ba-c44e-4c24-a32e-733cb0ed2266 tempest-TestInstancesWithCinderVolumes-1323272046 None] Volume volume-3327fcec-61cf-41e8-a232-406225c2640b (3327fcec-61cf-41e8-a232-406225c2640b): created successfully Aug 26 14:34:23 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-c5c662ba-c44e-4c24-a32e-733cb0ed2266 tempest-TestInstancesWithCinderVolumes-1323272046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e70d6ade-a615-4ff2-a352-1bb89a2b0e8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:34:23 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-c5c662ba-c44e-4c24-a32e-733cb0ed2266 tempest-TestInstancesWithCinderVolumes-1323272046 None] Flow 'volume_create_manager' (efaed9aa-2213-488a-9c1e-5c0f5f78e21d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:34:23 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-c5c662ba-c44e-4c24-a32e-733cb0ed2266 tempest-TestInstancesWithCinderVolumes-1323272046 None] Created volume successfully. Aug 26 14:34:23 devstack sudo[108510]: pam_unix(sudo:session): session closed for user root Aug 26 14:34:23 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-1900ccd5-6ed7-4015-9d4c-296cbe507553 tempest-VolumesSnapshotTestJSON-1776725678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e956e503-1b64-4c95-8307-ab2ec29a69b8 -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-e956e503-1b64-4c95-8307-ab2ec29a69b8.6bc633c5-ad5f-40c5-9a34-df82740e417f" returned: 0 in 0.365s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:34:23 devstack cinder-volume[94394]: WARNING cinder.volume.drivers.remotefs [None req-1900ccd5-6ed7-4015-9d4c-296cbe507553 tempest-VolumesSnapshotTestJSON-1776725678 None] /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-e956e503-1b64-4c95-8307-ab2ec29a69b8.6bc633c5-ad5f-40c5-9a34-df82740e417f is being set with open permissions: ugo+rw Aug 26 14:34:23 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-1900ccd5-6ed7-4015-9d4c-296cbe507553 tempest-VolumesSnapshotTestJSON-1776725678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-e956e503-1b64-4c95-8307-ab2ec29a69b8.6bc633c5-ad5f-40c5-9a34-df82740e417f {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:34:23 devstack sudo[108523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-e956e503-1b64-4c95-8307-ab2ec29a69b8.6bc633c5-ad5f-40c5-9a34-df82740e417f Aug 26 14:34:23 devstack sudo[108523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:34:23 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [req-ebc0ace3-30bc-4bc0-a7fa-f93c44edbbd5 req-52b06f1a-3816-4a5b-816e-7f142f9b7aea tempest-TestShelveInstance-576226965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:34:23 devstack sudo[108523]: pam_unix(sudo:session): session closed for user root Aug 26 14:34:23 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-1900ccd5-6ed7-4015-9d4c-296cbe507553 tempest-VolumesSnapshotTestJSON-1776725678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-e956e503-1b64-4c95-8307-ab2ec29a69b8.6bc633c5-ad5f-40c5-9a34-df82740e417f" returned: 0 in 0.313s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:34:24 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-1900ccd5-6ed7-4015-9d4c-296cbe507553 tempest-VolumesSnapshotTestJSON-1776725678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-e956e503-1b64-4c95-8307-ab2ec29a69b8.info {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:34:24 devstack sudo[108526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-e956e503-1b64-4c95-8307-ab2ec29a69b8.info Aug 26 14:34:24 devstack sudo[108526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:34:24 devstack sudo[108526]: pam_unix(sudo:session): session closed for user root Aug 26 14:34:24 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-1900ccd5-6ed7-4015-9d4c-296cbe507553 tempest-VolumesSnapshotTestJSON-1776725678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-e956e503-1b64-4c95-8307-ab2ec29a69b8.info" returned: 0 in 0.268s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:34:24 devstack cinder-volume[94394]: WARNING cinder.volume.drivers.remotefs [None req-1900ccd5-6ed7-4015-9d4c-296cbe507553 tempest-VolumesSnapshotTestJSON-1776725678 None] /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-e956e503-1b64-4c95-8307-ab2ec29a69b8.info is being set with open permissions: ugo+rw Aug 26 14:34:24 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-1900ccd5-6ed7-4015-9d4c-296cbe507553 tempest-VolumesSnapshotTestJSON-1776725678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-e956e503-1b64-4c95-8307-ab2ec29a69b8.info {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:34:24 devstack sudo[108529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-e956e503-1b64-4c95-8307-ab2ec29a69b8.info Aug 26 14:34:24 devstack sudo[108529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:34:24 devstack sudo[108529]: pam_unix(sudo:session): session closed for user root Aug 26 14:34:24 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-1900ccd5-6ed7-4015-9d4c-296cbe507553 tempest-VolumesSnapshotTestJSON-1776725678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-e956e503-1b64-4c95-8307-ab2ec29a69b8.info" returned: 0 in 0.273s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:34:24 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-1900ccd5-6ed7-4015-9d4c-296cbe507553 tempest-VolumesSnapshotTestJSON-1776725678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.383s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:34:24 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [req-ebc0ace3-30bc-4bc0-a7fa-f93c44edbbd5 req-52b06f1a-3816-4a5b-816e-7f142f9b7aea tempest-TestShelveInstance-576226965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.864s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:34:24 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [req-ebc0ace3-30bc-4bc0-a7fa-f93c44edbbd5 req-52b06f1a-3816-4a5b-816e-7f142f9b7aea tempest-TestShelveInstance-576226965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:34:24 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [req-ebc0ace3-30bc-4bc0-a7fa-f93c44edbbd5 req-52b06f1a-3816-4a5b-816e-7f142f9b7aea tempest-TestShelveInstance-576226965 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b', 'name': 'volume-3b7c1dab-36c9-4a0a-a516-ee8e96311a19', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6a3e025f-73fd-43e2-94d6-050cff749954', 'enforce_multipath': True} {{(pid=94394) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 14:34:24 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-1900ccd5-6ed7-4015-9d4c-296cbe507553 tempest-VolumesSnapshotTestJSON-1776725678 None] Create snapshot completed successfully Aug 26 14:34:24 devstack cinder-volume[94394]: INFO cinder.volume.manager [req-ebc0ace3-30bc-4bc0-a7fa-f93c44edbbd5 req-52b06f1a-3816-4a5b-816e-7f142f9b7aea tempest-TestShelveInstance-576226965 None] attachment_update completed successfully. Aug 26 14:34:25 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-30ffd098-cbb6-4f57-a0a3-9f469446ac8f tempest-VolumesSnapshotTestJSON-1776725678 None] Acquiring lock "cinder-6bc633c5-ad5f-40c5-9a34-df82740e417f-delete_snapshot" by "delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:34:25 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-30ffd098-cbb6-4f57-a0a3-9f469446ac8f tempest-VolumesSnapshotTestJSON-1776725678 None] Lock "cinder-6bc633c5-ad5f-40c5-9a34-df82740e417f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:34:25 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-30ffd098-cbb6-4f57-a0a3-9f469446ac8f tempest-VolumesSnapshotTestJSON-1776725678 None] Acquiring lock "cinder-quobyte-e956e503-1b64-4c95-8307-ab2ec29a69b8" by "delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:34:25 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-30ffd098-cbb6-4f57-a0a3-9f469446ac8f tempest-VolumesSnapshotTestJSON-1776725678 None] Lock "cinder-quobyte-e956e503-1b64-4c95-8307-ab2ec29a69b8" acquired by "delete_snapshot" :: waited 0.029s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:34:25 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-30ffd098-cbb6-4f57-a0a3-9f469446ac8f tempest-VolumesSnapshotTestJSON-1776725678 None] Acquiring lock "cinder-quobyte-6bc633c5-ad5f-40c5-9a34-df82740e417f" by "_delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:34:25 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-30ffd098-cbb6-4f57-a0a3-9f469446ac8f tempest-VolumesSnapshotTestJSON-1776725678 None] Lock "cinder-quobyte-6bc633c5-ad5f-40c5-9a34-df82740e417f" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:34:25 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-30ffd098-cbb6-4f57-a0a3-9f469446ac8f tempest-VolumesSnapshotTestJSON-1776725678 None] Deleting offline snapshot 6bc633c5-ad5f-40c5-9a34-df82740e417f of volume e956e503-1b64-4c95-8307-ab2ec29a69b8 {{(pid=94394) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 14:34:25 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-30ffd098-cbb6-4f57-a0a3-9f469446ac8f tempest-VolumesSnapshotTestJSON-1776725678 None] snapshot_file for this snap is: volume-e956e503-1b64-4c95-8307-ab2ec29a69b8.6bc633c5-ad5f-40c5-9a34-df82740e417f {{(pid=94394) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 14:34:25 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4ebf2b9-70dc-46bd-81f8-dca34aea3344]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:34:25 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-30ffd098-cbb6-4f57-a0a3-9f469446ac8f tempest-VolumesSnapshotTestJSON-1776725678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-e956e503-1b64-4c95-8307-ab2ec29a69b8.6bc633c5-ad5f-40c5-9a34-df82740e417f {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:34:26 devstack sudo[108535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-e956e503-1b64-4c95-8307-ab2ec29a69b8.6bc633c5-ad5f-40c5-9a34-df82740e417f Aug 26 14:34:26 devstack sudo[108535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:34:26 devstack sudo[108535]: pam_unix(sudo:session): session closed for user root Aug 26 14:34:26 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-30ffd098-cbb6-4f57-a0a3-9f469446ac8f tempest-VolumesSnapshotTestJSON-1776725678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-e956e503-1b64-4c95-8307-ab2ec29a69b8.6bc633c5-ad5f-40c5-9a34-df82740e417f" returned: 0 in 0.564s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:34:26 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-30ffd098-cbb6-4f57-a0a3-9f469446ac8f tempest-VolumesSnapshotTestJSON-1776725678 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e956e503-1b64-4c95-8307-ab2ec29a69b8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94394) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 14:34:26 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[4849a19b-6ab7-4f08-a3e9-055301931711]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:34:26 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-30ffd098-cbb6-4f57-a0a3-9f469446ac8f tempest-VolumesSnapshotTestJSON-1776725678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-e956e503-1b64-4c95-8307-ab2ec29a69b8 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:34:26 devstack sudo[108542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-e956e503-1b64-4c95-8307-ab2ec29a69b8 Aug 26 14:34:26 devstack sudo[108542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:34:26 devstack sudo[108542]: pam_unix(sudo:session): session closed for user root Aug 26 14:34:26 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-30ffd098-cbb6-4f57-a0a3-9f469446ac8f tempest-VolumesSnapshotTestJSON-1776725678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-e956e503-1b64-4c95-8307-ab2ec29a69b8" returned: 0 in 0.470s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:34:26 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-30ffd098-cbb6-4f57-a0a3-9f469446ac8f tempest-VolumesSnapshotTestJSON-1776725678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-e956e503-1b64-4c95-8307-ab2ec29a69b8.6bc633c5-ad5f-40c5-9a34-df82740e417f {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:34:26 devstack sudo[108548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-e956e503-1b64-4c95-8307-ab2ec29a69b8.6bc633c5-ad5f-40c5-9a34-df82740e417f Aug 26 14:34:26 devstack sudo[108548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:34:27 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [req-af873361-2d61-4fff-91a8-cf8c86ad07d2 req-33b28088-2cad-444f-aac7-16ff3ef01530 tempest-TestInstancesWithCinderVolumes-1323272046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:34:27 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [req-af873361-2d61-4fff-91a8-cf8c86ad07d2 req-33b28088-2cad-444f-aac7-16ff3ef01530 tempest-TestInstancesWithCinderVolumes-1323272046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:34:27 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [req-af873361-2d61-4fff-91a8-cf8c86ad07d2 req-33b28088-2cad-444f-aac7-16ff3ef01530 tempest-TestInstancesWithCinderVolumes-1323272046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:34:27 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [req-af873361-2d61-4fff-91a8-cf8c86ad07d2 req-33b28088-2cad-444f-aac7-16ff3ef01530 tempest-TestInstancesWithCinderVolumes-1323272046 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b', 'name': 'volume-3327fcec-61cf-41e8-a232-406225c2640b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1b43ff83-ef38-4600-859c-448c72e4deb1', 'enforce_multipath': True} {{(pid=94394) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 14:34:27 devstack cinder-volume[94394]: INFO cinder.volume.manager [req-af873361-2d61-4fff-91a8-cf8c86ad07d2 req-33b28088-2cad-444f-aac7-16ff3ef01530 tempest-TestInstancesWithCinderVolumes-1323272046 None] attachment_update completed successfully. Aug 26 14:34:27 devstack sudo[108548]: pam_unix(sudo:session): session closed for user root Aug 26 14:34:27 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-30ffd098-cbb6-4f57-a0a3-9f469446ac8f tempest-VolumesSnapshotTestJSON-1776725678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-e956e503-1b64-4c95-8307-ab2ec29a69b8.6bc633c5-ad5f-40c5-9a34-df82740e417f" returned: 0 in 0.513s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:34:27 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-30ffd098-cbb6-4f57-a0a3-9f469446ac8f tempest-VolumesSnapshotTestJSON-1776725678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-e956e503-1b64-4c95-8307-ab2ec29a69b8.6bc633c5-ad5f-40c5-9a34-df82740e417f {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:34:27 devstack sudo[108561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-e956e503-1b64-4c95-8307-ab2ec29a69b8.6bc633c5-ad5f-40c5-9a34-df82740e417f Aug 26 14:34:27 devstack sudo[108561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:34:27 devstack sudo[108561]: pam_unix(sudo:session): session closed for user root Aug 26 14:34:27 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-30ffd098-cbb6-4f57-a0a3-9f469446ac8f tempest-VolumesSnapshotTestJSON-1776725678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-e956e503-1b64-4c95-8307-ab2ec29a69b8.6bc633c5-ad5f-40c5-9a34-df82740e417f" returned: 0 in 0.337s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:34:27 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-30ffd098-cbb6-4f57-a0a3-9f469446ac8f tempest-VolumesSnapshotTestJSON-1776725678 None] Lock "cinder-quobyte-6bc633c5-ad5f-40c5-9a34-df82740e417f" released by "_delete_snapshot" :: held 2.053s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:34:27 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-30ffd098-cbb6-4f57-a0a3-9f469446ac8f tempest-VolumesSnapshotTestJSON-1776725678 None] Lock "cinder-quobyte-e956e503-1b64-4c95-8307-ab2ec29a69b8" released by "delete_snapshot" :: held 2.104s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:34:27 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-30ffd098-cbb6-4f57-a0a3-9f469446ac8f tempest-VolumesSnapshotTestJSON-1776725678 None] Created reservations ['dfd1909a-649c-4a2c-88a9-eb8765583fdf', '96db711f-4bfd-40bd-9770-d6b5c4df01f0', 'f87844c3-f028-44cf-845d-d4073ef7da1f', '1e9a8f2a-b84b-4520-9f29-8b478e15a63b'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:34:28 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-30ffd098-cbb6-4f57-a0a3-9f469446ac8f tempest-VolumesSnapshotTestJSON-1776725678 None] Delete snapshot completed successfully. Aug 26 14:34:28 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-30ffd098-cbb6-4f57-a0a3-9f469446ac8f tempest-VolumesSnapshotTestJSON-1776725678 None] Lock "cinder-6bc633c5-ad5f-40c5-9a34-df82740e417f-delete_snapshot" released by "delete_snapshot" :: held 2.367s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:34:29 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7a7f9ea-715f-4910-b2b0-c69b593fab39 tempest-VolumesSnapshotTestJSON-1776725678 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:34:29 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-a7a7f9ea-715f-4910-b2b0-c69b593fab39 tempest-VolumesSnapshotTestJSON-1776725678 None] Flow 'volume_create_manager' (36b1dcb4-9610-42bb-8cd5-e5b209b8f870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:34:29 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-a7a7f9ea-715f-4910-b2b0-c69b593fab39 tempest-VolumesSnapshotTestJSON-1776725678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16d0c9aa-cbe4-4aba-b3ad-dadcf67e1d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:34:29 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-a7a7f9ea-715f-4910-b2b0-c69b593fab39 tempest-VolumesSnapshotTestJSON-1776725678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16d0c9aa-cbe4-4aba-b3ad-dadcf67e1d76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:34:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1640643193',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f20111c-84f2-4df0-94af-a4f52409aeff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc1b419887b643c28cb952dc5c7fb2ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:34:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:34:30Z,use_quota=True,user_id='2966ecf31f2b4b26bb6de6eabe29590f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:34:29 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-a7a7f9ea-715f-4910-b2b0-c69b593fab39 tempest-VolumesSnapshotTestJSON-1776725678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd7966ce-b4b4-4057-86aa-1baa0a635ba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:34:29 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-a7a7f9ea-715f-4910-b2b0-c69b593fab39 tempest-VolumesSnapshotTestJSON-1776725678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd7966ce-b4b4-4057-86aa-1baa0a635ba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:34:29 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-a7a7f9ea-715f-4910-b2b0-c69b593fab39 tempest-VolumesSnapshotTestJSON-1776725678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb1b80a1-fc21-4038-a2b2-6ed7684488e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:34:29 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-a7a7f9ea-715f-4910-b2b0-c69b593fab39 tempest-VolumesSnapshotTestJSON-1776725678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb1b80a1-fc21-4038-a2b2-6ed7684488e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f20111c-84f2-4df0-94af-a4f52409aeff', 'volume_name': 'volume-0f20111c-84f2-4df0-94af-a4f52409aeff', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:34:29 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-a7a7f9ea-715f-4910-b2b0-c69b593fab39 tempest-VolumesSnapshotTestJSON-1776725678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cf7a454-57d6-4ce1-b5c3-7d923b6245cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:34:29 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-a7a7f9ea-715f-4910-b2b0-c69b593fab39 tempest-VolumesSnapshotTestJSON-1776725678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cf7a454-57d6-4ce1-b5c3-7d923b6245cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:34:29 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-a7a7f9ea-715f-4910-b2b0-c69b593fab39 tempest-VolumesSnapshotTestJSON-1776725678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81b36d0b-c93b-41fb-a946-a02b0fb735cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:34:29 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-a7a7f9ea-715f-4910-b2b0-c69b593fab39 tempest-VolumesSnapshotTestJSON-1776725678 None] Volume 0f20111c-84f2-4df0-94af-a4f52409aeff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f20111c-84f2-4df0-94af-a4f52409aeff', 'volume_size': 1} Aug 26 14:34:29 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-a7a7f9ea-715f-4910-b2b0-c69b593fab39 tempest-VolumesSnapshotTestJSON-1776725678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:34:29 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-a7a7f9ea-715f-4910-b2b0-c69b593fab39 tempest-VolumesSnapshotTestJSON-1776725678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:34:29 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-a7a7f9ea-715f-4910-b2b0-c69b593fab39 tempest-VolumesSnapshotTestJSON-1776725678 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:34:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1640643193',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f20111c-84f2-4df0-94af-a4f52409aeff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc1b419887b643c28cb952dc5c7fb2ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:34:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:34:30Z,use_quota=True,user_id='2966ecf31f2b4b26bb6de6eabe29590f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:34:29 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-a7a7f9ea-715f-4910-b2b0-c69b593fab39 tempest-VolumesSnapshotTestJSON-1776725678 None] Creating volume 0f20111c-84f2-4df0-94af-a4f52409aeff {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:34:29 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-a7a7f9ea-715f-4910-b2b0-c69b593fab39 tempest-VolumesSnapshotTestJSON-1776725678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:34:29 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-a7a7f9ea-715f-4910-b2b0-c69b593fab39 tempest-VolumesSnapshotTestJSON-1776725678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:34:29 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-a7a7f9ea-715f-4910-b2b0-c69b593fab39 tempest-VolumesSnapshotTestJSON-1776725678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:34:29 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-a7a7f9ea-715f-4910-b2b0-c69b593fab39 tempest-VolumesSnapshotTestJSON-1776725678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:34:29 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-a7a7f9ea-715f-4910-b2b0-c69b593fab39 tempest-VolumesSnapshotTestJSON-1776725678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:34:29 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-a7a7f9ea-715f-4910-b2b0-c69b593fab39 tempest-VolumesSnapshotTestJSON-1776725678 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:34:29 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-a7a7f9ea-715f-4910-b2b0-c69b593fab39 tempest-VolumesSnapshotTestJSON-1776725678 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:34:29 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-a7a7f9ea-715f-4910-b2b0-c69b593fab39 tempest-VolumesSnapshotTestJSON-1776725678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0f20111c-84f2-4df0-94af-a4f52409aeff 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:34:29 devstack sudo[108598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0f20111c-84f2-4df0-94af-a4f52409aeff 1073741824 Aug 26 14:34:29 devstack sudo[108598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:34:30 devstack sudo[108598]: pam_unix(sudo:session): session closed for user root Aug 26 14:34:30 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-a7a7f9ea-715f-4910-b2b0-c69b593fab39 tempest-VolumesSnapshotTestJSON-1776725678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0f20111c-84f2-4df0-94af-a4f52409aeff 1073741824" returned: 0 in 0.623s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:34:30 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-a7a7f9ea-715f-4910-b2b0-c69b593fab39 tempest-VolumesSnapshotTestJSON-1776725678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0f20111c-84f2-4df0-94af-a4f52409aeff {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:34:30 devstack sudo[108607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0f20111c-84f2-4df0-94af-a4f52409aeff Aug 26 14:34:30 devstack sudo[108607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:34:30 devstack sudo[108607]: pam_unix(sudo:session): session closed for user root Aug 26 14:34:30 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-a7a7f9ea-715f-4910-b2b0-c69b593fab39 tempest-VolumesSnapshotTestJSON-1776725678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0f20111c-84f2-4df0-94af-a4f52409aeff" returned: 0 in 0.322s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:34:30 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-a7a7f9ea-715f-4910-b2b0-c69b593fab39 tempest-VolumesSnapshotTestJSON-1776725678 None] <== create_volume: return (997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:34:30 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-a7a7f9ea-715f-4910-b2b0-c69b593fab39 tempest-VolumesSnapshotTestJSON-1776725678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.004s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:34:30 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-a7a7f9ea-715f-4910-b2b0-c69b593fab39 tempest-VolumesSnapshotTestJSON-1776725678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81b36d0b-c93b-41fb-a946-a02b0fb735cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f20111c-84f2-4df0-94af-a4f52409aeff', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:34:30 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-a7a7f9ea-715f-4910-b2b0-c69b593fab39 tempest-VolumesSnapshotTestJSON-1776725678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c2fc8c1-558d-49dd-b98f-dffe0c6184bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:34:30 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-a7a7f9ea-715f-4910-b2b0-c69b593fab39 tempest-VolumesSnapshotTestJSON-1776725678 None] Volume volume-0f20111c-84f2-4df0-94af-a4f52409aeff (0f20111c-84f2-4df0-94af-a4f52409aeff): created successfully Aug 26 14:34:30 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-a7a7f9ea-715f-4910-b2b0-c69b593fab39 tempest-VolumesSnapshotTestJSON-1776725678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c2fc8c1-558d-49dd-b98f-dffe0c6184bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:34:30 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-a7a7f9ea-715f-4910-b2b0-c69b593fab39 tempest-VolumesSnapshotTestJSON-1776725678 None] Flow 'volume_create_manager' (36b1dcb4-9610-42bb-8cd5-e5b209b8f870) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:34:30 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-a7a7f9ea-715f-4910-b2b0-c69b593fab39 tempest-VolumesSnapshotTestJSON-1776725678 None] Created volume successfully. Aug 26 14:34:32 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-36c05f5c-cd98-4652-95a5-1d8b787981a6 tempest-VolumesSnapshotTestJSON-1776725678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:34:32 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-36c05f5c-cd98-4652-95a5-1d8b787981a6 tempest-VolumesSnapshotTestJSON-1776725678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:34:32 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-36c05f5c-cd98-4652-95a5-1d8b787981a6 tempest-VolumesSnapshotTestJSON-1776725678 None] Creating offline snapshot e4e6efe3-f744-415b-a640-16c605a0de88 of volume 0f20111c-84f2-4df0-94af-a4f52409aeff {{(pid=94394) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 14:34:32 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4605bff-e343-4d8e-9e63-96f53b293164]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:34:32 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-36c05f5c-cd98-4652-95a5-1d8b787981a6 tempest-VolumesSnapshotTestJSON-1776725678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0f20111c-84f2-4df0-94af-a4f52409aeff {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:34:32 devstack sudo[109040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0f20111c-84f2-4df0-94af-a4f52409aeff Aug 26 14:34:32 devstack sudo[109040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:34:32 devstack sudo[109040]: pam_unix(sudo:session): session closed for user root Aug 26 14:34:32 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-36c05f5c-cd98-4652-95a5-1d8b787981a6 tempest-VolumesSnapshotTestJSON-1776725678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0f20111c-84f2-4df0-94af-a4f52409aeff" returned: 0 in 0.721s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:34:32 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-36c05f5c-cd98-4652-95a5-1d8b787981a6 tempest-VolumesSnapshotTestJSON-1776725678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0f20111c-84f2-4df0-94af-a4f52409aeff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0f20111c-84f2-4df0-94af-a4f52409aeff.e4e6efe3-f744-415b-a640-16c605a0de88 1G {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:34:33 devstack sudo[109073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0f20111c-84f2-4df0-94af-a4f52409aeff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0f20111c-84f2-4df0-94af-a4f52409aeff.e4e6efe3-f744-415b-a640-16c605a0de88 1G Aug 26 14:34:33 devstack sudo[109073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:34:33 devstack cinder-volume[94394]: DEBUG oslo_service.periodic_task [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94394) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 14:34:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:34:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:34:33 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:34:33 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:34:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:34:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:34:33 devstack sudo[109104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:34:33 devstack sudo[109104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:34:33 devstack sudo[109073]: pam_unix(sudo:session): session closed for user root Aug 26 14:34:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-36c05f5c-cd98-4652-95a5-1d8b787981a6 tempest-VolumesSnapshotTestJSON-1776725678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0f20111c-84f2-4df0-94af-a4f52409aeff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0f20111c-84f2-4df0-94af-a4f52409aeff.e4e6efe3-f744-415b-a640-16c605a0de88 1G" returned: 0 in 0.922s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:34:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-36c05f5c-cd98-4652-95a5-1d8b787981a6 tempest-VolumesSnapshotTestJSON-1776725678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f20111c-84f2-4df0-94af-a4f52409aeff -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0f20111c-84f2-4df0-94af-a4f52409aeff.e4e6efe3-f744-415b-a640-16c605a0de88 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:34:33 devstack sudo[109114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f20111c-84f2-4df0-94af-a4f52409aeff -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0f20111c-84f2-4df0-94af-a4f52409aeff.e4e6efe3-f744-415b-a640-16c605a0de88 Aug 26 14:34:33 devstack sudo[109114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:34:34 devstack sudo[109104]: pam_unix(sudo:session): session closed for user root Aug 26 14:34:34 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.615s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:34:34 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:34:34 devstack cinder-volume[94394]: DEBUG oslo_service.periodic_task [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Running periodic task VolumeManager._thread_info {{(pid=94394) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 14:34:34 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] thread count: 28 {{(pid=94394) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 14:34:34 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] thread info: [<_MainThread(MainThread, started 126600738033792)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94394) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 14:34:34 devstack sudo[109114]: pam_unix(sudo:session): session closed for user root Aug 26 14:34:34 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-36c05f5c-cd98-4652-95a5-1d8b787981a6 tempest-VolumesSnapshotTestJSON-1776725678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f20111c-84f2-4df0-94af-a4f52409aeff -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0f20111c-84f2-4df0-94af-a4f52409aeff.e4e6efe3-f744-415b-a640-16c605a0de88" returned: 0 in 0.421s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:34:34 devstack cinder-volume[94394]: WARNING cinder.volume.drivers.remotefs [None req-36c05f5c-cd98-4652-95a5-1d8b787981a6 tempest-VolumesSnapshotTestJSON-1776725678 None] /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0f20111c-84f2-4df0-94af-a4f52409aeff.e4e6efe3-f744-415b-a640-16c605a0de88 is being set with open permissions: ugo+rw Aug 26 14:34:34 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-36c05f5c-cd98-4652-95a5-1d8b787981a6 tempest-VolumesSnapshotTestJSON-1776725678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0f20111c-84f2-4df0-94af-a4f52409aeff.e4e6efe3-f744-415b-a640-16c605a0de88 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:34:34 devstack sudo[109131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0f20111c-84f2-4df0-94af-a4f52409aeff.e4e6efe3-f744-415b-a640-16c605a0de88 Aug 26 14:34:34 devstack sudo[109131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:34:34 devstack sudo[109131]: pam_unix(sudo:session): session closed for user root Aug 26 14:34:34 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-36c05f5c-cd98-4652-95a5-1d8b787981a6 tempest-VolumesSnapshotTestJSON-1776725678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0f20111c-84f2-4df0-94af-a4f52409aeff.e4e6efe3-f744-415b-a640-16c605a0de88" returned: 0 in 0.373s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:34:34 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-36c05f5c-cd98-4652-95a5-1d8b787981a6 tempest-VolumesSnapshotTestJSON-1776725678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0f20111c-84f2-4df0-94af-a4f52409aeff.info {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:34:34 devstack sudo[109144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0f20111c-84f2-4df0-94af-a4f52409aeff.info Aug 26 14:34:34 devstack sudo[109144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:34:35 devstack sudo[109144]: pam_unix(sudo:session): session closed for user root Aug 26 14:34:35 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-36c05f5c-cd98-4652-95a5-1d8b787981a6 tempest-VolumesSnapshotTestJSON-1776725678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0f20111c-84f2-4df0-94af-a4f52409aeff.info" returned: 0 in 0.387s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:34:35 devstack cinder-volume[94394]: WARNING cinder.volume.drivers.remotefs [None req-36c05f5c-cd98-4652-95a5-1d8b787981a6 tempest-VolumesSnapshotTestJSON-1776725678 None] /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0f20111c-84f2-4df0-94af-a4f52409aeff.info is being set with open permissions: ugo+rw Aug 26 14:34:35 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-36c05f5c-cd98-4652-95a5-1d8b787981a6 tempest-VolumesSnapshotTestJSON-1776725678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0f20111c-84f2-4df0-94af-a4f52409aeff.info {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:34:35 devstack sudo[109164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0f20111c-84f2-4df0-94af-a4f52409aeff.info Aug 26 14:34:35 devstack sudo[109164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:34:35 devstack sudo[109164]: pam_unix(sudo:session): session closed for user root Aug 26 14:34:35 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-36c05f5c-cd98-4652-95a5-1d8b787981a6 tempest-VolumesSnapshotTestJSON-1776725678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0f20111c-84f2-4df0-94af-a4f52409aeff.info" returned: 0 in 0.485s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:34:35 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-36c05f5c-cd98-4652-95a5-1d8b787981a6 tempest-VolumesSnapshotTestJSON-1776725678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.450s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:34:35 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-36c05f5c-cd98-4652-95a5-1d8b787981a6 tempest-VolumesSnapshotTestJSON-1776725678 None] Create snapshot completed successfully Aug 26 14:34:38 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5ab9b6f-e585-4d36-b0e8-97748ec3f6fb tempest-VolumesSnapshotTestJSON-1776725678 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:34:38 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-f5ab9b6f-e585-4d36-b0e8-97748ec3f6fb tempest-VolumesSnapshotTestJSON-1776725678 None] Flow 'volume_create_manager' (96b107d7-d055-4b05-9aac-b07c4547c51b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:34:38 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-f5ab9b6f-e585-4d36-b0e8-97748ec3f6fb tempest-VolumesSnapshotTestJSON-1776725678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e88345ec-0323-4de7-bf6b-a3f90097d64b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:34:38 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-f5ab9b6f-e585-4d36-b0e8-97748ec3f6fb tempest-VolumesSnapshotTestJSON-1776725678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e88345ec-0323-4de7-bf6b-a3f90097d64b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:34:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-295281718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f36f5a46-10f9-4047-87fb-e62c4df0ad51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc1b419887b643c28cb952dc5c7fb2ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:34:38Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=e4e6efe3-f744-415b-a640-16c605a0de88,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:34:38Z,use_quota=True,user_id='2966ecf31f2b4b26bb6de6eabe29590f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:34:38 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-f5ab9b6f-e585-4d36-b0e8-97748ec3f6fb tempest-VolumesSnapshotTestJSON-1776725678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c53d204f-7b3e-46d9-8301-455c8e0c4067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:34:38 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-f5ab9b6f-e585-4d36-b0e8-97748ec3f6fb tempest-VolumesSnapshotTestJSON-1776725678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c53d204f-7b3e-46d9-8301-455c8e0c4067) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:34:38 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-f5ab9b6f-e585-4d36-b0e8-97748ec3f6fb tempest-VolumesSnapshotTestJSON-1776725678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce7965f4-ab82-46bd-a733-6e11769d35e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:34:38 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-f5ab9b6f-e585-4d36-b0e8-97748ec3f6fb tempest-VolumesSnapshotTestJSON-1776725678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce7965f4-ab82-46bd-a733-6e11769d35e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f36f5a46-10f9-4047-87fb-e62c4df0ad51', 'volume_name': 'volume-f36f5a46-10f9-4047-87fb-e62c4df0ad51', 'volume_size': 2, 'snapshot_id': 'e4e6efe3-f744-415b-a640-16c605a0de88'}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:34:38 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-f5ab9b6f-e585-4d36-b0e8-97748ec3f6fb tempest-VolumesSnapshotTestJSON-1776725678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afb11101-9718-41f0-99f3-b404c4369892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:34:38 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-f5ab9b6f-e585-4d36-b0e8-97748ec3f6fb tempest-VolumesSnapshotTestJSON-1776725678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afb11101-9718-41f0-99f3-b404c4369892) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:34:38 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-f5ab9b6f-e585-4d36-b0e8-97748ec3f6fb tempest-VolumesSnapshotTestJSON-1776725678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e759d3e-262b-4599-b4fb-24ca7005805e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:34:38 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-f5ab9b6f-e585-4d36-b0e8-97748ec3f6fb tempest-VolumesSnapshotTestJSON-1776725678 None] Volume f36f5a46-10f9-4047-87fb-e62c4df0ad51: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f36f5a46-10f9-4047-87fb-e62c4df0ad51', 'volume_size': 2, 'snapshot_id': 'e4e6efe3-f744-415b-a640-16c605a0de88'} Aug 26 14:34:38 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-f5ab9b6f-e585-4d36-b0e8-97748ec3f6fb tempest-VolumesSnapshotTestJSON-1776725678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:34:38 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-f5ab9b6f-e585-4d36-b0e8-97748ec3f6fb tempest-VolumesSnapshotTestJSON-1776725678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:34:38 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-f5ab9b6f-e585-4d36-b0e8-97748ec3f6fb tempest-VolumesSnapshotTestJSON-1776725678 None] Acquiring lock "cinder-quobyte-e4e6efe3-f744-415b-a640-16c605a0de88-f36f5a46-10f9-4047-87fb-e62c4df0ad51" by "_create_volume_from_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:34:38 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-f5ab9b6f-e585-4d36-b0e8-97748ec3f6fb tempest-VolumesSnapshotTestJSON-1776725678 None] Lock "cinder-quobyte-e4e6efe3-f744-415b-a640-16c605a0de88-f36f5a46-10f9-4047-87fb-e62c4df0ad51" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:34:38 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-f5ab9b6f-e585-4d36-b0e8-97748ec3f6fb tempest-VolumesSnapshotTestJSON-1776725678 None] Creating volume f36f5a46-10f9-4047-87fb-e62c4df0ad51 from snapshot e4e6efe3-f744-415b-a640-16c605a0de88 {{(pid=94394) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Aug 26 14:34:38 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-f5ab9b6f-e585-4d36-b0e8-97748ec3f6fb tempest-VolumesSnapshotTestJSON-1776725678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:34:38 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-f5ab9b6f-e585-4d36-b0e8-97748ec3f6fb tempest-VolumesSnapshotTestJSON-1776725678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:34:38 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-f5ab9b6f-e585-4d36-b0e8-97748ec3f6fb tempest-VolumesSnapshotTestJSON-1776725678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:34:38 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-f5ab9b6f-e585-4d36-b0e8-97748ec3f6fb tempest-VolumesSnapshotTestJSON-1776725678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:34:38 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-f5ab9b6f-e585-4d36-b0e8-97748ec3f6fb tempest-VolumesSnapshotTestJSON-1776725678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:34:38 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-f5ab9b6f-e585-4d36-b0e8-97748ec3f6fb tempest-VolumesSnapshotTestJSON-1776725678 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:34:38 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-f5ab9b6f-e585-4d36-b0e8-97748ec3f6fb tempest-VolumesSnapshotTestJSON-1776725678 None] Acquiring lock "cinder-quobyte-f36f5a46-10f9-4047-87fb-e62c4df0ad51" by "_copy_volume_from_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:34:38 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-f5ab9b6f-e585-4d36-b0e8-97748ec3f6fb tempest-VolumesSnapshotTestJSON-1776725678 None] Lock "cinder-quobyte-f36f5a46-10f9-4047-87fb-e62c4df0ad51" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:34:38 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-f5ab9b6f-e585-4d36-b0e8-97748ec3f6fb tempest-VolumesSnapshotTestJSON-1776725678 None] snapshot: e4e6efe3-f744-415b-a640-16c605a0de88, volume: f36f5a46-10f9-4047-87fb-e62c4df0ad51, {{(pid=94394) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 26 14:34:38 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-f5ab9b6f-e585-4d36-b0e8-97748ec3f6fb tempest-VolumesSnapshotTestJSON-1776725678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:34:38 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-f5ab9b6f-e585-4d36-b0e8-97748ec3f6fb tempest-VolumesSnapshotTestJSON-1776725678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:34:38 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-f5ab9b6f-e585-4d36-b0e8-97748ec3f6fb tempest-VolumesSnapshotTestJSON-1776725678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:34:38 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-f5ab9b6f-e585-4d36-b0e8-97748ec3f6fb tempest-VolumesSnapshotTestJSON-1776725678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:34:38 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-f5ab9b6f-e585-4d36-b0e8-97748ec3f6fb tempest-VolumesSnapshotTestJSON-1776725678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:34:38 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd54e001-d229-42f4-87ff-347cb5abdbfa]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:34:38 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-f5ab9b6f-e585-4d36-b0e8-97748ec3f6fb tempest-VolumesSnapshotTestJSON-1776725678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0f20111c-84f2-4df0-94af-a4f52409aeff.e4e6efe3-f744-415b-a640-16c605a0de88 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:34:38 devstack sudo[109179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0f20111c-84f2-4df0-94af-a4f52409aeff.e4e6efe3-f744-415b-a640-16c605a0de88 Aug 26 14:34:38 devstack sudo[109179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:34:39 devstack sudo[109179]: pam_unix(sudo:session): session closed for user root Aug 26 14:34:39 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-f5ab9b6f-e585-4d36-b0e8-97748ec3f6fb tempest-VolumesSnapshotTestJSON-1776725678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0f20111c-84f2-4df0-94af-a4f52409aeff.e4e6efe3-f744-415b-a640-16c605a0de88" returned: 0 in 1.033s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:34:39 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-f5ab9b6f-e585-4d36-b0e8-97748ec3f6fb tempest-VolumesSnapshotTestJSON-1776725678 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f20111c-84f2-4df0-94af-a4f52409aeff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94394) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 14:34:39 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[7445fd40-f41d-4365-a357-e2c7194da684]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:34:39 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-f5ab9b6f-e585-4d36-b0e8-97748ec3f6fb tempest-VolumesSnapshotTestJSON-1776725678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0f20111c-84f2-4df0-94af-a4f52409aeff {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:34:40 devstack sudo[109185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0f20111c-84f2-4df0-94af-a4f52409aeff Aug 26 14:34:40 devstack sudo[109185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:34:41 devstack sudo[109185]: pam_unix(sudo:session): session closed for user root Aug 26 14:34:41 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-f5ab9b6f-e585-4d36-b0e8-97748ec3f6fb tempest-VolumesSnapshotTestJSON-1776725678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0f20111c-84f2-4df0-94af-a4f52409aeff" returned: 0 in 1.402s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:34:41 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-f5ab9b6f-e585-4d36-b0e8-97748ec3f6fb tempest-VolumesSnapshotTestJSON-1776725678 None] will copy from snapshot at /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0f20111c-84f2-4df0-94af-a4f52409aeff {{(pid=94394) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 26 14:34:41 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-f5ab9b6f-e585-4d36-b0e8-97748ec3f6fb tempest-VolumesSnapshotTestJSON-1776725678 None] Creating direct copy from snapshot {{(pid=94394) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 26 14:34:41 devstack cinder-volume[94394]: DEBUG cinder.utils [None req-f5ab9b6f-e585-4d36-b0e8-97748ec3f6fb tempest-VolumesSnapshotTestJSON-1776725678 None] Path /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-f36f5a46-10f9-4047-87fb-e62c4df0ad51 not found in is_blk_device check {{(pid=94394) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 26 14:34:41 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-f5ab9b6f-e585-4d36-b0e8-97748ec3f6fb tempest-VolumesSnapshotTestJSON-1776725678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0f20111c-84f2-4df0-94af-a4f52409aeff /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-f36f5a46-10f9-4047-87fb-e62c4df0ad51 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:34:41 devstack sudo[109194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0f20111c-84f2-4df0-94af-a4f52409aeff /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-f36f5a46-10f9-4047-87fb-e62c4df0ad51 Aug 26 14:34:41 devstack sudo[109194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:34:48 devstack cinder-volume[94394]: DEBUG dbcounter [-] [94394] Writing DB stats cinder:UPDATE=33,cinder:SELECT=46,cinder:INSERT=10,cinder:DELETE=2 {{(pid=94394) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 14:34:48 devstack cinder-volume[94394]: DEBUG dbcounter [-] [94394] Writing DB stats cinder:SELECT=54,cinder:INSERT=10,cinder:UPDATE=25,cinder:DELETE=5 {{(pid=94394) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 14:34:50 devstack sudo[109194]: pam_unix(sudo:session): session closed for user root Aug 26 14:34:50 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-f5ab9b6f-e585-4d36-b0e8-97748ec3f6fb tempest-VolumesSnapshotTestJSON-1776725678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0f20111c-84f2-4df0-94af-a4f52409aeff /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-f36f5a46-10f9-4047-87fb-e62c4df0ad51" returned: 0 in 9.904s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:34:50 devstack cinder-volume[94394]: DEBUG cinder.image.image_utils [None req-f5ab9b6f-e585-4d36-b0e8-97748ec3f6fb tempest-VolumesSnapshotTestJSON-1776725678 None] Image conversion details: src /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0f20111c-84f2-4df0-94af-a4f52409aeff, size 1024.00 MB, duration 9.91 sec, destination /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-f36f5a46-10f9-4047-87fb-e62c4df0ad51 {{(pid=94394) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 14:34:50 devstack cinder-volume[94394]: INFO cinder.image.image_utils [None req-f5ab9b6f-e585-4d36-b0e8-97748ec3f6fb tempest-VolumesSnapshotTestJSON-1776725678 None] Converted 1024.00 MB image at 103.30 MB/s Aug 26 14:34:50 devstack cinder-volume[94394]: WARNING cinder.volume.drivers.remotefs [None req-f5ab9b6f-e585-4d36-b0e8-97748ec3f6fb tempest-VolumesSnapshotTestJSON-1776725678 None] /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-f36f5a46-10f9-4047-87fb-e62c4df0ad51 is being set with open permissions: ugo+rw Aug 26 14:34:50 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-f5ab9b6f-e585-4d36-b0e8-97748ec3f6fb tempest-VolumesSnapshotTestJSON-1776725678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-f36f5a46-10f9-4047-87fb-e62c4df0ad51 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:34:50 devstack sudo[109216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-f36f5a46-10f9-4047-87fb-e62c4df0ad51 Aug 26 14:34:50 devstack sudo[109216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:34:51 devstack sudo[109216]: pam_unix(sudo:session): session closed for user root Aug 26 14:34:51 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-f5ab9b6f-e585-4d36-b0e8-97748ec3f6fb tempest-VolumesSnapshotTestJSON-1776725678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-f36f5a46-10f9-4047-87fb-e62c4df0ad51" returned: 0 in 0.437s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:34:51 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-f5ab9b6f-e585-4d36-b0e8-97748ec3f6fb tempest-VolumesSnapshotTestJSON-1776725678 None] Lock "cinder-quobyte-f36f5a46-10f9-4047-87fb-e62c4df0ad51" released by "_copy_volume_from_snapshot" :: held 12.961s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:34:51 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-f5ab9b6f-e585-4d36-b0e8-97748ec3f6fb tempest-VolumesSnapshotTestJSON-1776725678 None] Lock "cinder-quobyte-e4e6efe3-f744-415b-a640-16c605a0de88-f36f5a46-10f9-4047-87fb-e62c4df0ad51" released by "_create_volume_from_snapshot" :: held 13.085s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:34:51 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-f5ab9b6f-e585-4d36-b0e8-97748ec3f6fb tempest-VolumesSnapshotTestJSON-1776725678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.113s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:34:51 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-f5ab9b6f-e585-4d36-b0e8-97748ec3f6fb tempest-VolumesSnapshotTestJSON-1776725678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e759d3e-262b-4599-b4fb-24ca7005805e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f36f5a46-10f9-4047-87fb-e62c4df0ad51', 'volume_size': 2, 'snapshot_id': 'e4e6efe3-f744-415b-a640-16c605a0de88'}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:34:51 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-f5ab9b6f-e585-4d36-b0e8-97748ec3f6fb tempest-VolumesSnapshotTestJSON-1776725678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a6f6fa0-bd4c-421d-9b82-62d2b638980f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:34:51 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-f5ab9b6f-e585-4d36-b0e8-97748ec3f6fb tempest-VolumesSnapshotTestJSON-1776725678 None] Volume volume-f36f5a46-10f9-4047-87fb-e62c4df0ad51 (f36f5a46-10f9-4047-87fb-e62c4df0ad51): created successfully Aug 26 14:34:51 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-f5ab9b6f-e585-4d36-b0e8-97748ec3f6fb tempest-VolumesSnapshotTestJSON-1776725678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a6f6fa0-bd4c-421d-9b82-62d2b638980f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:34:51 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-f5ab9b6f-e585-4d36-b0e8-97748ec3f6fb tempest-VolumesSnapshotTestJSON-1776725678 None] Flow 'volume_create_manager' (96b107d7-d055-4b05-9aac-b07c4547c51b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:34:51 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-f5ab9b6f-e585-4d36-b0e8-97748ec3f6fb tempest-VolumesSnapshotTestJSON-1776725678 None] Created volume successfully. Aug 26 14:34:53 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-1356dbea-768e-4f40-8a1e-2cb9492ae802 tempest-VolumesSnapshotTestJSON-1776725678 None] Acquiring lock "cinder-f36f5a46-10f9-4047-87fb-e62c4df0ad51-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:34:53 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-1356dbea-768e-4f40-8a1e-2cb9492ae802 tempest-VolumesSnapshotTestJSON-1776725678 None] Lock "cinder-f36f5a46-10f9-4047-87fb-e62c4df0ad51-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:34:53 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-1356dbea-768e-4f40-8a1e-2cb9492ae802 tempest-VolumesSnapshotTestJSON-1776725678 None] Acquiring lock "cinder-quobyte-f36f5a46-10f9-4047-87fb-e62c4df0ad51" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:34:53 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-1356dbea-768e-4f40-8a1e-2cb9492ae802 tempest-VolumesSnapshotTestJSON-1776725678 None] Lock "cinder-quobyte-f36f5a46-10f9-4047-87fb-e62c4df0ad51" acquired by "delete_volume" :: waited 0.023s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:34:53 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[b61760f5-23e7-4c9b-9db3-aaed7dabd569]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:34:53 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-1356dbea-768e-4f40-8a1e-2cb9492ae802 tempest-VolumesSnapshotTestJSON-1776725678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-f36f5a46-10f9-4047-87fb-e62c4df0ad51 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:34:53 devstack sudo[109243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-f36f5a46-10f9-4047-87fb-e62c4df0ad51 Aug 26 14:34:53 devstack sudo[109243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:34:54 devstack sudo[109243]: pam_unix(sudo:session): session closed for user root Aug 26 14:34:54 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-1356dbea-768e-4f40-8a1e-2cb9492ae802 tempest-VolumesSnapshotTestJSON-1776725678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-f36f5a46-10f9-4047-87fb-e62c4df0ad51" returned: 0 in 0.786s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:34:54 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-1356dbea-768e-4f40-8a1e-2cb9492ae802 tempest-VolumesSnapshotTestJSON-1776725678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-f36f5a46-10f9-4047-87fb-e62c4df0ad51 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:34:54 devstack sudo[109249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-f36f5a46-10f9-4047-87fb-e62c4df0ad51 Aug 26 14:34:54 devstack sudo[109249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:34:54 devstack sudo[109249]: pam_unix(sudo:session): session closed for user root Aug 26 14:34:54 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-1356dbea-768e-4f40-8a1e-2cb9492ae802 tempest-VolumesSnapshotTestJSON-1776725678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-f36f5a46-10f9-4047-87fb-e62c4df0ad51" returned: 0 in 0.751s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:34:54 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-1356dbea-768e-4f40-8a1e-2cb9492ae802 tempest-VolumesSnapshotTestJSON-1776725678 None] Lock "cinder-quobyte-f36f5a46-10f9-4047-87fb-e62c4df0ad51" released by "delete_volume" :: held 1.632s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:34:55 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-1356dbea-768e-4f40-8a1e-2cb9492ae802 tempest-VolumesSnapshotTestJSON-1776725678 None] Created reservations ['dcc229bb-9939-402a-92d3-3e15d100c7a4', 'b8d7f7f7-91ac-437f-8f10-b631e4134b5a', 'ae3bb4fe-e709-477a-8031-d4ff2215350b', '271c7c09-9705-46e7-9f9d-a5b3c10303da'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:34:55 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-1356dbea-768e-4f40-8a1e-2cb9492ae802 tempest-VolumesSnapshotTestJSON-1776725678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:34:55 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-1356dbea-768e-4f40-8a1e-2cb9492ae802 tempest-VolumesSnapshotTestJSON-1776725678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:34:55 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-1356dbea-768e-4f40-8a1e-2cb9492ae802 tempest-VolumesSnapshotTestJSON-1776725678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:34:55 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-1356dbea-768e-4f40-8a1e-2cb9492ae802 tempest-VolumesSnapshotTestJSON-1776725678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:34:55 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-1356dbea-768e-4f40-8a1e-2cb9492ae802 tempest-VolumesSnapshotTestJSON-1776725678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:34:55 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-1356dbea-768e-4f40-8a1e-2cb9492ae802 tempest-VolumesSnapshotTestJSON-1776725678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:34:55 devstack sudo[109252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:34:55 devstack sudo[109252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:34:55 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-906f8f12-d740-4d4f-8d4b-c9205bae8756 tempest-VolumesSnapshotTestJSON-1776725678 None] Acquiring lock "cinder-e4e6efe3-f744-415b-a640-16c605a0de88-delete_snapshot" by "delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:34:55 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-906f8f12-d740-4d4f-8d4b-c9205bae8756 tempest-VolumesSnapshotTestJSON-1776725678 None] Lock "cinder-e4e6efe3-f744-415b-a640-16c605a0de88-delete_snapshot" acquired by "delete_snapshot" :: waited 0.066s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:34:55 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-906f8f12-d740-4d4f-8d4b-c9205bae8756 tempest-VolumesSnapshotTestJSON-1776725678 None] Acquiring lock "cinder-quobyte-0f20111c-84f2-4df0-94af-a4f52409aeff" by "delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:34:55 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-906f8f12-d740-4d4f-8d4b-c9205bae8756 tempest-VolumesSnapshotTestJSON-1776725678 None] Lock "cinder-quobyte-0f20111c-84f2-4df0-94af-a4f52409aeff" acquired by "delete_snapshot" :: waited 0.062s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:34:55 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-906f8f12-d740-4d4f-8d4b-c9205bae8756 tempest-VolumesSnapshotTestJSON-1776725678 None] Acquiring lock "cinder-quobyte-e4e6efe3-f744-415b-a640-16c605a0de88" by "_delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:34:55 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-906f8f12-d740-4d4f-8d4b-c9205bae8756 tempest-VolumesSnapshotTestJSON-1776725678 None] Lock "cinder-quobyte-e4e6efe3-f744-415b-a640-16c605a0de88" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:34:55 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-906f8f12-d740-4d4f-8d4b-c9205bae8756 tempest-VolumesSnapshotTestJSON-1776725678 None] Deleting offline snapshot e4e6efe3-f744-415b-a640-16c605a0de88 of volume 0f20111c-84f2-4df0-94af-a4f52409aeff {{(pid=94394) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 14:34:56 devstack sudo[109252]: pam_unix(sudo:session): session closed for user root Aug 26 14:34:56 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-906f8f12-d740-4d4f-8d4b-c9205bae8756 tempest-VolumesSnapshotTestJSON-1776725678 None] snapshot_file for this snap is: volume-0f20111c-84f2-4df0-94af-a4f52409aeff.e4e6efe3-f744-415b-a640-16c605a0de88 {{(pid=94394) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 14:34:56 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-1356dbea-768e-4f40-8a1e-2cb9492ae802 tempest-VolumesSnapshotTestJSON-1776725678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.744s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:34:56 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-1356dbea-768e-4f40-8a1e-2cb9492ae802 tempest-VolumesSnapshotTestJSON-1776725678 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:34:56 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-1356dbea-768e-4f40-8a1e-2cb9492ae802 tempest-VolumesSnapshotTestJSON-1776725678 None] Deleted volume successfully. Aug 26 14:34:56 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[640df456-7163-4ee0-9998-3d22fc935138]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:34:56 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-906f8f12-d740-4d4f-8d4b-c9205bae8756 tempest-VolumesSnapshotTestJSON-1776725678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0f20111c-84f2-4df0-94af-a4f52409aeff.e4e6efe3-f744-415b-a640-16c605a0de88 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:34:56 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-1356dbea-768e-4f40-8a1e-2cb9492ae802 tempest-VolumesSnapshotTestJSON-1776725678 None] Lock "cinder-f36f5a46-10f9-4047-87fb-e62c4df0ad51-delete_volume" released by "delete_volume" :: held 3.014s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:34:56 devstack sudo[109255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0f20111c-84f2-4df0-94af-a4f52409aeff.e4e6efe3-f744-415b-a640-16c605a0de88 Aug 26 14:34:56 devstack sudo[109255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:34:56 devstack sudo[109255]: pam_unix(sudo:session): session closed for user root Aug 26 14:34:56 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-906f8f12-d740-4d4f-8d4b-c9205bae8756 tempest-VolumesSnapshotTestJSON-1776725678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0f20111c-84f2-4df0-94af-a4f52409aeff.e4e6efe3-f744-415b-a640-16c605a0de88" returned: 0 in 0.695s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:34:56 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-906f8f12-d740-4d4f-8d4b-c9205bae8756 tempest-VolumesSnapshotTestJSON-1776725678 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f20111c-84f2-4df0-94af-a4f52409aeff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94394) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 14:34:56 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d0ba98f-5b7c-45e0-a13a-440c12a07b91]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:34:56 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-906f8f12-d740-4d4f-8d4b-c9205bae8756 tempest-VolumesSnapshotTestJSON-1776725678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0f20111c-84f2-4df0-94af-a4f52409aeff {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:34:57 devstack sudo[109277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0f20111c-84f2-4df0-94af-a4f52409aeff Aug 26 14:34:57 devstack sudo[109277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:34:58 devstack sudo[109277]: pam_unix(sudo:session): session closed for user root Aug 26 14:34:58 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-906f8f12-d740-4d4f-8d4b-c9205bae8756 tempest-VolumesSnapshotTestJSON-1776725678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0f20111c-84f2-4df0-94af-a4f52409aeff" returned: 0 in 1.210s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:34:58 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-906f8f12-d740-4d4f-8d4b-c9205bae8756 tempest-VolumesSnapshotTestJSON-1776725678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0f20111c-84f2-4df0-94af-a4f52409aeff.e4e6efe3-f744-415b-a640-16c605a0de88 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:34:58 devstack sudo[109284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0f20111c-84f2-4df0-94af-a4f52409aeff.e4e6efe3-f744-415b-a640-16c605a0de88 Aug 26 14:34:58 devstack sudo[109284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:34:58 devstack sudo[109284]: pam_unix(sudo:session): session closed for user root Aug 26 14:34:58 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-906f8f12-d740-4d4f-8d4b-c9205bae8756 tempest-VolumesSnapshotTestJSON-1776725678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0f20111c-84f2-4df0-94af-a4f52409aeff.e4e6efe3-f744-415b-a640-16c605a0de88" returned: 0 in 0.666s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:34:58 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-906f8f12-d740-4d4f-8d4b-c9205bae8756 tempest-VolumesSnapshotTestJSON-1776725678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0f20111c-84f2-4df0-94af-a4f52409aeff.e4e6efe3-f744-415b-a640-16c605a0de88 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:34:58 devstack sudo[109290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0f20111c-84f2-4df0-94af-a4f52409aeff.e4e6efe3-f744-415b-a640-16c605a0de88 Aug 26 14:34:58 devstack sudo[109290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:34:59 devstack sudo[109290]: pam_unix(sudo:session): session closed for user root Aug 26 14:34:59 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-906f8f12-d740-4d4f-8d4b-c9205bae8756 tempest-VolumesSnapshotTestJSON-1776725678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0f20111c-84f2-4df0-94af-a4f52409aeff.e4e6efe3-f744-415b-a640-16c605a0de88" returned: 0 in 0.385s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:34:59 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-906f8f12-d740-4d4f-8d4b-c9205bae8756 tempest-VolumesSnapshotTestJSON-1776725678 None] Lock "cinder-quobyte-e4e6efe3-f744-415b-a640-16c605a0de88" released by "_delete_snapshot" :: held 3.186s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:34:59 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-906f8f12-d740-4d4f-8d4b-c9205bae8756 tempest-VolumesSnapshotTestJSON-1776725678 None] Lock "cinder-quobyte-0f20111c-84f2-4df0-94af-a4f52409aeff" released by "delete_snapshot" :: held 3.229s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:34:59 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-906f8f12-d740-4d4f-8d4b-c9205bae8756 tempest-VolumesSnapshotTestJSON-1776725678 None] Created reservations ['aa191956-a838-4786-b0ef-0d54b8404389', 'f051ea2c-cdcd-417d-bada-82e1d6a6a307', '858df514-294e-4c3d-8a44-13d8a184fc2a', '77827a1a-7e1e-4f6e-bc82-e7962914bf22'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:34:59 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-906f8f12-d740-4d4f-8d4b-c9205bae8756 tempest-VolumesSnapshotTestJSON-1776725678 None] Delete snapshot completed successfully. Aug 26 14:34:59 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-906f8f12-d740-4d4f-8d4b-c9205bae8756 tempest-VolumesSnapshotTestJSON-1776725678 None] Lock "cinder-e4e6efe3-f744-415b-a640-16c605a0de88-delete_snapshot" released by "delete_snapshot" :: held 3.476s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:35:00 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-8496d22a-0611-4a57-8e14-8f71a7cc65c0 tempest-VolumesSnapshotTestJSON-1776725678 None] Acquiring lock "cinder-0f20111c-84f2-4df0-94af-a4f52409aeff-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:35:00 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-8496d22a-0611-4a57-8e14-8f71a7cc65c0 tempest-VolumesSnapshotTestJSON-1776725678 None] Lock "cinder-0f20111c-84f2-4df0-94af-a4f52409aeff-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:35:00 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-8496d22a-0611-4a57-8e14-8f71a7cc65c0 tempest-VolumesSnapshotTestJSON-1776725678 None] Acquiring lock "cinder-quobyte-0f20111c-84f2-4df0-94af-a4f52409aeff" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:35:00 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-8496d22a-0611-4a57-8e14-8f71a7cc65c0 tempest-VolumesSnapshotTestJSON-1776725678 None] Lock "cinder-quobyte-0f20111c-84f2-4df0-94af-a4f52409aeff" acquired by "delete_volume" :: waited 0.015s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:35:00 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4296b39-3e22-412d-847b-316b904cfa2c]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:35:00 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-8496d22a-0611-4a57-8e14-8f71a7cc65c0 tempest-VolumesSnapshotTestJSON-1776725678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0f20111c-84f2-4df0-94af-a4f52409aeff {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:35:00 devstack sudo[109294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0f20111c-84f2-4df0-94af-a4f52409aeff Aug 26 14:35:00 devstack sudo[109294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:35:00 devstack sudo[109294]: pam_unix(sudo:session): session closed for user root Aug 26 14:35:00 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-8496d22a-0611-4a57-8e14-8f71a7cc65c0 tempest-VolumesSnapshotTestJSON-1776725678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0f20111c-84f2-4df0-94af-a4f52409aeff" returned: 0 in 0.378s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:35:00 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-8496d22a-0611-4a57-8e14-8f71a7cc65c0 tempest-VolumesSnapshotTestJSON-1776725678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0f20111c-84f2-4df0-94af-a4f52409aeff {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:35:00 devstack sudo[109299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0f20111c-84f2-4df0-94af-a4f52409aeff Aug 26 14:35:00 devstack sudo[109299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:35:01 devstack sudo[109299]: pam_unix(sudo:session): session closed for user root Aug 26 14:35:01 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-8496d22a-0611-4a57-8e14-8f71a7cc65c0 tempest-VolumesSnapshotTestJSON-1776725678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0f20111c-84f2-4df0-94af-a4f52409aeff" returned: 0 in 0.273s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:35:01 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-8496d22a-0611-4a57-8e14-8f71a7cc65c0 tempest-VolumesSnapshotTestJSON-1776725678 None] Lock "cinder-quobyte-0f20111c-84f2-4df0-94af-a4f52409aeff" released by "delete_volume" :: held 0.749s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:35:01 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-8496d22a-0611-4a57-8e14-8f71a7cc65c0 tempest-VolumesSnapshotTestJSON-1776725678 None] Created reservations ['6a8f9134-9acc-4a9a-99c9-83087c640cb5', '74978365-1708-4b43-88bd-f6a34ca56efe', '202f5656-b627-45ae-8c37-950dfdbf0df4', 'cbac6804-a673-49eb-9373-f487928e2c2f'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:35:01 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-8496d22a-0611-4a57-8e14-8f71a7cc65c0 tempest-VolumesSnapshotTestJSON-1776725678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:35:01 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-8496d22a-0611-4a57-8e14-8f71a7cc65c0 tempest-VolumesSnapshotTestJSON-1776725678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:35:01 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-8496d22a-0611-4a57-8e14-8f71a7cc65c0 tempest-VolumesSnapshotTestJSON-1776725678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:35:01 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-8496d22a-0611-4a57-8e14-8f71a7cc65c0 tempest-VolumesSnapshotTestJSON-1776725678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:35:01 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-8496d22a-0611-4a57-8e14-8f71a7cc65c0 tempest-VolumesSnapshotTestJSON-1776725678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:35:01 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-8496d22a-0611-4a57-8e14-8f71a7cc65c0 tempest-VolumesSnapshotTestJSON-1776725678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:35:01 devstack sudo[109302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:35:01 devstack sudo[109302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:35:01 devstack sudo[109302]: pam_unix(sudo:session): session closed for user root Aug 26 14:35:01 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-8496d22a-0611-4a57-8e14-8f71a7cc65c0 tempest-VolumesSnapshotTestJSON-1776725678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.268s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:35:01 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-8496d22a-0611-4a57-8e14-8f71a7cc65c0 tempest-VolumesSnapshotTestJSON-1776725678 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:35:01 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-8496d22a-0611-4a57-8e14-8f71a7cc65c0 tempest-VolumesSnapshotTestJSON-1776725678 None] Deleted volume successfully. Aug 26 14:35:01 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-8496d22a-0611-4a57-8e14-8f71a7cc65c0 tempest-VolumesSnapshotTestJSON-1776725678 None] Lock "cinder-0f20111c-84f2-4df0-94af-a4f52409aeff-delete_volume" released by "delete_volume" :: held 1.260s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:35:01 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-64894294-b8ff-43a1-a874-54d613410d46 tempest-VolumesSnapshotTestJSON-1776725678 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:35:02 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-64894294-b8ff-43a1-a874-54d613410d46 tempest-VolumesSnapshotTestJSON-1776725678 None] Flow 'volume_create_manager' (470ae381-9a7a-43b6-bdfb-0eb65e7545e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:35:02 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-64894294-b8ff-43a1-a874-54d613410d46 tempest-VolumesSnapshotTestJSON-1776725678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d56af0d-1b50-4c8a-9094-71228e78ce41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:35:02 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-64894294-b8ff-43a1-a874-54d613410d46 tempest-VolumesSnapshotTestJSON-1776725678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d56af0d-1b50-4c8a-9094-71228e78ce41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:35:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1920314231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=648711f8-e553-4576-84e1-c1cf81afef7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc1b419887b643c28cb952dc5c7fb2ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:35:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:35:02Z,use_quota=True,user_id='2966ecf31f2b4b26bb6de6eabe29590f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:35:02 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-64894294-b8ff-43a1-a874-54d613410d46 tempest-VolumesSnapshotTestJSON-1776725678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de7c2c36-f584-4270-afc5-b548052a12d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:35:02 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-64894294-b8ff-43a1-a874-54d613410d46 tempest-VolumesSnapshotTestJSON-1776725678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de7c2c36-f584-4270-afc5-b548052a12d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:35:02 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-64894294-b8ff-43a1-a874-54d613410d46 tempest-VolumesSnapshotTestJSON-1776725678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f29d22c4-491e-43d0-b6d3-9aa448829abb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:35:02 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-64894294-b8ff-43a1-a874-54d613410d46 tempest-VolumesSnapshotTestJSON-1776725678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f29d22c4-491e-43d0-b6d3-9aa448829abb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '648711f8-e553-4576-84e1-c1cf81afef7c', 'volume_name': 'volume-648711f8-e553-4576-84e1-c1cf81afef7c', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:35:02 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-64894294-b8ff-43a1-a874-54d613410d46 tempest-VolumesSnapshotTestJSON-1776725678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (240e50f8-a132-4a72-9bfd-95d9bec7f908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:35:02 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-64894294-b8ff-43a1-a874-54d613410d46 tempest-VolumesSnapshotTestJSON-1776725678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (240e50f8-a132-4a72-9bfd-95d9bec7f908) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:35:02 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-64894294-b8ff-43a1-a874-54d613410d46 tempest-VolumesSnapshotTestJSON-1776725678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (833a759b-f92f-43b5-8df7-b037842fb88f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:35:02 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-64894294-b8ff-43a1-a874-54d613410d46 tempest-VolumesSnapshotTestJSON-1776725678 None] Volume 648711f8-e553-4576-84e1-c1cf81afef7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-648711f8-e553-4576-84e1-c1cf81afef7c', 'volume_size': 1} Aug 26 14:35:02 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-64894294-b8ff-43a1-a874-54d613410d46 tempest-VolumesSnapshotTestJSON-1776725678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:35:02 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-64894294-b8ff-43a1-a874-54d613410d46 tempest-VolumesSnapshotTestJSON-1776725678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:35:02 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-64894294-b8ff-43a1-a874-54d613410d46 tempest-VolumesSnapshotTestJSON-1776725678 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:35:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1920314231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=648711f8-e553-4576-84e1-c1cf81afef7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc1b419887b643c28cb952dc5c7fb2ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:35:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:35:02Z,use_quota=True,user_id='2966ecf31f2b4b26bb6de6eabe29590f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:35:02 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-64894294-b8ff-43a1-a874-54d613410d46 tempest-VolumesSnapshotTestJSON-1776725678 None] Creating volume 648711f8-e553-4576-84e1-c1cf81afef7c {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:35:02 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-64894294-b8ff-43a1-a874-54d613410d46 tempest-VolumesSnapshotTestJSON-1776725678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:35:02 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-64894294-b8ff-43a1-a874-54d613410d46 tempest-VolumesSnapshotTestJSON-1776725678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:35:02 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-64894294-b8ff-43a1-a874-54d613410d46 tempest-VolumesSnapshotTestJSON-1776725678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:35:02 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-64894294-b8ff-43a1-a874-54d613410d46 tempest-VolumesSnapshotTestJSON-1776725678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:35:02 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-64894294-b8ff-43a1-a874-54d613410d46 tempest-VolumesSnapshotTestJSON-1776725678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:35:02 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-64894294-b8ff-43a1-a874-54d613410d46 tempest-VolumesSnapshotTestJSON-1776725678 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:35:02 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-64894294-b8ff-43a1-a874-54d613410d46 tempest-VolumesSnapshotTestJSON-1776725678 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:35:02 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-64894294-b8ff-43a1-a874-54d613410d46 tempest-VolumesSnapshotTestJSON-1776725678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-648711f8-e553-4576-84e1-c1cf81afef7c 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:35:02 devstack sudo[109308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-648711f8-e553-4576-84e1-c1cf81afef7c 1073741824 Aug 26 14:35:02 devstack sudo[109308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:35:02 devstack sudo[109308]: pam_unix(sudo:session): session closed for user root Aug 26 14:35:02 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-64894294-b8ff-43a1-a874-54d613410d46 tempest-VolumesSnapshotTestJSON-1776725678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-648711f8-e553-4576-84e1-c1cf81afef7c 1073741824" returned: 0 in 0.524s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:35:02 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-64894294-b8ff-43a1-a874-54d613410d46 tempest-VolumesSnapshotTestJSON-1776725678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-648711f8-e553-4576-84e1-c1cf81afef7c {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:35:02 devstack sudo[109314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-648711f8-e553-4576-84e1-c1cf81afef7c Aug 26 14:35:02 devstack sudo[109314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:35:02 devstack sudo[109314]: pam_unix(sudo:session): session closed for user root Aug 26 14:35:02 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-64894294-b8ff-43a1-a874-54d613410d46 tempest-VolumesSnapshotTestJSON-1776725678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-648711f8-e553-4576-84e1-c1cf81afef7c" returned: 0 in 0.323s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:35:02 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-64894294-b8ff-43a1-a874-54d613410d46 tempest-VolumesSnapshotTestJSON-1776725678 None] <== create_volume: return (902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:35:02 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-64894294-b8ff-43a1-a874-54d613410d46 tempest-VolumesSnapshotTestJSON-1776725678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.906s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:35:03 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-64894294-b8ff-43a1-a874-54d613410d46 tempest-VolumesSnapshotTestJSON-1776725678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (833a759b-f92f-43b5-8df7-b037842fb88f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-648711f8-e553-4576-84e1-c1cf81afef7c', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:35:03 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-64894294-b8ff-43a1-a874-54d613410d46 tempest-VolumesSnapshotTestJSON-1776725678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19d57e3a-78d8-4ada-84e3-caddb7d8f9ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:35:03 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-64894294-b8ff-43a1-a874-54d613410d46 tempest-VolumesSnapshotTestJSON-1776725678 None] Volume volume-648711f8-e553-4576-84e1-c1cf81afef7c (648711f8-e553-4576-84e1-c1cf81afef7c): created successfully Aug 26 14:35:03 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-64894294-b8ff-43a1-a874-54d613410d46 tempest-VolumesSnapshotTestJSON-1776725678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19d57e3a-78d8-4ada-84e3-caddb7d8f9ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:35:03 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-64894294-b8ff-43a1-a874-54d613410d46 tempest-VolumesSnapshotTestJSON-1776725678 None] Flow 'volume_create_manager' (470ae381-9a7a-43b6-bdfb-0eb65e7545e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:35:03 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-64894294-b8ff-43a1-a874-54d613410d46 tempest-VolumesSnapshotTestJSON-1776725678 None] Created volume successfully. Aug 26 14:35:04 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3554d59-8b0e-40b6-8a9d-fd141e99b8bf tempest-TestServerVolumeAttachmentScenario-1907654709 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:35:04 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-c3554d59-8b0e-40b6-8a9d-fd141e99b8bf tempest-TestServerVolumeAttachmentScenario-1907654709 None] Flow 'volume_create_manager' (dd272531-4643-46b3-855a-8b5dcf203ee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:35:04 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-c3554d59-8b0e-40b6-8a9d-fd141e99b8bf tempest-TestServerVolumeAttachmentScenario-1907654709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15c6eaf6-fd38-4927-b57a-0c9aa2daef55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:35:04 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-c3554d59-8b0e-40b6-8a9d-fd141e99b8bf tempest-TestServerVolumeAttachmentScenario-1907654709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15c6eaf6-fd38-4927-b57a-0c9aa2daef55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:35:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-155785438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17b6e820-6cc8-4018-b799-0e20a871423a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f3e624ee20c4e90bdae497cb19481e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:35:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:35:04Z,use_quota=True,user_id='d0d5b5333c1342b7af9c9c87faf31427',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:35:04 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-c3554d59-8b0e-40b6-8a9d-fd141e99b8bf tempest-TestServerVolumeAttachmentScenario-1907654709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65f3a32e-9fc9-41b0-b979-8a47854faaad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:35:04 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-c3554d59-8b0e-40b6-8a9d-fd141e99b8bf tempest-TestServerVolumeAttachmentScenario-1907654709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65f3a32e-9fc9-41b0-b979-8a47854faaad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:35:04 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-c3554d59-8b0e-40b6-8a9d-fd141e99b8bf tempest-TestServerVolumeAttachmentScenario-1907654709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f514c411-8ca3-44fa-a41f-196fca7c97a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:35:04 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-c3554d59-8b0e-40b6-8a9d-fd141e99b8bf tempest-TestServerVolumeAttachmentScenario-1907654709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f514c411-8ca3-44fa-a41f-196fca7c97a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17b6e820-6cc8-4018-b799-0e20a871423a', 'volume_name': 'volume-17b6e820-6cc8-4018-b799-0e20a871423a', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:35:04 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-c3554d59-8b0e-40b6-8a9d-fd141e99b8bf tempest-TestServerVolumeAttachmentScenario-1907654709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f974364e-0416-4e2b-a8f9-1f5347d94058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:35:04 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-c3554d59-8b0e-40b6-8a9d-fd141e99b8bf tempest-TestServerVolumeAttachmentScenario-1907654709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f974364e-0416-4e2b-a8f9-1f5347d94058) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:35:04 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-c3554d59-8b0e-40b6-8a9d-fd141e99b8bf tempest-TestServerVolumeAttachmentScenario-1907654709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e9f6ebe-3f92-4593-90fa-be9f762950dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:35:04 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-c3554d59-8b0e-40b6-8a9d-fd141e99b8bf tempest-TestServerVolumeAttachmentScenario-1907654709 None] Volume 17b6e820-6cc8-4018-b799-0e20a871423a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17b6e820-6cc8-4018-b799-0e20a871423a', 'volume_size': 1} Aug 26 14:35:04 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-c3554d59-8b0e-40b6-8a9d-fd141e99b8bf tempest-TestServerVolumeAttachmentScenario-1907654709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:35:04 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-c3554d59-8b0e-40b6-8a9d-fd141e99b8bf tempest-TestServerVolumeAttachmentScenario-1907654709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:35:04 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-c3554d59-8b0e-40b6-8a9d-fd141e99b8bf tempest-TestServerVolumeAttachmentScenario-1907654709 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:35:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-155785438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17b6e820-6cc8-4018-b799-0e20a871423a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f3e624ee20c4e90bdae497cb19481e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:35:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:35:04Z,use_quota=True,user_id='d0d5b5333c1342b7af9c9c87faf31427',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:35:04 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-c3554d59-8b0e-40b6-8a9d-fd141e99b8bf tempest-TestServerVolumeAttachmentScenario-1907654709 None] Creating volume 17b6e820-6cc8-4018-b799-0e20a871423a {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:35:04 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-c3554d59-8b0e-40b6-8a9d-fd141e99b8bf tempest-TestServerVolumeAttachmentScenario-1907654709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:35:04 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-c3554d59-8b0e-40b6-8a9d-fd141e99b8bf tempest-TestServerVolumeAttachmentScenario-1907654709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:35:04 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-c3554d59-8b0e-40b6-8a9d-fd141e99b8bf tempest-TestServerVolumeAttachmentScenario-1907654709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:35:04 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-c3554d59-8b0e-40b6-8a9d-fd141e99b8bf tempest-TestServerVolumeAttachmentScenario-1907654709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:35:04 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-c3554d59-8b0e-40b6-8a9d-fd141e99b8bf tempest-TestServerVolumeAttachmentScenario-1907654709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:35:04 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-c3554d59-8b0e-40b6-8a9d-fd141e99b8bf tempest-TestServerVolumeAttachmentScenario-1907654709 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:35:04 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-c3554d59-8b0e-40b6-8a9d-fd141e99b8bf tempest-TestServerVolumeAttachmentScenario-1907654709 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:35:04 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-c3554d59-8b0e-40b6-8a9d-fd141e99b8bf tempest-TestServerVolumeAttachmentScenario-1907654709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-17b6e820-6cc8-4018-b799-0e20a871423a 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:35:04 devstack sudo[109317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-17b6e820-6cc8-4018-b799-0e20a871423a 1073741824 Aug 26 14:35:04 devstack sudo[109317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:35:04 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-0bf7e602-c7aa-4a7c-8b3b-99c65bb63c70 tempest-VolumesSnapshotTestJSON-1776725678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:35:04 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-2aa30ac1-869f-4b83-9048-7ddfda71d856 tempest-TestServerVolumeAttachmentScenario-1907654709 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:35:04 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-2aa30ac1-869f-4b83-9048-7ddfda71d856 tempest-TestServerVolumeAttachmentScenario-1907654709 None] Flow 'volume_create_manager' (e492d080-75d8-4d32-a182-962e32f94532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:35:04 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-2aa30ac1-869f-4b83-9048-7ddfda71d856 tempest-TestServerVolumeAttachmentScenario-1907654709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c209666a-4228-4380-8d7c-24e6a05194db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:35:04 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-2aa30ac1-869f-4b83-9048-7ddfda71d856 tempest-TestServerVolumeAttachmentScenario-1907654709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c209666a-4228-4380-8d7c-24e6a05194db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:35:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-734431356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7d6860d-0284-4061-9746-d1e2d159969a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f3e624ee20c4e90bdae497cb19481e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:35:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:35:05Z,use_quota=True,user_id='d0d5b5333c1342b7af9c9c87faf31427',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:35:04 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-2aa30ac1-869f-4b83-9048-7ddfda71d856 tempest-TestServerVolumeAttachmentScenario-1907654709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (772bf0cc-dbcb-431c-a6cb-3b032b19a82a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:35:04 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-2aa30ac1-869f-4b83-9048-7ddfda71d856 tempest-TestServerVolumeAttachmentScenario-1907654709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (772bf0cc-dbcb-431c-a6cb-3b032b19a82a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:35:04 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-2aa30ac1-869f-4b83-9048-7ddfda71d856 tempest-TestServerVolumeAttachmentScenario-1907654709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eabdc11d-560c-492c-b1f5-6f5a7ec54fae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:35:04 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-2aa30ac1-869f-4b83-9048-7ddfda71d856 tempest-TestServerVolumeAttachmentScenario-1907654709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eabdc11d-560c-492c-b1f5-6f5a7ec54fae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7d6860d-0284-4061-9746-d1e2d159969a', 'volume_name': 'volume-b7d6860d-0284-4061-9746-d1e2d159969a', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:35:04 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-2aa30ac1-869f-4b83-9048-7ddfda71d856 tempest-TestServerVolumeAttachmentScenario-1907654709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (200ce774-3a36-4cf9-852b-55233d9be98f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:35:04 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-2aa30ac1-869f-4b83-9048-7ddfda71d856 tempest-TestServerVolumeAttachmentScenario-1907654709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (200ce774-3a36-4cf9-852b-55233d9be98f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:35:04 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-2aa30ac1-869f-4b83-9048-7ddfda71d856 tempest-TestServerVolumeAttachmentScenario-1907654709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95832c86-e69f-4997-a620-ed684b7d3d93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:35:04 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-2aa30ac1-869f-4b83-9048-7ddfda71d856 tempest-TestServerVolumeAttachmentScenario-1907654709 None] Volume b7d6860d-0284-4061-9746-d1e2d159969a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7d6860d-0284-4061-9746-d1e2d159969a', 'volume_size': 1} Aug 26 14:35:04 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-2aa30ac1-869f-4b83-9048-7ddfda71d856 tempest-TestServerVolumeAttachmentScenario-1907654709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:35:04 devstack sudo[109317]: pam_unix(sudo:session): session closed for user root Aug 26 14:35:04 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-c3554d59-8b0e-40b6-8a9d-fd141e99b8bf tempest-TestServerVolumeAttachmentScenario-1907654709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-17b6e820-6cc8-4018-b799-0e20a871423a 1073741824" returned: 0 in 0.679s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:35:05 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-c3554d59-8b0e-40b6-8a9d-fd141e99b8bf tempest-TestServerVolumeAttachmentScenario-1907654709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-17b6e820-6cc8-4018-b799-0e20a871423a {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:35:05 devstack sudo[109325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-17b6e820-6cc8-4018-b799-0e20a871423a Aug 26 14:35:05 devstack sudo[109325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:35:05 devstack sudo[109325]: pam_unix(sudo:session): session closed for user root Aug 26 14:35:05 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-c3554d59-8b0e-40b6-8a9d-fd141e99b8bf tempest-TestServerVolumeAttachmentScenario-1907654709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-17b6e820-6cc8-4018-b799-0e20a871423a" returned: 0 in 0.282s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:35:05 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-c3554d59-8b0e-40b6-8a9d-fd141e99b8bf tempest-TestServerVolumeAttachmentScenario-1907654709 None] <== create_volume: return (1008ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:35:05 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-c3554d59-8b0e-40b6-8a9d-fd141e99b8bf tempest-TestServerVolumeAttachmentScenario-1907654709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.014s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:35:05 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-0bf7e602-c7aa-4a7c-8b3b-99c65bb63c70 tempest-VolumesSnapshotTestJSON-1776725678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.972s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:35:05 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-c3554d59-8b0e-40b6-8a9d-fd141e99b8bf tempest-TestServerVolumeAttachmentScenario-1907654709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e9f6ebe-3f92-4593-90fa-be9f762950dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17b6e820-6cc8-4018-b799-0e20a871423a', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:35:05 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-c3554d59-8b0e-40b6-8a9d-fd141e99b8bf tempest-TestServerVolumeAttachmentScenario-1907654709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da2a9253-265b-43f0-b7ec-d306e5241395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:35:05 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-0bf7e602-c7aa-4a7c-8b3b-99c65bb63c70 tempest-VolumesSnapshotTestJSON-1776725678 None] Creating offline snapshot 9eb519ba-55c3-43db-a063-c70407f54240 of volume 648711f8-e553-4576-84e1-c1cf81afef7c {{(pid=94394) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 14:35:05 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-c3554d59-8b0e-40b6-8a9d-fd141e99b8bf tempest-TestServerVolumeAttachmentScenario-1907654709 None] Volume volume-17b6e820-6cc8-4018-b799-0e20a871423a (17b6e820-6cc8-4018-b799-0e20a871423a): created successfully Aug 26 14:35:05 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-c3554d59-8b0e-40b6-8a9d-fd141e99b8bf tempest-TestServerVolumeAttachmentScenario-1907654709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da2a9253-265b-43f0-b7ec-d306e5241395) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:35:05 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-c3554d59-8b0e-40b6-8a9d-fd141e99b8bf tempest-TestServerVolumeAttachmentScenario-1907654709 None] Flow 'volume_create_manager' (dd272531-4643-46b3-855a-8b5dcf203ee7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:35:05 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[a25dc78b-34d1-4854-9c68-de1f4210a8bb]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:35:05 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-0bf7e602-c7aa-4a7c-8b3b-99c65bb63c70 tempest-VolumesSnapshotTestJSON-1776725678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-648711f8-e553-4576-84e1-c1cf81afef7c {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:35:05 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-c3554d59-8b0e-40b6-8a9d-fd141e99b8bf tempest-TestServerVolumeAttachmentScenario-1907654709 None] Created volume successfully. Aug 26 14:35:05 devstack sudo[109328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-648711f8-e553-4576-84e1-c1cf81afef7c Aug 26 14:35:05 devstack sudo[109328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:35:05 devstack sudo[109328]: pam_unix(sudo:session): session closed for user root Aug 26 14:35:05 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-0bf7e602-c7aa-4a7c-8b3b-99c65bb63c70 tempest-VolumesSnapshotTestJSON-1776725678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-648711f8-e553-4576-84e1-c1cf81afef7c" returned: 0 in 0.556s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:35:05 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-0bf7e602-c7aa-4a7c-8b3b-99c65bb63c70 tempest-VolumesSnapshotTestJSON-1776725678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-648711f8-e553-4576-84e1-c1cf81afef7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-648711f8-e553-4576-84e1-c1cf81afef7c.9eb519ba-55c3-43db-a063-c70407f54240 1G {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:35:06 devstack sudo[109333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-648711f8-e553-4576-84e1-c1cf81afef7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-648711f8-e553-4576-84e1-c1cf81afef7c.9eb519ba-55c3-43db-a063-c70407f54240 1G Aug 26 14:35:06 devstack sudo[109333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:35:06 devstack sudo[109333]: pam_unix(sudo:session): session closed for user root Aug 26 14:35:06 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-0bf7e602-c7aa-4a7c-8b3b-99c65bb63c70 tempest-VolumesSnapshotTestJSON-1776725678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-648711f8-e553-4576-84e1-c1cf81afef7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-648711f8-e553-4576-84e1-c1cf81afef7c.9eb519ba-55c3-43db-a063-c70407f54240 1G" returned: 0 in 0.524s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:35:06 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-0bf7e602-c7aa-4a7c-8b3b-99c65bb63c70 tempest-VolumesSnapshotTestJSON-1776725678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-648711f8-e553-4576-84e1-c1cf81afef7c -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-648711f8-e553-4576-84e1-c1cf81afef7c.9eb519ba-55c3-43db-a063-c70407f54240 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:35:06 devstack sudo[109339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-648711f8-e553-4576-84e1-c1cf81afef7c -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-648711f8-e553-4576-84e1-c1cf81afef7c.9eb519ba-55c3-43db-a063-c70407f54240 Aug 26 14:35:06 devstack sudo[109339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:35:06 devstack sudo[109339]: pam_unix(sudo:session): session closed for user root Aug 26 14:35:06 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-0bf7e602-c7aa-4a7c-8b3b-99c65bb63c70 tempest-VolumesSnapshotTestJSON-1776725678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-648711f8-e553-4576-84e1-c1cf81afef7c -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-648711f8-e553-4576-84e1-c1cf81afef7c.9eb519ba-55c3-43db-a063-c70407f54240" returned: 0 in 0.381s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:35:06 devstack cinder-volume[94394]: WARNING cinder.volume.drivers.remotefs [None req-0bf7e602-c7aa-4a7c-8b3b-99c65bb63c70 tempest-VolumesSnapshotTestJSON-1776725678 None] /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-648711f8-e553-4576-84e1-c1cf81afef7c.9eb519ba-55c3-43db-a063-c70407f54240 is being set with open permissions: ugo+rw Aug 26 14:35:06 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-0bf7e602-c7aa-4a7c-8b3b-99c65bb63c70 tempest-VolumesSnapshotTestJSON-1776725678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-648711f8-e553-4576-84e1-c1cf81afef7c.9eb519ba-55c3-43db-a063-c70407f54240 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:35:06 devstack sudo[109345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-648711f8-e553-4576-84e1-c1cf81afef7c.9eb519ba-55c3-43db-a063-c70407f54240 Aug 26 14:35:06 devstack sudo[109345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:35:07 devstack sudo[109345]: pam_unix(sudo:session): session closed for user root Aug 26 14:35:07 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-0bf7e602-c7aa-4a7c-8b3b-99c65bb63c70 tempest-VolumesSnapshotTestJSON-1776725678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-648711f8-e553-4576-84e1-c1cf81afef7c.9eb519ba-55c3-43db-a063-c70407f54240" returned: 0 in 0.274s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:35:07 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-0bf7e602-c7aa-4a7c-8b3b-99c65bb63c70 tempest-VolumesSnapshotTestJSON-1776725678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-648711f8-e553-4576-84e1-c1cf81afef7c.info {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:35:07 devstack sudo[109348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-648711f8-e553-4576-84e1-c1cf81afef7c.info Aug 26 14:35:07 devstack sudo[109348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:35:07 devstack sudo[109348]: pam_unix(sudo:session): session closed for user root Aug 26 14:35:07 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-0bf7e602-c7aa-4a7c-8b3b-99c65bb63c70 tempest-VolumesSnapshotTestJSON-1776725678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-648711f8-e553-4576-84e1-c1cf81afef7c.info" returned: 0 in 0.306s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:35:07 devstack cinder-volume[94394]: WARNING cinder.volume.drivers.remotefs [None req-0bf7e602-c7aa-4a7c-8b3b-99c65bb63c70 tempest-VolumesSnapshotTestJSON-1776725678 None] /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-648711f8-e553-4576-84e1-c1cf81afef7c.info is being set with open permissions: ugo+rw Aug 26 14:35:07 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-0bf7e602-c7aa-4a7c-8b3b-99c65bb63c70 tempest-VolumesSnapshotTestJSON-1776725678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-648711f8-e553-4576-84e1-c1cf81afef7c.info {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:35:07 devstack sudo[109356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-648711f8-e553-4576-84e1-c1cf81afef7c.info Aug 26 14:35:07 devstack sudo[109356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:35:07 devstack sudo[109356]: pam_unix(sudo:session): session closed for user root Aug 26 14:35:07 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-0bf7e602-c7aa-4a7c-8b3b-99c65bb63c70 tempest-VolumesSnapshotTestJSON-1776725678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-648711f8-e553-4576-84e1-c1cf81afef7c.info" returned: 0 in 0.271s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:35:07 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-0bf7e602-c7aa-4a7c-8b3b-99c65bb63c70 tempest-VolumesSnapshotTestJSON-1776725678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.476s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:35:07 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-2aa30ac1-869f-4b83-9048-7ddfda71d856 tempest-TestServerVolumeAttachmentScenario-1907654709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.129s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:35:07 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-2aa30ac1-869f-4b83-9048-7ddfda71d856 tempest-TestServerVolumeAttachmentScenario-1907654709 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:35:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-734431356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7d6860d-0284-4061-9746-d1e2d159969a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f3e624ee20c4e90bdae497cb19481e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:35:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:35:05Z,use_quota=True,user_id='d0d5b5333c1342b7af9c9c87faf31427',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:35:07 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-2aa30ac1-869f-4b83-9048-7ddfda71d856 tempest-TestServerVolumeAttachmentScenario-1907654709 None] Creating volume b7d6860d-0284-4061-9746-d1e2d159969a {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:35:07 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-2aa30ac1-869f-4b83-9048-7ddfda71d856 tempest-TestServerVolumeAttachmentScenario-1907654709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:35:07 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-2aa30ac1-869f-4b83-9048-7ddfda71d856 tempest-TestServerVolumeAttachmentScenario-1907654709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:35:07 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-2aa30ac1-869f-4b83-9048-7ddfda71d856 tempest-TestServerVolumeAttachmentScenario-1907654709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:35:07 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-2aa30ac1-869f-4b83-9048-7ddfda71d856 tempest-TestServerVolumeAttachmentScenario-1907654709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:35:07 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-2aa30ac1-869f-4b83-9048-7ddfda71d856 tempest-TestServerVolumeAttachmentScenario-1907654709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:35:07 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-2aa30ac1-869f-4b83-9048-7ddfda71d856 tempest-TestServerVolumeAttachmentScenario-1907654709 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:35:07 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-2aa30ac1-869f-4b83-9048-7ddfda71d856 tempest-TestServerVolumeAttachmentScenario-1907654709 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:35:07 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-2aa30ac1-869f-4b83-9048-7ddfda71d856 tempest-TestServerVolumeAttachmentScenario-1907654709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b7d6860d-0284-4061-9746-d1e2d159969a 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:35:07 devstack sudo[109359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b7d6860d-0284-4061-9746-d1e2d159969a 1073741824 Aug 26 14:35:07 devstack sudo[109359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:35:07 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-0bf7e602-c7aa-4a7c-8b3b-99c65bb63c70 tempest-VolumesSnapshotTestJSON-1776725678 None] Create snapshot completed successfully Aug 26 14:35:08 devstack sudo[109359]: pam_unix(sudo:session): session closed for user root Aug 26 14:35:08 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-2aa30ac1-869f-4b83-9048-7ddfda71d856 tempest-TestServerVolumeAttachmentScenario-1907654709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b7d6860d-0284-4061-9746-d1e2d159969a 1073741824" returned: 0 in 0.434s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:35:08 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-2aa30ac1-869f-4b83-9048-7ddfda71d856 tempest-TestServerVolumeAttachmentScenario-1907654709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b7d6860d-0284-4061-9746-d1e2d159969a {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:35:08 devstack sudo[109365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b7d6860d-0284-4061-9746-d1e2d159969a Aug 26 14:35:08 devstack sudo[109365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:35:08 devstack sudo[109365]: pam_unix(sudo:session): session closed for user root Aug 26 14:35:08 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-2aa30ac1-869f-4b83-9048-7ddfda71d856 tempest-TestServerVolumeAttachmentScenario-1907654709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b7d6860d-0284-4061-9746-d1e2d159969a" returned: 0 in 0.295s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:35:08 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-2aa30ac1-869f-4b83-9048-7ddfda71d856 tempest-TestServerVolumeAttachmentScenario-1907654709 None] <== create_volume: return (778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:35:08 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-2aa30ac1-869f-4b83-9048-7ddfda71d856 tempest-TestServerVolumeAttachmentScenario-1907654709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.788s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:35:08 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-2aa30ac1-869f-4b83-9048-7ddfda71d856 tempest-TestServerVolumeAttachmentScenario-1907654709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95832c86-e69f-4997-a620-ed684b7d3d93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7d6860d-0284-4061-9746-d1e2d159969a', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:35:08 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-2aa30ac1-869f-4b83-9048-7ddfda71d856 tempest-TestServerVolumeAttachmentScenario-1907654709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5f63907-4b52-410a-85e2-04733188aa84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:35:08 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-2aa30ac1-869f-4b83-9048-7ddfda71d856 tempest-TestServerVolumeAttachmentScenario-1907654709 None] Volume volume-b7d6860d-0284-4061-9746-d1e2d159969a (b7d6860d-0284-4061-9746-d1e2d159969a): created successfully Aug 26 14:35:08 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-2aa30ac1-869f-4b83-9048-7ddfda71d856 tempest-TestServerVolumeAttachmentScenario-1907654709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5f63907-4b52-410a-85e2-04733188aa84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:35:08 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-2aa30ac1-869f-4b83-9048-7ddfda71d856 tempest-TestServerVolumeAttachmentScenario-1907654709 None] Flow 'volume_create_manager' (e492d080-75d8-4d32-a182-962e32f94532) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:35:08 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-2aa30ac1-869f-4b83-9048-7ddfda71d856 tempest-TestServerVolumeAttachmentScenario-1907654709 None] Created volume successfully. Aug 26 14:35:09 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b3d10aa-60fe-421a-8a0b-634d2dcf4c58 tempest-VolumesSnapshotTestJSON-1776725678 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:35:09 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-0b3d10aa-60fe-421a-8a0b-634d2dcf4c58 tempest-VolumesSnapshotTestJSON-1776725678 None] Flow 'volume_create_manager' (5c0448d1-e6f9-4cc3-a261-ebe94c214f3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:35:09 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-0b3d10aa-60fe-421a-8a0b-634d2dcf4c58 tempest-VolumesSnapshotTestJSON-1776725678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29edf919-e78c-4436-9fa2-9d2ad82c6f37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:35:09 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-0b3d10aa-60fe-421a-8a0b-634d2dcf4c58 tempest-VolumesSnapshotTestJSON-1776725678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29edf919-e78c-4436-9fa2-9d2ad82c6f37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:35:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-391341078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a148e505-845b-493c-a680-460dfaa6334d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc1b419887b643c28cb952dc5c7fb2ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:35:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9eb519ba-55c3-43db-a063-c70407f54240,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:35:09Z,use_quota=True,user_id='2966ecf31f2b4b26bb6de6eabe29590f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:35:09 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-0b3d10aa-60fe-421a-8a0b-634d2dcf4c58 tempest-VolumesSnapshotTestJSON-1776725678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6b9b081-2d07-468a-b14c-1ab102304094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:35:09 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-0b3d10aa-60fe-421a-8a0b-634d2dcf4c58 tempest-VolumesSnapshotTestJSON-1776725678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6b9b081-2d07-468a-b14c-1ab102304094) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:35:09 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-0b3d10aa-60fe-421a-8a0b-634d2dcf4c58 tempest-VolumesSnapshotTestJSON-1776725678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a356802f-c16c-47a4-b02a-6268b313e7ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:35:09 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-0b3d10aa-60fe-421a-8a0b-634d2dcf4c58 tempest-VolumesSnapshotTestJSON-1776725678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a356802f-c16c-47a4-b02a-6268b313e7ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a148e505-845b-493c-a680-460dfaa6334d', 'volume_name': 'volume-a148e505-845b-493c-a680-460dfaa6334d', 'volume_size': 1, 'snapshot_id': '9eb519ba-55c3-43db-a063-c70407f54240'}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:35:09 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-0b3d10aa-60fe-421a-8a0b-634d2dcf4c58 tempest-VolumesSnapshotTestJSON-1776725678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7de33121-f2f8-429d-8327-1d3c8b3f0271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:35:09 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-0b3d10aa-60fe-421a-8a0b-634d2dcf4c58 tempest-VolumesSnapshotTestJSON-1776725678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7de33121-f2f8-429d-8327-1d3c8b3f0271) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:35:09 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-0b3d10aa-60fe-421a-8a0b-634d2dcf4c58 tempest-VolumesSnapshotTestJSON-1776725678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d722d82-432b-4dfb-afd5-9df396b1f423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:35:09 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-0b3d10aa-60fe-421a-8a0b-634d2dcf4c58 tempest-VolumesSnapshotTestJSON-1776725678 None] Volume a148e505-845b-493c-a680-460dfaa6334d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a148e505-845b-493c-a680-460dfaa6334d', 'volume_size': 1, 'snapshot_id': '9eb519ba-55c3-43db-a063-c70407f54240'} Aug 26 14:35:09 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-0b3d10aa-60fe-421a-8a0b-634d2dcf4c58 tempest-VolumesSnapshotTestJSON-1776725678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:35:09 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-0b3d10aa-60fe-421a-8a0b-634d2dcf4c58 tempest-VolumesSnapshotTestJSON-1776725678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:35:09 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-0b3d10aa-60fe-421a-8a0b-634d2dcf4c58 tempest-VolumesSnapshotTestJSON-1776725678 None] Acquiring lock "cinder-quobyte-9eb519ba-55c3-43db-a063-c70407f54240-a148e505-845b-493c-a680-460dfaa6334d" by "_create_volume_from_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:35:09 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-0b3d10aa-60fe-421a-8a0b-634d2dcf4c58 tempest-VolumesSnapshotTestJSON-1776725678 None] Lock "cinder-quobyte-9eb519ba-55c3-43db-a063-c70407f54240-a148e505-845b-493c-a680-460dfaa6334d" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:35:09 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-0b3d10aa-60fe-421a-8a0b-634d2dcf4c58 tempest-VolumesSnapshotTestJSON-1776725678 None] Creating volume a148e505-845b-493c-a680-460dfaa6334d from snapshot 9eb519ba-55c3-43db-a063-c70407f54240 {{(pid=94394) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Aug 26 14:35:09 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-0b3d10aa-60fe-421a-8a0b-634d2dcf4c58 tempest-VolumesSnapshotTestJSON-1776725678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:35:09 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-0b3d10aa-60fe-421a-8a0b-634d2dcf4c58 tempest-VolumesSnapshotTestJSON-1776725678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:35:09 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-0b3d10aa-60fe-421a-8a0b-634d2dcf4c58 tempest-VolumesSnapshotTestJSON-1776725678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:35:09 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-0b3d10aa-60fe-421a-8a0b-634d2dcf4c58 tempest-VolumesSnapshotTestJSON-1776725678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:35:09 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-0b3d10aa-60fe-421a-8a0b-634d2dcf4c58 tempest-VolumesSnapshotTestJSON-1776725678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:35:09 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-0b3d10aa-60fe-421a-8a0b-634d2dcf4c58 tempest-VolumesSnapshotTestJSON-1776725678 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:35:09 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-0b3d10aa-60fe-421a-8a0b-634d2dcf4c58 tempest-VolumesSnapshotTestJSON-1776725678 None] Acquiring lock "cinder-quobyte-a148e505-845b-493c-a680-460dfaa6334d" by "_copy_volume_from_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:35:09 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-0b3d10aa-60fe-421a-8a0b-634d2dcf4c58 tempest-VolumesSnapshotTestJSON-1776725678 None] Lock "cinder-quobyte-a148e505-845b-493c-a680-460dfaa6334d" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:35:09 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-0b3d10aa-60fe-421a-8a0b-634d2dcf4c58 tempest-VolumesSnapshotTestJSON-1776725678 None] snapshot: 9eb519ba-55c3-43db-a063-c70407f54240, volume: a148e505-845b-493c-a680-460dfaa6334d, {{(pid=94394) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 26 14:35:09 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-0b3d10aa-60fe-421a-8a0b-634d2dcf4c58 tempest-VolumesSnapshotTestJSON-1776725678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:35:09 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-0b3d10aa-60fe-421a-8a0b-634d2dcf4c58 tempest-VolumesSnapshotTestJSON-1776725678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:35:09 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-0b3d10aa-60fe-421a-8a0b-634d2dcf4c58 tempest-VolumesSnapshotTestJSON-1776725678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:35:09 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-0b3d10aa-60fe-421a-8a0b-634d2dcf4c58 tempest-VolumesSnapshotTestJSON-1776725678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:35:09 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-0b3d10aa-60fe-421a-8a0b-634d2dcf4c58 tempest-VolumesSnapshotTestJSON-1776725678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:35:09 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8a29fd5-62ea-474e-9f10-8ee398c87c1b]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:35:09 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-0b3d10aa-60fe-421a-8a0b-634d2dcf4c58 tempest-VolumesSnapshotTestJSON-1776725678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-648711f8-e553-4576-84e1-c1cf81afef7c.9eb519ba-55c3-43db-a063-c70407f54240 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:35:09 devstack sudo[109378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-648711f8-e553-4576-84e1-c1cf81afef7c.9eb519ba-55c3-43db-a063-c70407f54240 Aug 26 14:35:09 devstack sudo[109378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:35:09 devstack sudo[109378]: pam_unix(sudo:session): session closed for user root Aug 26 14:35:09 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-0b3d10aa-60fe-421a-8a0b-634d2dcf4c58 tempest-VolumesSnapshotTestJSON-1776725678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-648711f8-e553-4576-84e1-c1cf81afef7c.9eb519ba-55c3-43db-a063-c70407f54240" returned: 0 in 0.483s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:35:09 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-0b3d10aa-60fe-421a-8a0b-634d2dcf4c58 tempest-VolumesSnapshotTestJSON-1776725678 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-648711f8-e553-4576-84e1-c1cf81afef7c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94394) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 14:35:09 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[586bc32e-d1fb-428a-bc5b-6a484df7489f]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:35:09 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-0b3d10aa-60fe-421a-8a0b-634d2dcf4c58 tempest-VolumesSnapshotTestJSON-1776725678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-648711f8-e553-4576-84e1-c1cf81afef7c {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:35:10 devstack sudo[109390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-648711f8-e553-4576-84e1-c1cf81afef7c Aug 26 14:35:10 devstack sudo[109390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:35:10 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [req-0f37c10b-f612-41d3-8a71-dd5cff503b11 req-8e711620-d268-43b7-92b7-f35be72b51ec tempest-TestInstancesWithCinderVolumes-1323272046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:35:10 devstack sudo[109390]: pam_unix(sudo:session): session closed for user root Aug 26 14:35:10 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-0b3d10aa-60fe-421a-8a0b-634d2dcf4c58 tempest-VolumesSnapshotTestJSON-1776725678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-648711f8-e553-4576-84e1-c1cf81afef7c" returned: 0 in 0.497s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:35:10 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-0b3d10aa-60fe-421a-8a0b-634d2dcf4c58 tempest-VolumesSnapshotTestJSON-1776725678 None] will copy from snapshot at /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-648711f8-e553-4576-84e1-c1cf81afef7c {{(pid=94394) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 26 14:35:10 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-0b3d10aa-60fe-421a-8a0b-634d2dcf4c58 tempest-VolumesSnapshotTestJSON-1776725678 None] Creating direct copy from snapshot {{(pid=94394) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 26 14:35:10 devstack cinder-volume[94394]: DEBUG cinder.utils [None req-0b3d10aa-60fe-421a-8a0b-634d2dcf4c58 tempest-VolumesSnapshotTestJSON-1776725678 None] Path /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-a148e505-845b-493c-a680-460dfaa6334d not found in is_blk_device check {{(pid=94394) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 26 14:35:10 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-0b3d10aa-60fe-421a-8a0b-634d2dcf4c58 tempest-VolumesSnapshotTestJSON-1776725678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-648711f8-e553-4576-84e1-c1cf81afef7c /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-a148e505-845b-493c-a680-460dfaa6334d {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:35:10 devstack sudo[109402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-648711f8-e553-4576-84e1-c1cf81afef7c /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-a148e505-845b-493c-a680-460dfaa6334d Aug 26 14:35:10 devstack sudo[109402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:35:16 devstack sudo[109402]: pam_unix(sudo:session): session closed for user root Aug 26 14:35:16 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-0b3d10aa-60fe-421a-8a0b-634d2dcf4c58 tempest-VolumesSnapshotTestJSON-1776725678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-648711f8-e553-4576-84e1-c1cf81afef7c /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-a148e505-845b-493c-a680-460dfaa6334d" returned: 0 in 5.903s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:35:16 devstack cinder-volume[94394]: DEBUG cinder.image.image_utils [None req-0b3d10aa-60fe-421a-8a0b-634d2dcf4c58 tempest-VolumesSnapshotTestJSON-1776725678 None] Image conversion details: src /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-648711f8-e553-4576-84e1-c1cf81afef7c, size 1024.00 MB, duration 5.90 sec, destination /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-a148e505-845b-493c-a680-460dfaa6334d {{(pid=94394) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 14:35:16 devstack cinder-volume[94394]: INFO cinder.image.image_utils [None req-0b3d10aa-60fe-421a-8a0b-634d2dcf4c58 tempest-VolumesSnapshotTestJSON-1776725678 None] Converted 1024.00 MB image at 173.42 MB/s Aug 26 14:35:16 devstack cinder-volume[94394]: WARNING cinder.volume.drivers.remotefs [None req-0b3d10aa-60fe-421a-8a0b-634d2dcf4c58 tempest-VolumesSnapshotTestJSON-1776725678 None] /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-a148e505-845b-493c-a680-460dfaa6334d is being set with open permissions: ugo+rw Aug 26 14:35:16 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-0b3d10aa-60fe-421a-8a0b-634d2dcf4c58 tempest-VolumesSnapshotTestJSON-1776725678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-a148e505-845b-493c-a680-460dfaa6334d {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:35:16 devstack sudo[109482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-a148e505-845b-493c-a680-460dfaa6334d Aug 26 14:35:16 devstack sudo[109482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:35:16 devstack sudo[109482]: pam_unix(sudo:session): session closed for user root Aug 26 14:35:16 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-0b3d10aa-60fe-421a-8a0b-634d2dcf4c58 tempest-VolumesSnapshotTestJSON-1776725678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-a148e505-845b-493c-a680-460dfaa6334d" returned: 0 in 0.452s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:35:16 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-0b3d10aa-60fe-421a-8a0b-634d2dcf4c58 tempest-VolumesSnapshotTestJSON-1776725678 None] Lock "cinder-quobyte-a148e505-845b-493c-a680-460dfaa6334d" released by "_copy_volume_from_snapshot" :: held 7.461s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:35:16 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-0b3d10aa-60fe-421a-8a0b-634d2dcf4c58 tempest-VolumesSnapshotTestJSON-1776725678 None] Lock "cinder-quobyte-9eb519ba-55c3-43db-a063-c70407f54240-a148e505-845b-493c-a680-460dfaa6334d" released by "_create_volume_from_snapshot" :: held 7.540s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:35:16 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-0b3d10aa-60fe-421a-8a0b-634d2dcf4c58 tempest-VolumesSnapshotTestJSON-1776725678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.564s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:35:16 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [req-0f37c10b-f612-41d3-8a71-dd5cff503b11 req-8e711620-d268-43b7-92b7-f35be72b51ec tempest-TestInstancesWithCinderVolumes-1323272046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 6.695s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:35:16 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [req-0f37c10b-f612-41d3-8a71-dd5cff503b11 req-8e711620-d268-43b7-92b7-f35be72b51ec tempest-TestInstancesWithCinderVolumes-1323272046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.042s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:35:16 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-0b3d10aa-60fe-421a-8a0b-634d2dcf4c58 tempest-VolumesSnapshotTestJSON-1776725678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d722d82-432b-4dfb-afd5-9df396b1f423) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a148e505-845b-493c-a680-460dfaa6334d', 'volume_size': 1, 'snapshot_id': '9eb519ba-55c3-43db-a063-c70407f54240'}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:35:16 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-0b3d10aa-60fe-421a-8a0b-634d2dcf4c58 tempest-VolumesSnapshotTestJSON-1776725678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddf1a642-6c71-46ab-b50f-e3428e49e4e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:35:16 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-0b3d10aa-60fe-421a-8a0b-634d2dcf4c58 tempest-VolumesSnapshotTestJSON-1776725678 None] Volume volume-a148e505-845b-493c-a680-460dfaa6334d (a148e505-845b-493c-a680-460dfaa6334d): created successfully Aug 26 14:35:17 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-0b3d10aa-60fe-421a-8a0b-634d2dcf4c58 tempest-VolumesSnapshotTestJSON-1776725678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddf1a642-6c71-46ab-b50f-e3428e49e4e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:35:17 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-0b3d10aa-60fe-421a-8a0b-634d2dcf4c58 tempest-VolumesSnapshotTestJSON-1776725678 None] Flow 'volume_create_manager' (5c0448d1-e6f9-4cc3-a261-ebe94c214f3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:35:17 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [req-0f37c10b-f612-41d3-8a71-dd5cff503b11 req-8e711620-d268-43b7-92b7-f35be72b51ec tempest-TestInstancesWithCinderVolumes-1323272046 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b', 'name': 'volume-66ce87d3-338e-48f9-843f-fe55e4d24e3c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3637781c-937f-4d3f-9929-a4dcb2fec444', 'enforce_multipath': True} {{(pid=94394) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 14:35:17 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-0b3d10aa-60fe-421a-8a0b-634d2dcf4c58 tempest-VolumesSnapshotTestJSON-1776725678 None] Created volume successfully. Aug 26 14:35:17 devstack cinder-volume[94394]: INFO cinder.volume.manager [req-0f37c10b-f612-41d3-8a71-dd5cff503b11 req-8e711620-d268-43b7-92b7-f35be72b51ec tempest-TestInstancesWithCinderVolumes-1323272046 None] attachment_update completed successfully. Aug 26 14:35:17 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-6c492951-f2cb-4884-b99e-d7e75f254aec tempest-VolumesSnapshotTestJSON-1776725678 None] Acquiring lock "cinder-a148e505-845b-493c-a680-460dfaa6334d-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:35:17 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-6c492951-f2cb-4884-b99e-d7e75f254aec tempest-VolumesSnapshotTestJSON-1776725678 None] Lock "cinder-a148e505-845b-493c-a680-460dfaa6334d-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:35:17 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-6c492951-f2cb-4884-b99e-d7e75f254aec tempest-VolumesSnapshotTestJSON-1776725678 None] Acquiring lock "cinder-quobyte-a148e505-845b-493c-a680-460dfaa6334d" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:35:17 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-6c492951-f2cb-4884-b99e-d7e75f254aec tempest-VolumesSnapshotTestJSON-1776725678 None] Lock "cinder-quobyte-a148e505-845b-493c-a680-460dfaa6334d" acquired by "delete_volume" :: waited 0.020s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:35:17 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[496be320-651c-481b-b285-8d0b7b1ccb35]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:35:17 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-6c492951-f2cb-4884-b99e-d7e75f254aec tempest-VolumesSnapshotTestJSON-1776725678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-a148e505-845b-493c-a680-460dfaa6334d {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:35:17 devstack sudo[109527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-a148e505-845b-493c-a680-460dfaa6334d Aug 26 14:35:17 devstack sudo[109527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:35:18 devstack sudo[109527]: pam_unix(sudo:session): session closed for user root Aug 26 14:35:18 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-6c492951-f2cb-4884-b99e-d7e75f254aec tempest-VolumesSnapshotTestJSON-1776725678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-a148e505-845b-493c-a680-460dfaa6334d" returned: 0 in 0.876s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:35:18 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-6c492951-f2cb-4884-b99e-d7e75f254aec tempest-VolumesSnapshotTestJSON-1776725678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-a148e505-845b-493c-a680-460dfaa6334d {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:35:18 devstack sudo[109554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-a148e505-845b-493c-a680-460dfaa6334d Aug 26 14:35:18 devstack sudo[109554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:35:19 devstack sudo[109554]: pam_unix(sudo:session): session closed for user root Aug 26 14:35:19 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-6c492951-f2cb-4884-b99e-d7e75f254aec tempest-VolumesSnapshotTestJSON-1776725678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-a148e505-845b-493c-a680-460dfaa6334d" returned: 0 in 0.800s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:35:19 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-6c492951-f2cb-4884-b99e-d7e75f254aec tempest-VolumesSnapshotTestJSON-1776725678 None] Lock "cinder-quobyte-a148e505-845b-493c-a680-460dfaa6334d" released by "delete_volume" :: held 1.771s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:35:19 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-6c492951-f2cb-4884-b99e-d7e75f254aec tempest-VolumesSnapshotTestJSON-1776725678 None] Created reservations ['201a63be-6992-492d-b3c5-dac12cdd64f4', '94f098a2-e3b2-4e8a-83a0-2e72bacffc97', 'b2c64253-1606-4304-ab41-6deab621b549', 'df087fba-9b06-4c9b-8e31-6569b3036953'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:35:19 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-6c492951-f2cb-4884-b99e-d7e75f254aec tempest-VolumesSnapshotTestJSON-1776725678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:35:19 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-6c492951-f2cb-4884-b99e-d7e75f254aec tempest-VolumesSnapshotTestJSON-1776725678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:35:19 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-6c492951-f2cb-4884-b99e-d7e75f254aec tempest-VolumesSnapshotTestJSON-1776725678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:35:19 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-6c492951-f2cb-4884-b99e-d7e75f254aec tempest-VolumesSnapshotTestJSON-1776725678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:35:19 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-6c492951-f2cb-4884-b99e-d7e75f254aec tempest-VolumesSnapshotTestJSON-1776725678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:35:19 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-6c492951-f2cb-4884-b99e-d7e75f254aec tempest-VolumesSnapshotTestJSON-1776725678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:35:19 devstack sudo[109567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:35:19 devstack sudo[109567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:35:20 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-4a5e8fad-0b02-4697-8f36-c0b91a7426d3 tempest-VolumesSnapshotTestJSON-1776725678 None] Acquiring lock "cinder-9eb519ba-55c3-43db-a063-c70407f54240-delete_snapshot" by "delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:35:20 devstack sudo[109567]: pam_unix(sudo:session): session closed for user root Aug 26 14:35:20 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-6c492951-f2cb-4884-b99e-d7e75f254aec tempest-VolumesSnapshotTestJSON-1776725678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.384s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:35:20 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-6c492951-f2cb-4884-b99e-d7e75f254aec tempest-VolumesSnapshotTestJSON-1776725678 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:35:20 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-6c492951-f2cb-4884-b99e-d7e75f254aec tempest-VolumesSnapshotTestJSON-1776725678 None] Deleted volume successfully. Aug 26 14:35:20 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-4a5e8fad-0b02-4697-8f36-c0b91a7426d3 tempest-VolumesSnapshotTestJSON-1776725678 None] Lock "cinder-9eb519ba-55c3-43db-a063-c70407f54240-delete_snapshot" acquired by "delete_snapshot" :: waited 0.073s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:35:20 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-4a5e8fad-0b02-4697-8f36-c0b91a7426d3 tempest-VolumesSnapshotTestJSON-1776725678 None] Acquiring lock "cinder-quobyte-648711f8-e553-4576-84e1-c1cf81afef7c" by "delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:35:20 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-6c492951-f2cb-4884-b99e-d7e75f254aec tempest-VolumesSnapshotTestJSON-1776725678 None] Lock "cinder-a148e505-845b-493c-a680-460dfaa6334d-delete_volume" released by "delete_volume" :: held 2.686s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:35:20 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-4a5e8fad-0b02-4697-8f36-c0b91a7426d3 tempest-VolumesSnapshotTestJSON-1776725678 None] Lock "cinder-quobyte-648711f8-e553-4576-84e1-c1cf81afef7c" acquired by "delete_snapshot" :: waited 0.035s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:35:20 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-4a5e8fad-0b02-4697-8f36-c0b91a7426d3 tempest-VolumesSnapshotTestJSON-1776725678 None] Acquiring lock "cinder-quobyte-9eb519ba-55c3-43db-a063-c70407f54240" by "_delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:35:20 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-4a5e8fad-0b02-4697-8f36-c0b91a7426d3 tempest-VolumesSnapshotTestJSON-1776725678 None] Lock "cinder-quobyte-9eb519ba-55c3-43db-a063-c70407f54240" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:35:20 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-4a5e8fad-0b02-4697-8f36-c0b91a7426d3 tempest-VolumesSnapshotTestJSON-1776725678 None] Deleting offline snapshot 9eb519ba-55c3-43db-a063-c70407f54240 of volume 648711f8-e553-4576-84e1-c1cf81afef7c {{(pid=94394) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 14:35:20 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-4a5e8fad-0b02-4697-8f36-c0b91a7426d3 tempest-VolumesSnapshotTestJSON-1776725678 None] snapshot_file for this snap is: volume-648711f8-e553-4576-84e1-c1cf81afef7c.9eb519ba-55c3-43db-a063-c70407f54240 {{(pid=94394) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 14:35:20 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[7852cabd-845a-4e69-ad12-44e2941bdec9]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:35:20 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4a5e8fad-0b02-4697-8f36-c0b91a7426d3 tempest-VolumesSnapshotTestJSON-1776725678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-648711f8-e553-4576-84e1-c1cf81afef7c.9eb519ba-55c3-43db-a063-c70407f54240 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:35:20 devstack sudo[109575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-648711f8-e553-4576-84e1-c1cf81afef7c.9eb519ba-55c3-43db-a063-c70407f54240 Aug 26 14:35:20 devstack sudo[109575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:35:21 devstack cinder-volume[94394]: INFO cinder.volume.manager [req-5f83db8a-e4ac-4779-9dad-eb98bd26cf2e req-dd18449d-e1f2-4b4e-8df2-e0952731513e tempest-TestShelveInstance-576226965 None] Terminate volume connection completed successfully. Aug 26 14:35:21 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [req-5f83db8a-e4ac-4779-9dad-eb98bd26cf2e req-dd18449d-e1f2-4b4e-8df2-e0952731513e tempest-TestShelveInstance-576226965 None] Deleting attachment 6a3e025f-73fd-43e2-94d6-050cff749954. {{(pid=94394) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 14:35:21 devstack sudo[109575]: pam_unix(sudo:session): session closed for user root Aug 26 14:35:21 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4a5e8fad-0b02-4697-8f36-c0b91a7426d3 tempest-VolumesSnapshotTestJSON-1776725678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-648711f8-e553-4576-84e1-c1cf81afef7c.9eb519ba-55c3-43db-a063-c70407f54240" returned: 0 in 1.029s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:35:21 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-4a5e8fad-0b02-4697-8f36-c0b91a7426d3 tempest-VolumesSnapshotTestJSON-1776725678 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-648711f8-e553-4576-84e1-c1cf81afef7c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94394) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 14:35:21 devstack cinder-volume[94394]: DEBUG cinder.coordination [req-5f83db8a-e4ac-4779-9dad-eb98bd26cf2e req-36fc45c9-9d62-4266-985c-ace609c8c9ed tempest-TestShelveInstance-576226965 None] Acquiring lock "cinder-3b7c1dab-36c9-4a0a-a516-ee8e96311a19-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:35:21 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[c00f670c-5f09-4728-9b2e-cfca5e61ba3b]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:35:21 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4a5e8fad-0b02-4697-8f36-c0b91a7426d3 tempest-VolumesSnapshotTestJSON-1776725678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-648711f8-e553-4576-84e1-c1cf81afef7c {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:35:21 devstack cinder-volume[94394]: DEBUG cinder.coordination [req-5f83db8a-e4ac-4779-9dad-eb98bd26cf2e req-36fc45c9-9d62-4266-985c-ace609c8c9ed tempest-TestShelveInstance-576226965 None] Lock "cinder-3b7c1dab-36c9-4a0a-a516-ee8e96311a19-delete_volume" acquired by "delete_volume" :: waited 0.091s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:35:21 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [req-ac3369d9-7297-4b51-a9a8-db57e82eb147 req-d19246f4-06d2-4469-a7e7-3d8a301bfdc7 tempest-TestInstancesWithCinderVolumes-1323272046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:35:21 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [req-ac3369d9-7297-4b51-a9a8-db57e82eb147 req-d19246f4-06d2-4469-a7e7-3d8a301bfdc7 tempest-TestInstancesWithCinderVolumes-1323272046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:35:21 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [req-ac3369d9-7297-4b51-a9a8-db57e82eb147 req-d19246f4-06d2-4469-a7e7-3d8a301bfdc7 tempest-TestInstancesWithCinderVolumes-1323272046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.036s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:35:21 devstack cinder-volume[94394]: DEBUG cinder.coordination [req-5f83db8a-e4ac-4779-9dad-eb98bd26cf2e req-36fc45c9-9d62-4266-985c-ace609c8c9ed tempest-TestShelveInstance-576226965 None] Acquiring lock "cinder-quobyte-3b7c1dab-36c9-4a0a-a516-ee8e96311a19" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:35:21 devstack cinder-volume[94394]: DEBUG cinder.coordination [req-5f83db8a-e4ac-4779-9dad-eb98bd26cf2e req-36fc45c9-9d62-4266-985c-ace609c8c9ed tempest-TestShelveInstance-576226965 None] Lock "cinder-quobyte-3b7c1dab-36c9-4a0a-a516-ee8e96311a19" acquired by "delete_volume" :: waited 0.039s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:35:21 devstack sudo[109589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-648711f8-e553-4576-84e1-c1cf81afef7c Aug 26 14:35:21 devstack sudo[109589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:35:21 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [req-ac3369d9-7297-4b51-a9a8-db57e82eb147 req-d19246f4-06d2-4469-a7e7-3d8a301bfdc7 tempest-TestInstancesWithCinderVolumes-1323272046 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b', 'name': 'volume-3c9fe106-7525-49da-9ba9-6b2bb78ddb19', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3e3edf35-2777-4a40-be6f-db82d7f36195', 'enforce_multipath': True} {{(pid=94394) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 14:35:21 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[a85db03d-10c4-4b3b-b5a5-187007f6bf36]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:35:21 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [req-5f83db8a-e4ac-4779-9dad-eb98bd26cf2e req-36fc45c9-9d62-4266-985c-ace609c8c9ed tempest-TestShelveInstance-576226965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3b7c1dab-36c9-4a0a-a516-ee8e96311a19 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:35:21 devstack cinder-volume[94394]: INFO cinder.volume.manager [req-ac3369d9-7297-4b51-a9a8-db57e82eb147 req-d19246f4-06d2-4469-a7e7-3d8a301bfdc7 tempest-TestInstancesWithCinderVolumes-1323272046 None] attachment_update completed successfully. Aug 26 14:35:21 devstack sudo[109591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3b7c1dab-36c9-4a0a-a516-ee8e96311a19 Aug 26 14:35:21 devstack sudo[109591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:35:22 devstack sudo[109589]: pam_unix(sudo:session): session closed for user root Aug 26 14:35:22 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4a5e8fad-0b02-4697-8f36-c0b91a7426d3 tempest-VolumesSnapshotTestJSON-1776725678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-648711f8-e553-4576-84e1-c1cf81afef7c" returned: 0 in 1.039s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:35:22 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4a5e8fad-0b02-4697-8f36-c0b91a7426d3 tempest-VolumesSnapshotTestJSON-1776725678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-648711f8-e553-4576-84e1-c1cf81afef7c.9eb519ba-55c3-43db-a063-c70407f54240 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:35:22 devstack sudo[109605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-648711f8-e553-4576-84e1-c1cf81afef7c.9eb519ba-55c3-43db-a063-c70407f54240 Aug 26 14:35:22 devstack sudo[109605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:35:22 devstack sudo[109591]: pam_unix(sudo:session): session closed for user root Aug 26 14:35:22 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [req-5f83db8a-e4ac-4779-9dad-eb98bd26cf2e req-36fc45c9-9d62-4266-985c-ace609c8c9ed tempest-TestShelveInstance-576226965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3b7c1dab-36c9-4a0a-a516-ee8e96311a19" returned: 0 in 0.850s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:35:22 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [req-5f83db8a-e4ac-4779-9dad-eb98bd26cf2e req-36fc45c9-9d62-4266-985c-ace609c8c9ed tempest-TestShelveInstance-576226965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3b7c1dab-36c9-4a0a-a516-ee8e96311a19 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:35:22 devstack sudo[109607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3b7c1dab-36c9-4a0a-a516-ee8e96311a19 Aug 26 14:35:22 devstack sudo[109607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:35:23 devstack sudo[109607]: pam_unix(sudo:session): session closed for user root Aug 26 14:35:23 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [req-5f83db8a-e4ac-4779-9dad-eb98bd26cf2e req-36fc45c9-9d62-4266-985c-ace609c8c9ed tempest-TestShelveInstance-576226965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3b7c1dab-36c9-4a0a-a516-ee8e96311a19" returned: 0 in 0.512s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:35:23 devstack cinder-volume[94394]: DEBUG cinder.coordination [req-5f83db8a-e4ac-4779-9dad-eb98bd26cf2e req-36fc45c9-9d62-4266-985c-ace609c8c9ed tempest-TestShelveInstance-576226965 None] Lock "cinder-quobyte-3b7c1dab-36c9-4a0a-a516-ee8e96311a19" released by "delete_volume" :: held 1.470s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:35:23 devstack cinder-volume[94394]: DEBUG cinder.quota [req-5f83db8a-e4ac-4779-9dad-eb98bd26cf2e req-36fc45c9-9d62-4266-985c-ace609c8c9ed tempest-TestShelveInstance-576226965 None] Created reservations ['9f0a3a44-b0c4-48d6-b8d2-ea845890cdcb', '5dc8538b-ac38-455d-bc7c-b4e0d4235e62', '016329a7-ea6a-48c8-a535-b9093fe2c5b3', '7789e6ed-a55a-49b9-b621-69c3c039d1be'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:35:23 devstack sudo[109605]: pam_unix(sudo:session): session closed for user root Aug 26 14:35:23 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4a5e8fad-0b02-4697-8f36-c0b91a7426d3 tempest-VolumesSnapshotTestJSON-1776725678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-648711f8-e553-4576-84e1-c1cf81afef7c.9eb519ba-55c3-43db-a063-c70407f54240" returned: 0 in 0.915s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:35:23 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4a5e8fad-0b02-4697-8f36-c0b91a7426d3 tempest-VolumesSnapshotTestJSON-1776725678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-648711f8-e553-4576-84e1-c1cf81afef7c.9eb519ba-55c3-43db-a063-c70407f54240 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:35:23 devstack sudo[109615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-648711f8-e553-4576-84e1-c1cf81afef7c.9eb519ba-55c3-43db-a063-c70407f54240 Aug 26 14:35:23 devstack sudo[109615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:35:23 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [req-5f83db8a-e4ac-4779-9dad-eb98bd26cf2e req-36fc45c9-9d62-4266-985c-ace609c8c9ed tempest-TestShelveInstance-576226965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:35:23 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [req-5f83db8a-e4ac-4779-9dad-eb98bd26cf2e req-36fc45c9-9d62-4266-985c-ace609c8c9ed tempest-TestShelveInstance-576226965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:35:23 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [req-5f83db8a-e4ac-4779-9dad-eb98bd26cf2e req-36fc45c9-9d62-4266-985c-ace609c8c9ed tempest-TestShelveInstance-576226965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:35:23 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [req-5f83db8a-e4ac-4779-9dad-eb98bd26cf2e req-36fc45c9-9d62-4266-985c-ace609c8c9ed tempest-TestShelveInstance-576226965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:35:23 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [req-5f83db8a-e4ac-4779-9dad-eb98bd26cf2e req-36fc45c9-9d62-4266-985c-ace609c8c9ed tempest-TestShelveInstance-576226965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:35:23 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [req-5f83db8a-e4ac-4779-9dad-eb98bd26cf2e req-36fc45c9-9d62-4266-985c-ace609c8c9ed tempest-TestShelveInstance-576226965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:35:23 devstack sudo[109617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:35:23 devstack sudo[109617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:35:23 devstack sudo[109615]: pam_unix(sudo:session): session closed for user root Aug 26 14:35:24 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4a5e8fad-0b02-4697-8f36-c0b91a7426d3 tempest-VolumesSnapshotTestJSON-1776725678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-648711f8-e553-4576-84e1-c1cf81afef7c.9eb519ba-55c3-43db-a063-c70407f54240" returned: 0 in 0.586s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:35:24 devstack sudo[109617]: pam_unix(sudo:session): session closed for user root Aug 26 14:35:24 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [req-5f83db8a-e4ac-4779-9dad-eb98bd26cf2e req-36fc45c9-9d62-4266-985c-ace609c8c9ed tempest-TestShelveInstance-576226965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.493s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:35:24 devstack cinder-volume[94394]: DEBUG cinder.manager [req-5f83db8a-e4ac-4779-9dad-eb98bd26cf2e req-36fc45c9-9d62-4266-985c-ace609c8c9ed tempest-TestShelveInstance-576226965 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:35:24 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-4a5e8fad-0b02-4697-8f36-c0b91a7426d3 tempest-VolumesSnapshotTestJSON-1776725678 None] Lock "cinder-quobyte-9eb519ba-55c3-43db-a063-c70407f54240" released by "_delete_snapshot" :: held 3.815s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:35:24 devstack cinder-volume[94394]: INFO cinder.volume.manager [req-5f83db8a-e4ac-4779-9dad-eb98bd26cf2e req-36fc45c9-9d62-4266-985c-ace609c8c9ed tempest-TestShelveInstance-576226965 None] Deleted volume successfully. Aug 26 14:35:24 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-4a5e8fad-0b02-4697-8f36-c0b91a7426d3 tempest-VolumesSnapshotTestJSON-1776725678 None] Lock "cinder-quobyte-648711f8-e553-4576-84e1-c1cf81afef7c" released by "delete_snapshot" :: held 3.864s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:35:24 devstack cinder-volume[94394]: DEBUG cinder.coordination [req-5f83db8a-e4ac-4779-9dad-eb98bd26cf2e req-36fc45c9-9d62-4266-985c-ace609c8c9ed tempest-TestShelveInstance-576226965 None] Lock "cinder-3b7c1dab-36c9-4a0a-a516-ee8e96311a19-delete_volume" released by "delete_volume" :: held 2.603s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:35:24 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-4a5e8fad-0b02-4697-8f36-c0b91a7426d3 tempest-VolumesSnapshotTestJSON-1776725678 None] Created reservations ['94b6a28c-45f4-43fb-99e4-43a7d44123d4', 'bc9ef87f-40fd-4e26-be27-2a558675e595', '527837c3-958e-4092-8b62-ec5f6230eb21', '2ad6ee46-7345-4cfd-8f02-2e990adec48c'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:35:24 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-4a5e8fad-0b02-4697-8f36-c0b91a7426d3 tempest-VolumesSnapshotTestJSON-1776725678 None] Delete snapshot completed successfully. Aug 26 14:35:24 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-4a5e8fad-0b02-4697-8f36-c0b91a7426d3 tempest-VolumesSnapshotTestJSON-1776725678 None] Lock "cinder-9eb519ba-55c3-43db-a063-c70407f54240-delete_snapshot" released by "delete_snapshot" :: held 4.067s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:35:24 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-56567c99-034d-45bb-a294-d907c5c87060 tempest-VolumesSnapshotTestJSON-1776725678 None] Acquiring lock "cinder-648711f8-e553-4576-84e1-c1cf81afef7c-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:35:24 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-56567c99-034d-45bb-a294-d907c5c87060 tempest-VolumesSnapshotTestJSON-1776725678 None] Lock "cinder-648711f8-e553-4576-84e1-c1cf81afef7c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:35:24 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-56567c99-034d-45bb-a294-d907c5c87060 tempest-VolumesSnapshotTestJSON-1776725678 None] Acquiring lock "cinder-quobyte-648711f8-e553-4576-84e1-c1cf81afef7c" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:35:24 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-56567c99-034d-45bb-a294-d907c5c87060 tempest-VolumesSnapshotTestJSON-1776725678 None] Lock "cinder-quobyte-648711f8-e553-4576-84e1-c1cf81afef7c" acquired by "delete_volume" :: waited 0.037s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:35:24 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[139d6622-623b-4ac3-8d8b-e8856ebb1fc6]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:35:24 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-56567c99-034d-45bb-a294-d907c5c87060 tempest-VolumesSnapshotTestJSON-1776725678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-648711f8-e553-4576-84e1-c1cf81afef7c {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:35:25 devstack sudo[109629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-648711f8-e553-4576-84e1-c1cf81afef7c Aug 26 14:35:25 devstack sudo[109629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:35:25 devstack sudo[109629]: pam_unix(sudo:session): session closed for user root Aug 26 14:35:25 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-56567c99-034d-45bb-a294-d907c5c87060 tempest-VolumesSnapshotTestJSON-1776725678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-648711f8-e553-4576-84e1-c1cf81afef7c" returned: 0 in 0.517s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:35:25 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-56567c99-034d-45bb-a294-d907c5c87060 tempest-VolumesSnapshotTestJSON-1776725678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-648711f8-e553-4576-84e1-c1cf81afef7c {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:35:25 devstack sudo[109634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-648711f8-e553-4576-84e1-c1cf81afef7c Aug 26 14:35:25 devstack sudo[109634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:35:25 devstack sudo[109634]: pam_unix(sudo:session): session closed for user root Aug 26 14:35:25 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-56567c99-034d-45bb-a294-d907c5c87060 tempest-VolumesSnapshotTestJSON-1776725678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-648711f8-e553-4576-84e1-c1cf81afef7c" returned: 0 in 0.347s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:35:25 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-56567c99-034d-45bb-a294-d907c5c87060 tempest-VolumesSnapshotTestJSON-1776725678 None] Lock "cinder-quobyte-648711f8-e553-4576-84e1-c1cf81afef7c" released by "delete_volume" :: held 0.938s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:35:25 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-56567c99-034d-45bb-a294-d907c5c87060 tempest-VolumesSnapshotTestJSON-1776725678 None] Created reservations ['46f1fa88-fdbb-45cf-a259-6eb84a7afcd6', '08d4fdaf-fa06-4cbf-a664-04c4ec562f67', '9927208d-b286-433f-bd4e-99291c09d515', '911f1705-df97-45f3-ba66-224d3f9b0b19'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:35:25 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-56567c99-034d-45bb-a294-d907c5c87060 tempest-VolumesSnapshotTestJSON-1776725678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:35:25 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-56567c99-034d-45bb-a294-d907c5c87060 tempest-VolumesSnapshotTestJSON-1776725678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:35:25 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-56567c99-034d-45bb-a294-d907c5c87060 tempest-VolumesSnapshotTestJSON-1776725678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:35:25 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-56567c99-034d-45bb-a294-d907c5c87060 tempest-VolumesSnapshotTestJSON-1776725678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:35:25 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-56567c99-034d-45bb-a294-d907c5c87060 tempest-VolumesSnapshotTestJSON-1776725678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:35:25 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-56567c99-034d-45bb-a294-d907c5c87060 tempest-VolumesSnapshotTestJSON-1776725678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:35:26 devstack sudo[109638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:35:26 devstack sudo[109638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:35:26 devstack sudo[109638]: pam_unix(sudo:session): session closed for user root Aug 26 14:35:26 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-56567c99-034d-45bb-a294-d907c5c87060 tempest-VolumesSnapshotTestJSON-1776725678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.299s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:35:26 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-56567c99-034d-45bb-a294-d907c5c87060 tempest-VolumesSnapshotTestJSON-1776725678 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:35:26 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-56567c99-034d-45bb-a294-d907c5c87060 tempest-VolumesSnapshotTestJSON-1776725678 None] Deleted volume successfully. Aug 26 14:35:26 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-56567c99-034d-45bb-a294-d907c5c87060 tempest-VolumesSnapshotTestJSON-1776725678 None] Lock "cinder-648711f8-e553-4576-84e1-c1cf81afef7c-delete_volume" released by "delete_volume" :: held 1.583s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:35:27 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-adbb767f-1d77-4916-8955-54a21d3a0fba tempest-VolumesSnapshotTestJSON-1776725678 None] Acquiring lock "cinder-e956e503-1b64-4c95-8307-ab2ec29a69b8-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:35:27 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-adbb767f-1d77-4916-8955-54a21d3a0fba tempest-VolumesSnapshotTestJSON-1776725678 None] Lock "cinder-e956e503-1b64-4c95-8307-ab2ec29a69b8-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:35:27 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-adbb767f-1d77-4916-8955-54a21d3a0fba tempest-VolumesSnapshotTestJSON-1776725678 None] Acquiring lock "cinder-quobyte-e956e503-1b64-4c95-8307-ab2ec29a69b8" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:35:27 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-adbb767f-1d77-4916-8955-54a21d3a0fba tempest-VolumesSnapshotTestJSON-1776725678 None] Lock "cinder-quobyte-e956e503-1b64-4c95-8307-ab2ec29a69b8" acquired by "delete_volume" :: waited 0.014s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:35:27 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad72b2a3-7c44-43c6-8706-92f679c5fdd0]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:35:27 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-adbb767f-1d77-4916-8955-54a21d3a0fba tempest-VolumesSnapshotTestJSON-1776725678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-e956e503-1b64-4c95-8307-ab2ec29a69b8 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:35:27 devstack sudo[109650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-e956e503-1b64-4c95-8307-ab2ec29a69b8 Aug 26 14:35:27 devstack sudo[109650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:35:27 devstack sudo[109650]: pam_unix(sudo:session): session closed for user root Aug 26 14:35:27 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-adbb767f-1d77-4916-8955-54a21d3a0fba tempest-VolumesSnapshotTestJSON-1776725678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-e956e503-1b64-4c95-8307-ab2ec29a69b8" returned: 0 in 0.629s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:35:27 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-adbb767f-1d77-4916-8955-54a21d3a0fba tempest-VolumesSnapshotTestJSON-1776725678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-e956e503-1b64-4c95-8307-ab2ec29a69b8 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:35:27 devstack sudo[109666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-e956e503-1b64-4c95-8307-ab2ec29a69b8 Aug 26 14:35:27 devstack sudo[109666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:35:28 devstack sudo[109666]: pam_unix(sudo:session): session closed for user root Aug 26 14:35:28 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-adbb767f-1d77-4916-8955-54a21d3a0fba tempest-VolumesSnapshotTestJSON-1776725678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-e956e503-1b64-4c95-8307-ab2ec29a69b8" returned: 0 in 0.298s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:35:28 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-adbb767f-1d77-4916-8955-54a21d3a0fba tempest-VolumesSnapshotTestJSON-1776725678 None] Lock "cinder-quobyte-e956e503-1b64-4c95-8307-ab2ec29a69b8" released by "delete_volume" :: held 1.009s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:35:28 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-adbb767f-1d77-4916-8955-54a21d3a0fba tempest-VolumesSnapshotTestJSON-1776725678 None] Created reservations ['ef348c11-123f-4236-9eed-b563e272b87e', 'e6db4e3e-4d0b-4346-91d1-cd4459957f2b', '5c9c8322-bec5-47e9-b88c-068114f9f92c', 'cb1a728f-16cc-41e8-a8be-2f7893f3cb4e'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:35:28 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-adbb767f-1d77-4916-8955-54a21d3a0fba tempest-VolumesSnapshotTestJSON-1776725678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:35:28 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-adbb767f-1d77-4916-8955-54a21d3a0fba tempest-VolumesSnapshotTestJSON-1776725678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:35:28 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-adbb767f-1d77-4916-8955-54a21d3a0fba tempest-VolumesSnapshotTestJSON-1776725678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:35:28 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-adbb767f-1d77-4916-8955-54a21d3a0fba tempest-VolumesSnapshotTestJSON-1776725678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:35:28 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-adbb767f-1d77-4916-8955-54a21d3a0fba tempest-VolumesSnapshotTestJSON-1776725678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:35:28 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-adbb767f-1d77-4916-8955-54a21d3a0fba tempest-VolumesSnapshotTestJSON-1776725678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:35:28 devstack sudo[109673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:35:28 devstack sudo[109673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:35:29 devstack sudo[109673]: pam_unix(sudo:session): session closed for user root Aug 26 14:35:29 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-adbb767f-1d77-4916-8955-54a21d3a0fba tempest-VolumesSnapshotTestJSON-1776725678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.592s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:35:29 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-adbb767f-1d77-4916-8955-54a21d3a0fba tempest-VolumesSnapshotTestJSON-1776725678 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:35:29 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-adbb767f-1d77-4916-8955-54a21d3a0fba tempest-VolumesSnapshotTestJSON-1776725678 None] Deleted volume successfully. Aug 26 14:35:29 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-adbb767f-1d77-4916-8955-54a21d3a0fba tempest-VolumesSnapshotTestJSON-1776725678 None] Lock "cinder-e956e503-1b64-4c95-8307-ab2ec29a69b8-delete_volume" released by "delete_volume" :: held 1.921s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:35:29 devstack cinder-volume[94394]: INFO cinder.volume.manager [req-8c43f023-71c0-41df-9223-eb73c26fe37e req-16f6f55b-5ada-48d4-9938-f773e73fdff2 tempest-TestInstancesWithCinderVolumes-1323272046 None] Terminate volume connection completed successfully. Aug 26 14:35:29 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [req-8c43f023-71c0-41df-9223-eb73c26fe37e req-16f6f55b-5ada-48d4-9938-f773e73fdff2 tempest-TestInstancesWithCinderVolumes-1323272046 None] Deleting attachment 3637781c-937f-4d3f-9929-a4dcb2fec444. {{(pid=94394) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 14:35:30 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-96d673bf-7a1d-4c62-b618-b3a223362a18 tempest-TestInstancesWithCinderVolumes-1323272046 None] Acquiring lock "cinder-66ce87d3-338e-48f9-843f-fe55e4d24e3c-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:35:30 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-96d673bf-7a1d-4c62-b618-b3a223362a18 tempest-TestInstancesWithCinderVolumes-1323272046 None] Lock "cinder-66ce87d3-338e-48f9-843f-fe55e4d24e3c-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:35:30 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-96d673bf-7a1d-4c62-b618-b3a223362a18 tempest-TestInstancesWithCinderVolumes-1323272046 None] Acquiring lock "cinder-quobyte-66ce87d3-338e-48f9-843f-fe55e4d24e3c" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:35:30 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-96d673bf-7a1d-4c62-b618-b3a223362a18 tempest-TestInstancesWithCinderVolumes-1323272046 None] Lock "cinder-quobyte-66ce87d3-338e-48f9-843f-fe55e4d24e3c" acquired by "delete_volume" :: waited 0.042s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:35:30 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc1e0d41-8261-4812-862d-bb4fba4abd1a]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:35:30 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-96d673bf-7a1d-4c62-b618-b3a223362a18 tempest-TestInstancesWithCinderVolumes-1323272046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-66ce87d3-338e-48f9-843f-fe55e4d24e3c {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:35:30 devstack sudo[109701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-66ce87d3-338e-48f9-843f-fe55e4d24e3c Aug 26 14:35:30 devstack sudo[109701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:35:31 devstack sudo[109701]: pam_unix(sudo:session): session closed for user root Aug 26 14:35:31 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-96d673bf-7a1d-4c62-b618-b3a223362a18 tempest-TestInstancesWithCinderVolumes-1323272046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-66ce87d3-338e-48f9-843f-fe55e4d24e3c" returned: 0 in 0.927s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:35:31 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-96d673bf-7a1d-4c62-b618-b3a223362a18 tempest-TestInstancesWithCinderVolumes-1323272046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-66ce87d3-338e-48f9-843f-fe55e4d24e3c {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:35:31 devstack sudo[109737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-66ce87d3-338e-48f9-843f-fe55e4d24e3c Aug 26 14:35:31 devstack sudo[109737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:35:31 devstack sudo[109737]: pam_unix(sudo:session): session closed for user root Aug 26 14:35:31 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-96d673bf-7a1d-4c62-b618-b3a223362a18 tempest-TestInstancesWithCinderVolumes-1323272046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-66ce87d3-338e-48f9-843f-fe55e4d24e3c" returned: 0 in 0.354s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:35:31 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-96d673bf-7a1d-4c62-b618-b3a223362a18 tempest-TestInstancesWithCinderVolumes-1323272046 None] Lock "cinder-quobyte-66ce87d3-338e-48f9-843f-fe55e4d24e3c" released by "delete_volume" :: held 1.357s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:35:31 devstack cinder-volume[94394]: WARNING cinder.quota [None req-96d673bf-7a1d-4c62-b618-b3a223362a18 tempest-TestInstancesWithCinderVolumes-1323272046 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-184480234-914585439 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-184480234-914585439, it is now deprecated. Please use the default quota class for default quota. Aug 26 14:35:31 devstack cinder-volume[94394]: WARNING cinder.quota [None req-96d673bf-7a1d-4c62-b618-b3a223362a18 tempest-TestInstancesWithCinderVolumes-1323272046 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-184480234-914585439 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-184480234-914585439, it is now deprecated. Please use the default quota class for default quota. Aug 26 14:35:31 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-96d673bf-7a1d-4c62-b618-b3a223362a18 tempest-TestInstancesWithCinderVolumes-1323272046 None] Created reservations ['c399381e-580c-454f-a81e-53f73b7da3ed', '2feb0a4e-d034-4615-9ca8-e43dba9f456d', 'e45dac65-4e71-4419-a4d2-1e305a56f978', '3a7ac36c-858a-4334-bbe4-72954c4852b3'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:35:31 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-96d673bf-7a1d-4c62-b618-b3a223362a18 tempest-TestInstancesWithCinderVolumes-1323272046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:35:31 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-96d673bf-7a1d-4c62-b618-b3a223362a18 tempest-TestInstancesWithCinderVolumes-1323272046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:35:31 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-96d673bf-7a1d-4c62-b618-b3a223362a18 tempest-TestInstancesWithCinderVolumes-1323272046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:35:31 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-96d673bf-7a1d-4c62-b618-b3a223362a18 tempest-TestInstancesWithCinderVolumes-1323272046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:35:31 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-96d673bf-7a1d-4c62-b618-b3a223362a18 tempest-TestInstancesWithCinderVolumes-1323272046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:35:31 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-96d673bf-7a1d-4c62-b618-b3a223362a18 tempest-TestInstancesWithCinderVolumes-1323272046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:35:31 devstack sudo[109746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:35:31 devstack sudo[109746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:35:32 devstack sudo[109746]: pam_unix(sudo:session): session closed for user root Aug 26 14:35:32 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-96d673bf-7a1d-4c62-b618-b3a223362a18 tempest-TestInstancesWithCinderVolumes-1323272046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.377s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:35:32 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-96d673bf-7a1d-4c62-b618-b3a223362a18 tempest-TestInstancesWithCinderVolumes-1323272046 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:35:32 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-96d673bf-7a1d-4c62-b618-b3a223362a18 tempest-TestInstancesWithCinderVolumes-1323272046 None] Deleted volume successfully. Aug 26 14:35:32 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-96d673bf-7a1d-4c62-b618-b3a223362a18 tempest-TestInstancesWithCinderVolumes-1323272046 None] Lock "cinder-66ce87d3-338e-48f9-843f-fe55e4d24e3c-delete_volume" released by "delete_volume" :: held 2.098s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:35:33 devstack cinder-volume[94394]: DEBUG oslo_service.periodic_task [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94394) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 14:35:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:35:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:35:33 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:35:33 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:35:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:35:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:35:33 devstack sudo[109768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:35:33 devstack sudo[109768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:35:34 devstack sudo[109768]: pam_unix(sudo:session): session closed for user root Aug 26 14:35:34 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.427s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:35:34 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:35:34 devstack cinder-volume[94394]: DEBUG oslo_service.periodic_task [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Running periodic task VolumeManager._thread_info {{(pid=94394) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 14:35:34 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] thread count: 28 {{(pid=94394) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 14:35:34 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] thread info: [<_MainThread(MainThread, started 126600738033792)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94394) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 14:35:34 devstack cinder-volume[94394]: INFO cinder.volume.manager [req-faa0f5de-1ec4-49b6-8525-d7d1d0969949 req-ce5ad769-16ae-4802-8a73-6a0c13c9f9dc tempest-TestInstancesWithCinderVolumes-1323272046 None] Terminate volume connection completed successfully. Aug 26 14:35:34 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [req-faa0f5de-1ec4-49b6-8525-d7d1d0969949 req-ce5ad769-16ae-4802-8a73-6a0c13c9f9dc tempest-TestInstancesWithCinderVolumes-1323272046 None] Deleting attachment 3e3edf35-2777-4a40-be6f-db82d7f36195. {{(pid=94394) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 14:35:35 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-52bab092-43b3-42b3-9081-d8e450d20ae6 tempest-TestInstancesWithCinderVolumes-1323272046 None] Acquiring lock "cinder-3c9fe106-7525-49da-9ba9-6b2bb78ddb19-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:35:35 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-52bab092-43b3-42b3-9081-d8e450d20ae6 tempest-TestInstancesWithCinderVolumes-1323272046 None] Lock "cinder-3c9fe106-7525-49da-9ba9-6b2bb78ddb19-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:35:35 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-52bab092-43b3-42b3-9081-d8e450d20ae6 tempest-TestInstancesWithCinderVolumes-1323272046 None] Acquiring lock "cinder-quobyte-3c9fe106-7525-49da-9ba9-6b2bb78ddb19" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:35:35 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-52bab092-43b3-42b3-9081-d8e450d20ae6 tempest-TestInstancesWithCinderVolumes-1323272046 None] Lock "cinder-quobyte-3c9fe106-7525-49da-9ba9-6b2bb78ddb19" acquired by "delete_volume" :: waited 0.024s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:35:35 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1e9dae4-59c0-4396-9cb0-66ad6ecb660f]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:35:35 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-52bab092-43b3-42b3-9081-d8e450d20ae6 tempest-TestInstancesWithCinderVolumes-1323272046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3c9fe106-7525-49da-9ba9-6b2bb78ddb19 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:35:35 devstack sudo[109779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3c9fe106-7525-49da-9ba9-6b2bb78ddb19 Aug 26 14:35:35 devstack sudo[109779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:35:35 devstack sudo[109779]: pam_unix(sudo:session): session closed for user root Aug 26 14:35:35 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-52bab092-43b3-42b3-9081-d8e450d20ae6 tempest-TestInstancesWithCinderVolumes-1323272046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3c9fe106-7525-49da-9ba9-6b2bb78ddb19" returned: 0 in 0.454s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:35:35 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-52bab092-43b3-42b3-9081-d8e450d20ae6 tempest-TestInstancesWithCinderVolumes-1323272046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3c9fe106-7525-49da-9ba9-6b2bb78ddb19 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:35:35 devstack sudo[109786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3c9fe106-7525-49da-9ba9-6b2bb78ddb19 Aug 26 14:35:35 devstack sudo[109786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:35:36 devstack sudo[109786]: pam_unix(sudo:session): session closed for user root Aug 26 14:35:36 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-52bab092-43b3-42b3-9081-d8e450d20ae6 tempest-TestInstancesWithCinderVolumes-1323272046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3c9fe106-7525-49da-9ba9-6b2bb78ddb19" returned: 0 in 0.346s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:35:36 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-52bab092-43b3-42b3-9081-d8e450d20ae6 tempest-TestInstancesWithCinderVolumes-1323272046 None] Lock "cinder-quobyte-3c9fe106-7525-49da-9ba9-6b2bb78ddb19" released by "delete_volume" :: held 0.869s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:35:36 devstack cinder-volume[94394]: WARNING cinder.quota [None req-52bab092-43b3-42b3-9081-d8e450d20ae6 tempest-TestInstancesWithCinderVolumes-1323272046 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-879933962-1722575959 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-879933962-1722575959, it is now deprecated. Please use the default quota class for default quota. Aug 26 14:35:36 devstack cinder-volume[94394]: WARNING cinder.quota [None req-52bab092-43b3-42b3-9081-d8e450d20ae6 tempest-TestInstancesWithCinderVolumes-1323272046 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-879933962-1722575959 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-879933962-1722575959, it is now deprecated. Please use the default quota class for default quota. Aug 26 14:35:36 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-52bab092-43b3-42b3-9081-d8e450d20ae6 tempest-TestInstancesWithCinderVolumes-1323272046 None] Created reservations ['ef97e6af-56e5-4a39-ae06-4cdcf299114f', '6fa4395f-0866-4f06-817b-99afcf22d9dd', '36f797df-f111-4797-8424-b6cad58e0db2', 'c146d971-8aea-4d7e-9740-15e3bb391c56'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:35:36 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-52bab092-43b3-42b3-9081-d8e450d20ae6 tempest-TestInstancesWithCinderVolumes-1323272046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:35:36 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-52bab092-43b3-42b3-9081-d8e450d20ae6 tempest-TestInstancesWithCinderVolumes-1323272046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:35:36 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-52bab092-43b3-42b3-9081-d8e450d20ae6 tempest-TestInstancesWithCinderVolumes-1323272046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:35:36 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-52bab092-43b3-42b3-9081-d8e450d20ae6 tempest-TestInstancesWithCinderVolumes-1323272046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:35:36 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-52bab092-43b3-42b3-9081-d8e450d20ae6 tempest-TestInstancesWithCinderVolumes-1323272046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:35:36 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-52bab092-43b3-42b3-9081-d8e450d20ae6 tempest-TestInstancesWithCinderVolumes-1323272046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:35:36 devstack sudo[109789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:35:36 devstack sudo[109789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:35:36 devstack sudo[109789]: pam_unix(sudo:session): session closed for user root Aug 26 14:35:36 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-52bab092-43b3-42b3-9081-d8e450d20ae6 tempest-TestInstancesWithCinderVolumes-1323272046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.307s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:35:36 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-52bab092-43b3-42b3-9081-d8e450d20ae6 tempest-TestInstancesWithCinderVolumes-1323272046 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:35:36 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-52bab092-43b3-42b3-9081-d8e450d20ae6 tempest-TestInstancesWithCinderVolumes-1323272046 None] Deleted volume successfully. Aug 26 14:35:36 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-52bab092-43b3-42b3-9081-d8e450d20ae6 tempest-TestInstancesWithCinderVolumes-1323272046 None] Lock "cinder-3c9fe106-7525-49da-9ba9-6b2bb78ddb19-delete_volume" released by "delete_volume" :: held 1.446s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:35:41 devstack cinder-volume[94394]: INFO cinder.volume.manager [req-8d161073-ca7a-4b2c-8308-d04f92016d17 req-ffacbdac-aa31-4605-9697-28482d663e7f tempest-TestInstancesWithCinderVolumes-1323272046 None] Terminate volume connection completed successfully. Aug 26 14:35:41 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [req-8d161073-ca7a-4b2c-8308-d04f92016d17 req-ffacbdac-aa31-4605-9697-28482d663e7f tempest-TestInstancesWithCinderVolumes-1323272046 None] Deleting attachment 1b43ff83-ef38-4600-859c-448c72e4deb1. {{(pid=94394) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 14:35:42 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-6a0ac1ee-82ba-4c1c-9c76-7e91353f466d tempest-TestInstancesWithCinderVolumes-1323272046 None] Acquiring lock "cinder-3327fcec-61cf-41e8-a232-406225c2640b-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:35:42 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-6a0ac1ee-82ba-4c1c-9c76-7e91353f466d tempest-TestInstancesWithCinderVolumes-1323272046 None] Lock "cinder-3327fcec-61cf-41e8-a232-406225c2640b-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:35:42 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-6a0ac1ee-82ba-4c1c-9c76-7e91353f466d tempest-TestInstancesWithCinderVolumes-1323272046 None] Acquiring lock "cinder-quobyte-3327fcec-61cf-41e8-a232-406225c2640b" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:35:42 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-6a0ac1ee-82ba-4c1c-9c76-7e91353f466d tempest-TestInstancesWithCinderVolumes-1323272046 None] Lock "cinder-quobyte-3327fcec-61cf-41e8-a232-406225c2640b" acquired by "delete_volume" :: waited 0.018s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:35:42 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[72e920c9-bed7-4d5e-be7f-3dba023c9159]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:35:42 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-6a0ac1ee-82ba-4c1c-9c76-7e91353f466d tempest-TestInstancesWithCinderVolumes-1323272046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3327fcec-61cf-41e8-a232-406225c2640b {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:35:42 devstack sudo[109829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3327fcec-61cf-41e8-a232-406225c2640b Aug 26 14:35:42 devstack sudo[109829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:35:42 devstack sudo[109829]: pam_unix(sudo:session): session closed for user root Aug 26 14:35:42 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-6a0ac1ee-82ba-4c1c-9c76-7e91353f466d tempest-TestInstancesWithCinderVolumes-1323272046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3327fcec-61cf-41e8-a232-406225c2640b" returned: 0 in 0.458s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:35:42 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-6a0ac1ee-82ba-4c1c-9c76-7e91353f466d tempest-TestInstancesWithCinderVolumes-1323272046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3327fcec-61cf-41e8-a232-406225c2640b {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:35:42 devstack sudo[109844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3327fcec-61cf-41e8-a232-406225c2640b Aug 26 14:35:42 devstack sudo[109844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:35:43 devstack sudo[109844]: pam_unix(sudo:session): session closed for user root Aug 26 14:35:43 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-6a0ac1ee-82ba-4c1c-9c76-7e91353f466d tempest-TestInstancesWithCinderVolumes-1323272046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3327fcec-61cf-41e8-a232-406225c2640b" returned: 0 in 0.358s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:35:43 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-6a0ac1ee-82ba-4c1c-9c76-7e91353f466d tempest-TestInstancesWithCinderVolumes-1323272046 None] Lock "cinder-quobyte-3327fcec-61cf-41e8-a232-406225c2640b" released by "delete_volume" :: held 0.871s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:35:43 devstack cinder-volume[94394]: WARNING cinder.quota [None req-6a0ac1ee-82ba-4c1c-9c76-7e91353f466d tempest-TestInstancesWithCinderVolumes-1323272046 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1434455363-80978912 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1434455363-80978912, it is now deprecated. Please use the default quota class for default quota. Aug 26 14:35:43 devstack cinder-volume[94394]: WARNING cinder.quota [None req-6a0ac1ee-82ba-4c1c-9c76-7e91353f466d tempest-TestInstancesWithCinderVolumes-1323272046 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1434455363-80978912 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1434455363-80978912, it is now deprecated. Please use the default quota class for default quota. Aug 26 14:35:43 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-6a0ac1ee-82ba-4c1c-9c76-7e91353f466d tempest-TestInstancesWithCinderVolumes-1323272046 None] Created reservations ['4d73adfa-22b9-450d-a5a3-182d07998de6', 'ddf5c7e3-961d-4e3f-9295-b35b45936465', 'b5fc472c-1f80-4a2b-96a1-3d18c55ccd68', 'd06b67c3-ad25-4d1a-8d93-164c02d8eba0'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:35:43 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-6a0ac1ee-82ba-4c1c-9c76-7e91353f466d tempest-TestInstancesWithCinderVolumes-1323272046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:35:43 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-6a0ac1ee-82ba-4c1c-9c76-7e91353f466d tempest-TestInstancesWithCinderVolumes-1323272046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:35:43 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-6a0ac1ee-82ba-4c1c-9c76-7e91353f466d tempest-TestInstancesWithCinderVolumes-1323272046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:35:43 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-6a0ac1ee-82ba-4c1c-9c76-7e91353f466d tempest-TestInstancesWithCinderVolumes-1323272046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:35:43 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-6a0ac1ee-82ba-4c1c-9c76-7e91353f466d tempest-TestInstancesWithCinderVolumes-1323272046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:35:43 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-6a0ac1ee-82ba-4c1c-9c76-7e91353f466d tempest-TestInstancesWithCinderVolumes-1323272046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:35:43 devstack sudo[109847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:35:43 devstack sudo[109847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:35:43 devstack sudo[109847]: pam_unix(sudo:session): session closed for user root Aug 26 14:35:43 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-6a0ac1ee-82ba-4c1c-9c76-7e91353f466d tempest-TestInstancesWithCinderVolumes-1323272046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.334s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:35:43 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-6a0ac1ee-82ba-4c1c-9c76-7e91353f466d tempest-TestInstancesWithCinderVolumes-1323272046 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:35:43 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-6a0ac1ee-82ba-4c1c-9c76-7e91353f466d tempest-TestInstancesWithCinderVolumes-1323272046 None] Deleted volume successfully. Aug 26 14:35:43 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-6a0ac1ee-82ba-4c1c-9c76-7e91353f466d tempest-TestInstancesWithCinderVolumes-1323272046 None] Lock "cinder-3327fcec-61cf-41e8-a232-406225c2640b-delete_volume" released by "delete_volume" :: held 1.501s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:35:44 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [req-b6a44e65-af4c-47d8-a003-876138a53932 req-50412ea7-00bb-47b7-9650-df49c6f40946 tempest-TestServerVolumeAttachmentScenario-1907654709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:35:44 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [req-b6a44e65-af4c-47d8-a003-876138a53932 req-50412ea7-00bb-47b7-9650-df49c6f40946 tempest-TestServerVolumeAttachmentScenario-1907654709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:35:44 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [req-b6a44e65-af4c-47d8-a003-876138a53932 req-50412ea7-00bb-47b7-9650-df49c6f40946 tempest-TestServerVolumeAttachmentScenario-1907654709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:35:44 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [req-b6a44e65-af4c-47d8-a003-876138a53932 req-50412ea7-00bb-47b7-9650-df49c6f40946 tempest-TestServerVolumeAttachmentScenario-1907654709 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b', 'name': 'volume-17b6e820-6cc8-4018-b799-0e20a871423a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c103457d-2713-4d64-8b3b-9831ca476d3d', 'enforce_multipath': True} {{(pid=94394) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 14:35:44 devstack cinder-volume[94394]: INFO cinder.volume.manager [req-b6a44e65-af4c-47d8-a003-876138a53932 req-50412ea7-00bb-47b7-9650-df49c6f40946 tempest-TestServerVolumeAttachmentScenario-1907654709 None] attachment_update completed successfully. Aug 26 14:35:50 devstack cinder-volume[94394]: DEBUG dbcounter [-] [94394] Writing DB stats cinder:SELECT=93,cinder:INSERT=21,cinder:UPDATE=100,cinder:DELETE=5 {{(pid=94394) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 14:35:50 devstack cinder-volume[94394]: DEBUG dbcounter [-] [94394] Writing DB stats cinder:UPDATE=108,cinder:SELECT=98,cinder:INSERT=29,cinder:DELETE=10 {{(pid=94394) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 14:35:50 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [req-563fb0cc-37c0-4372-aa4a-192ff143f25c req-22db9df0-cf75-4500-b1fe-5ff51a697f8c tempest-TestServerVolumeAttachmentScenario-1907654709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:35:50 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [req-563fb0cc-37c0-4372-aa4a-192ff143f25c req-22db9df0-cf75-4500-b1fe-5ff51a697f8c tempest-TestServerVolumeAttachmentScenario-1907654709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:35:50 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [req-563fb0cc-37c0-4372-aa4a-192ff143f25c req-22db9df0-cf75-4500-b1fe-5ff51a697f8c tempest-TestServerVolumeAttachmentScenario-1907654709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:35:50 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [req-563fb0cc-37c0-4372-aa4a-192ff143f25c req-22db9df0-cf75-4500-b1fe-5ff51a697f8c tempest-TestServerVolumeAttachmentScenario-1907654709 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b', 'name': 'volume-b7d6860d-0284-4061-9746-d1e2d159969a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fd1e0c78-378a-4f3f-92c6-38f1df19cc47', 'enforce_multipath': True} {{(pid=94394) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 14:35:50 devstack cinder-volume[94394]: INFO cinder.volume.manager [req-563fb0cc-37c0-4372-aa4a-192ff143f25c req-22db9df0-cf75-4500-b1fe-5ff51a697f8c tempest-TestServerVolumeAttachmentScenario-1907654709 None] attachment_update completed successfully. Aug 26 14:35:52 devstack cinder-volume[94394]: INFO cinder.volume.manager [req-c7fb46e3-5450-457a-b824-0128e0876201 req-7f6ee6a6-7b9e-4c04-964f-f0ec38abf8a8 tempest-TestServerVolumeAttachmentScenario-1907654709 None] Terminate volume connection completed successfully. Aug 26 14:35:53 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [req-c7fb46e3-5450-457a-b824-0128e0876201 req-7f6ee6a6-7b9e-4c04-964f-f0ec38abf8a8 tempest-TestServerVolumeAttachmentScenario-1907654709 None] Deleting attachment fd1e0c78-378a-4f3f-92c6-38f1df19cc47. {{(pid=94394) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 14:35:54 devstack cinder-volume[94394]: INFO cinder.volume.manager [req-e6c49aba-5493-48df-87d7-dd6d71f1e0ec req-be46bc0a-49f6-471b-ae06-aeeb53b8016a tempest-TestServerVolumeAttachmentScenario-1907654709 None] Terminate volume connection completed successfully. Aug 26 14:35:54 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [req-e6c49aba-5493-48df-87d7-dd6d71f1e0ec req-be46bc0a-49f6-471b-ae06-aeeb53b8016a tempest-TestServerVolumeAttachmentScenario-1907654709 None] Deleting attachment c103457d-2713-4d64-8b3b-9831ca476d3d. {{(pid=94394) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 14:36:00 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-31676a38-7c06-445d-9ac3-855b806f926c tempest-TestServerVolumeAttachmentScenario-1907654709 None] Acquiring lock "cinder-b7d6860d-0284-4061-9746-d1e2d159969a-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:36:00 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-31676a38-7c06-445d-9ac3-855b806f926c tempest-TestServerVolumeAttachmentScenario-1907654709 None] Lock "cinder-b7d6860d-0284-4061-9746-d1e2d159969a-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:36:00 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-31676a38-7c06-445d-9ac3-855b806f926c tempest-TestServerVolumeAttachmentScenario-1907654709 None] Acquiring lock "cinder-quobyte-b7d6860d-0284-4061-9746-d1e2d159969a" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:36:00 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-31676a38-7c06-445d-9ac3-855b806f926c tempest-TestServerVolumeAttachmentScenario-1907654709 None] Lock "cinder-quobyte-b7d6860d-0284-4061-9746-d1e2d159969a" acquired by "delete_volume" :: waited 0.020s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:36:00 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[205bf009-3dec-4c86-8c0f-b672f65001be]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:36:00 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-31676a38-7c06-445d-9ac3-855b806f926c tempest-TestServerVolumeAttachmentScenario-1907654709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b7d6860d-0284-4061-9746-d1e2d159969a {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:36:00 devstack sudo[110330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b7d6860d-0284-4061-9746-d1e2d159969a Aug 26 14:36:00 devstack sudo[110330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:36:00 devstack sudo[110330]: pam_unix(sudo:session): session closed for user root Aug 26 14:36:00 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-31676a38-7c06-445d-9ac3-855b806f926c tempest-TestServerVolumeAttachmentScenario-1907654709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b7d6860d-0284-4061-9746-d1e2d159969a" returned: 0 in 0.474s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:36:00 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-31676a38-7c06-445d-9ac3-855b806f926c tempest-TestServerVolumeAttachmentScenario-1907654709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b7d6860d-0284-4061-9746-d1e2d159969a {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:36:01 devstack sudo[110336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b7d6860d-0284-4061-9746-d1e2d159969a Aug 26 14:36:01 devstack sudo[110336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:36:01 devstack sudo[110336]: pam_unix(sudo:session): session closed for user root Aug 26 14:36:01 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-31676a38-7c06-445d-9ac3-855b806f926c tempest-TestServerVolumeAttachmentScenario-1907654709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b7d6860d-0284-4061-9746-d1e2d159969a" returned: 0 in 0.311s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:36:01 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-31676a38-7c06-445d-9ac3-855b806f926c tempest-TestServerVolumeAttachmentScenario-1907654709 None] Lock "cinder-quobyte-b7d6860d-0284-4061-9746-d1e2d159969a" released by "delete_volume" :: held 0.847s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:36:01 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-31676a38-7c06-445d-9ac3-855b806f926c tempest-TestServerVolumeAttachmentScenario-1907654709 None] Created reservations ['7891d965-fa8f-4ff2-9e21-028e1c680b93', 'b7e834a7-8409-4322-a13b-bafd16d11186', '111a089f-e54b-49d2-8d5c-efb9802680cb', '253382f5-3659-4117-9ea6-cfd077b0ea14'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:36:01 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-31676a38-7c06-445d-9ac3-855b806f926c tempest-TestServerVolumeAttachmentScenario-1907654709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:36:01 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-31676a38-7c06-445d-9ac3-855b806f926c tempest-TestServerVolumeAttachmentScenario-1907654709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:36:01 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-31676a38-7c06-445d-9ac3-855b806f926c tempest-TestServerVolumeAttachmentScenario-1907654709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:36:01 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-31676a38-7c06-445d-9ac3-855b806f926c tempest-TestServerVolumeAttachmentScenario-1907654709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:36:01 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-31676a38-7c06-445d-9ac3-855b806f926c tempest-TestServerVolumeAttachmentScenario-1907654709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:36:01 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-31676a38-7c06-445d-9ac3-855b806f926c tempest-TestServerVolumeAttachmentScenario-1907654709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:36:01 devstack sudo[110339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:36:01 devstack sudo[110339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:36:01 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-0e0d351c-4eff-4575-a23f-83a1e4e84b1e tempest-TestServerVolumeAttachmentScenario-1907654709 None] Acquiring lock "cinder-17b6e820-6cc8-4018-b799-0e20a871423a-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:36:01 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-0e0d351c-4eff-4575-a23f-83a1e4e84b1e tempest-TestServerVolumeAttachmentScenario-1907654709 None] Lock "cinder-17b6e820-6cc8-4018-b799-0e20a871423a-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:36:01 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-0e0d351c-4eff-4575-a23f-83a1e4e84b1e tempest-TestServerVolumeAttachmentScenario-1907654709 None] Acquiring lock "cinder-quobyte-17b6e820-6cc8-4018-b799-0e20a871423a" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:36:01 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-0e0d351c-4eff-4575-a23f-83a1e4e84b1e tempest-TestServerVolumeAttachmentScenario-1907654709 None] Lock "cinder-quobyte-17b6e820-6cc8-4018-b799-0e20a871423a" acquired by "delete_volume" :: waited 0.019s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:36:01 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[73c63433-225d-490a-a8de-0df501dc9719]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:36:01 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-0e0d351c-4eff-4575-a23f-83a1e4e84b1e tempest-TestServerVolumeAttachmentScenario-1907654709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-17b6e820-6cc8-4018-b799-0e20a871423a {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:36:01 devstack sudo[110341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-17b6e820-6cc8-4018-b799-0e20a871423a Aug 26 14:36:01 devstack sudo[110341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:36:02 devstack sudo[110339]: pam_unix(sudo:session): session closed for user root Aug 26 14:36:02 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-31676a38-7c06-445d-9ac3-855b806f926c tempest-TestServerVolumeAttachmentScenario-1907654709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.486s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:36:02 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-31676a38-7c06-445d-9ac3-855b806f926c tempest-TestServerVolumeAttachmentScenario-1907654709 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:36:02 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-31676a38-7c06-445d-9ac3-855b806f926c tempest-TestServerVolumeAttachmentScenario-1907654709 None] Deleted volume successfully. Aug 26 14:36:02 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-31676a38-7c06-445d-9ac3-855b806f926c tempest-TestServerVolumeAttachmentScenario-1907654709 None] Lock "cinder-b7d6860d-0284-4061-9746-d1e2d159969a-delete_volume" released by "delete_volume" :: held 1.718s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:36:02 devstack sudo[110341]: pam_unix(sudo:session): session closed for user root Aug 26 14:36:02 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-0e0d351c-4eff-4575-a23f-83a1e4e84b1e tempest-TestServerVolumeAttachmentScenario-1907654709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-17b6e820-6cc8-4018-b799-0e20a871423a" returned: 0 in 0.532s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:36:02 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-0e0d351c-4eff-4575-a23f-83a1e4e84b1e tempest-TestServerVolumeAttachmentScenario-1907654709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-17b6e820-6cc8-4018-b799-0e20a871423a {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:36:02 devstack sudo[110347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-17b6e820-6cc8-4018-b799-0e20a871423a Aug 26 14:36:02 devstack sudo[110347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:36:02 devstack sudo[110347]: pam_unix(sudo:session): session closed for user root Aug 26 14:36:02 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-0e0d351c-4eff-4575-a23f-83a1e4e84b1e tempest-TestServerVolumeAttachmentScenario-1907654709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-17b6e820-6cc8-4018-b799-0e20a871423a" returned: 0 in 0.283s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:36:02 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-0e0d351c-4eff-4575-a23f-83a1e4e84b1e tempest-TestServerVolumeAttachmentScenario-1907654709 None] Lock "cinder-quobyte-17b6e820-6cc8-4018-b799-0e20a871423a" released by "delete_volume" :: held 0.869s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:36:02 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-0e0d351c-4eff-4575-a23f-83a1e4e84b1e tempest-TestServerVolumeAttachmentScenario-1907654709 None] Created reservations ['fe0eaec2-1713-453b-aef7-b12e423c51ff', 'b174a271-6368-4e11-ba7d-6b96fcf3e462', '805ddc14-dfe8-4114-a3d7-54e43f6b313f', '4366e116-6627-4804-85f6-8ee43f1132b9'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:36:02 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-0e0d351c-4eff-4575-a23f-83a1e4e84b1e tempest-TestServerVolumeAttachmentScenario-1907654709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:36:02 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-0e0d351c-4eff-4575-a23f-83a1e4e84b1e tempest-TestServerVolumeAttachmentScenario-1907654709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:36:02 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-0e0d351c-4eff-4575-a23f-83a1e4e84b1e tempest-TestServerVolumeAttachmentScenario-1907654709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:36:02 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-0e0d351c-4eff-4575-a23f-83a1e4e84b1e tempest-TestServerVolumeAttachmentScenario-1907654709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:36:02 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-0e0d351c-4eff-4575-a23f-83a1e4e84b1e tempest-TestServerVolumeAttachmentScenario-1907654709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:36:02 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-0e0d351c-4eff-4575-a23f-83a1e4e84b1e tempest-TestServerVolumeAttachmentScenario-1907654709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:36:02 devstack sudo[110350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:36:02 devstack sudo[110350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:36:03 devstack sudo[110350]: pam_unix(sudo:session): session closed for user root Aug 26 14:36:03 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-0e0d351c-4eff-4575-a23f-83a1e4e84b1e tempest-TestServerVolumeAttachmentScenario-1907654709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.321s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:36:03 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-0e0d351c-4eff-4575-a23f-83a1e4e84b1e tempest-TestServerVolumeAttachmentScenario-1907654709 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:36:03 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-0e0d351c-4eff-4575-a23f-83a1e4e84b1e tempest-TestServerVolumeAttachmentScenario-1907654709 None] Deleted volume successfully. Aug 26 14:36:03 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-0e0d351c-4eff-4575-a23f-83a1e4e84b1e tempest-TestServerVolumeAttachmentScenario-1907654709 None] Lock "cinder-17b6e820-6cc8-4018-b799-0e20a871423a-delete_volume" released by "delete_volume" :: held 1.479s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:36:05 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf46cf4e-1a5d-42e9-8d05-34e3fd2f8492 tempest-TestImageHashVerification-1974320999 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:36:05 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-bf46cf4e-1a5d-42e9-8d05-34e3fd2f8492 tempest-TestImageHashVerification-1974320999 None] Flow 'volume_create_manager' (669a7439-3d12-4546-b1de-c3114648b659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:36:05 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-bf46cf4e-1a5d-42e9-8d05-34e3fd2f8492 tempest-TestImageHashVerification-1974320999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1be08439-9333-4be0-acb9-eae2900a539e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:36:05 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-bf46cf4e-1a5d-42e9-8d05-34e3fd2f8492 tempest-TestImageHashVerification-1974320999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1be08439-9333-4be0-acb9-eae2900a539e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:36:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1772811738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcb7eb5e-ff4a-4669-8546-90a6bb417b25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8796cd879472474fb94777c640cf65de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:36:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:36:05Z,use_quota=True,user_id='81576459e8a140fdaa9cf9e9f3a91031',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:36:05 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-bf46cf4e-1a5d-42e9-8d05-34e3fd2f8492 tempest-TestImageHashVerification-1974320999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b05ee56-71bf-4c77-ab74-5a6c9c6bd20d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:36:05 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-bf46cf4e-1a5d-42e9-8d05-34e3fd2f8492 tempest-TestImageHashVerification-1974320999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b05ee56-71bf-4c77-ab74-5a6c9c6bd20d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:36:05 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-bf46cf4e-1a5d-42e9-8d05-34e3fd2f8492 tempest-TestImageHashVerification-1974320999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1230ee78-877e-444d-83a7-588fa4e5b1f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:36:05 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-bf46cf4e-1a5d-42e9-8d05-34e3fd2f8492 tempest-TestImageHashVerification-1974320999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1230ee78-877e-444d-83a7-588fa4e5b1f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fcb7eb5e-ff4a-4669-8546-90a6bb417b25', 'volume_name': 'volume-fcb7eb5e-ff4a-4669-8546-90a6bb417b25', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:36:05 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-bf46cf4e-1a5d-42e9-8d05-34e3fd2f8492 tempest-TestImageHashVerification-1974320999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82710d03-a481-4a9e-aa2c-eed987801754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:36:05 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-bf46cf4e-1a5d-42e9-8d05-34e3fd2f8492 tempest-TestImageHashVerification-1974320999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82710d03-a481-4a9e-aa2c-eed987801754) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:36:05 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-bf46cf4e-1a5d-42e9-8d05-34e3fd2f8492 tempest-TestImageHashVerification-1974320999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d53d50ce-542d-446e-bbe8-e781ce6935c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:36:05 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-bf46cf4e-1a5d-42e9-8d05-34e3fd2f8492 tempest-TestImageHashVerification-1974320999 None] Volume fcb7eb5e-ff4a-4669-8546-90a6bb417b25: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fcb7eb5e-ff4a-4669-8546-90a6bb417b25', 'volume_size': 1} Aug 26 14:36:05 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-bf46cf4e-1a5d-42e9-8d05-34e3fd2f8492 tempest-TestImageHashVerification-1974320999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:36:05 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-bf46cf4e-1a5d-42e9-8d05-34e3fd2f8492 tempest-TestImageHashVerification-1974320999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:36:05 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-bf46cf4e-1a5d-42e9-8d05-34e3fd2f8492 tempest-TestImageHashVerification-1974320999 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:36:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1772811738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcb7eb5e-ff4a-4669-8546-90a6bb417b25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8796cd879472474fb94777c640cf65de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:36:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:36:05Z,use_quota=True,user_id='81576459e8a140fdaa9cf9e9f3a91031',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:36:05 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-bf46cf4e-1a5d-42e9-8d05-34e3fd2f8492 tempest-TestImageHashVerification-1974320999 None] Creating volume fcb7eb5e-ff4a-4669-8546-90a6bb417b25 {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:36:05 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-bf46cf4e-1a5d-42e9-8d05-34e3fd2f8492 tempest-TestImageHashVerification-1974320999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:36:05 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-bf46cf4e-1a5d-42e9-8d05-34e3fd2f8492 tempest-TestImageHashVerification-1974320999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:36:05 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-bf46cf4e-1a5d-42e9-8d05-34e3fd2f8492 tempest-TestImageHashVerification-1974320999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:36:05 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-bf46cf4e-1a5d-42e9-8d05-34e3fd2f8492 tempest-TestImageHashVerification-1974320999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:36:05 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-bf46cf4e-1a5d-42e9-8d05-34e3fd2f8492 tempest-TestImageHashVerification-1974320999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:36:05 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-bf46cf4e-1a5d-42e9-8d05-34e3fd2f8492 tempest-TestImageHashVerification-1974320999 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:36:05 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-bf46cf4e-1a5d-42e9-8d05-34e3fd2f8492 tempest-TestImageHashVerification-1974320999 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:36:05 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-bf46cf4e-1a5d-42e9-8d05-34e3fd2f8492 tempest-TestImageHashVerification-1974320999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-fcb7eb5e-ff4a-4669-8546-90a6bb417b25 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:36:05 devstack sudo[110354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-fcb7eb5e-ff4a-4669-8546-90a6bb417b25 1073741824 Aug 26 14:36:05 devstack sudo[110354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:36:06 devstack sudo[110354]: pam_unix(sudo:session): session closed for user root Aug 26 14:36:06 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-bf46cf4e-1a5d-42e9-8d05-34e3fd2f8492 tempest-TestImageHashVerification-1974320999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-fcb7eb5e-ff4a-4669-8546-90a6bb417b25 1073741824" returned: 0 in 0.535s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:36:06 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-bf46cf4e-1a5d-42e9-8d05-34e3fd2f8492 tempest-TestImageHashVerification-1974320999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-fcb7eb5e-ff4a-4669-8546-90a6bb417b25 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:36:06 devstack sudo[110359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-fcb7eb5e-ff4a-4669-8546-90a6bb417b25 Aug 26 14:36:06 devstack sudo[110359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:36:06 devstack sudo[110359]: pam_unix(sudo:session): session closed for user root Aug 26 14:36:06 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-bf46cf4e-1a5d-42e9-8d05-34e3fd2f8492 tempest-TestImageHashVerification-1974320999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-fcb7eb5e-ff4a-4669-8546-90a6bb417b25" returned: 0 in 0.268s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:36:06 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-bf46cf4e-1a5d-42e9-8d05-34e3fd2f8492 tempest-TestImageHashVerification-1974320999 None] <== create_volume: return (851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:36:06 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-bf46cf4e-1a5d-42e9-8d05-34e3fd2f8492 tempest-TestImageHashVerification-1974320999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.854s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:36:06 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-bf46cf4e-1a5d-42e9-8d05-34e3fd2f8492 tempest-TestImageHashVerification-1974320999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d53d50ce-542d-446e-bbe8-e781ce6935c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fcb7eb5e-ff4a-4669-8546-90a6bb417b25', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:36:06 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-bf46cf4e-1a5d-42e9-8d05-34e3fd2f8492 tempest-TestImageHashVerification-1974320999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b82c4be7-ce5b-4afb-92be-f276d2f080c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:36:06 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-bf46cf4e-1a5d-42e9-8d05-34e3fd2f8492 tempest-TestImageHashVerification-1974320999 None] Volume volume-fcb7eb5e-ff4a-4669-8546-90a6bb417b25 (fcb7eb5e-ff4a-4669-8546-90a6bb417b25): created successfully Aug 26 14:36:06 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-bf46cf4e-1a5d-42e9-8d05-34e3fd2f8492 tempest-TestImageHashVerification-1974320999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b82c4be7-ce5b-4afb-92be-f276d2f080c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:36:06 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-bf46cf4e-1a5d-42e9-8d05-34e3fd2f8492 tempest-TestImageHashVerification-1974320999 None] Flow 'volume_create_manager' (669a7439-3d12-4546-b1de-c3114648b659) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:36:06 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-bf46cf4e-1a5d-42e9-8d05-34e3fd2f8492 tempest-TestImageHashVerification-1974320999 None] Created volume successfully. Aug 26 14:36:08 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-6ddfa63e-bc0f-4554-b2f3-e5ab8edbfdfa tempest-TestImageHashVerification-1974320999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:36:08 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-6ddfa63e-bc0f-4554-b2f3-e5ab8edbfdfa tempest-TestImageHashVerification-1974320999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:36:08 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[feebddb8-055a-4e8d-b742-7803cfefeb43]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:36:08 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-6ddfa63e-bc0f-4554-b2f3-e5ab8edbfdfa tempest-TestImageHashVerification-1974320999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-fcb7eb5e-ff4a-4669-8546-90a6bb417b25 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:36:08 devstack sudo[110363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-fcb7eb5e-ff4a-4669-8546-90a6bb417b25 Aug 26 14:36:08 devstack sudo[110363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:36:08 devstack sudo[110363]: pam_unix(sudo:session): session closed for user root Aug 26 14:36:08 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-6ddfa63e-bc0f-4554-b2f3-e5ab8edbfdfa tempest-TestImageHashVerification-1974320999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-fcb7eb5e-ff4a-4669-8546-90a6bb417b25" returned: 0 in 0.438s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:36:08 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebf2e34f-8e7e-4831-87f0-24d30b8e5ae8]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:36:08 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-6ddfa63e-bc0f-4554-b2f3-e5ab8edbfdfa tempest-TestImageHashVerification-1974320999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-fcb7eb5e-ff4a-4669-8546-90a6bb417b25 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:36:09 devstack sudo[110368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-fcb7eb5e-ff4a-4669-8546-90a6bb417b25 Aug 26 14:36:09 devstack sudo[110368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:36:09 devstack sudo[110368]: pam_unix(sudo:session): session closed for user root Aug 26 14:36:09 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-6ddfa63e-bc0f-4554-b2f3-e5ab8edbfdfa tempest-TestImageHashVerification-1974320999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-fcb7eb5e-ff4a-4669-8546-90a6bb417b25" returned: 0 in 0.437s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:36:09 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-6ddfa63e-bc0f-4554-b2f3-e5ab8edbfdfa tempest-TestImageHashVerification-1974320999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-fcb7eb5e-ff4a-4669-8546-90a6bb417b25 /opt/stack/data/cinder/conversion/fcb7eb5e-ff4a-4669-8546-90a6bb417b25.temp_image.65f0a6ae-79ef-4d62-873d-f5e71ea0b840ef_dditx.img {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:36:09 devstack sudo[110373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-fcb7eb5e-ff4a-4669-8546-90a6bb417b25 /opt/stack/data/cinder/conversion/fcb7eb5e-ff4a-4669-8546-90a6bb417b25.temp_image.65f0a6ae-79ef-4d62-873d-f5e71ea0b840ef_dditx.img Aug 26 14:36:09 devstack sudo[110373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:36:14 devstack sudo[110373]: pam_unix(sudo:session): session closed for user root Aug 26 14:36:14 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-6ddfa63e-bc0f-4554-b2f3-e5ab8edbfdfa tempest-TestImageHashVerification-1974320999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-fcb7eb5e-ff4a-4669-8546-90a6bb417b25 /opt/stack/data/cinder/conversion/fcb7eb5e-ff4a-4669-8546-90a6bb417b25.temp_image.65f0a6ae-79ef-4d62-873d-f5e71ea0b840ef_dditx.img" returned: 0 in 5.152s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:36:14 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[24081a15-002c-4f26-a315-8b4c2b82df9c]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:36:14 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-6ddfa63e-bc0f-4554-b2f3-e5ab8edbfdfa tempest-TestImageHashVerification-1974320999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-fcb7eb5e-ff4a-4669-8546-90a6bb417b25 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:36:14 devstack sudo[110388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-fcb7eb5e-ff4a-4669-8546-90a6bb417b25 Aug 26 14:36:14 devstack sudo[110388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:36:15 devstack sudo[110388]: pam_unix(sudo:session): session closed for user root Aug 26 14:36:15 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-6ddfa63e-bc0f-4554-b2f3-e5ab8edbfdfa tempest-TestImageHashVerification-1974320999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-fcb7eb5e-ff4a-4669-8546-90a6bb417b25" returned: 0 in 0.593s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:36:15 devstack cinder-volume[94394]: DEBUG cinder.image.image_utils [None req-6ddfa63e-bc0f-4554-b2f3-e5ab8edbfdfa tempest-TestImageHashVerification-1974320999 None] Image conversion details: src /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-fcb7eb5e-ff4a-4669-8546-90a6bb417b25, size 1024.00 MB, duration 5.15 sec, destination /opt/stack/data/cinder/conversion/fcb7eb5e-ff4a-4669-8546-90a6bb417b25.temp_image.65f0a6ae-79ef-4d62-873d-f5e71ea0b840ef_dditx.img {{(pid=94394) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 14:36:15 devstack cinder-volume[94394]: INFO cinder.image.image_utils [None req-6ddfa63e-bc0f-4554-b2f3-e5ab8edbfdfa tempest-TestImageHashVerification-1974320999 None] Converted 1024.00 MB image at 198.70 MB/s Aug 26 14:36:15 devstack cinder-volume[94394]: DEBUG cinder.image.image_utils [None req-6ddfa63e-bc0f-4554-b2f3-e5ab8edbfdfa tempest-TestImageHashVerification-1974320999 None] 65f0a6ae-79ef-4d62-873d-f5e71ea0b840 was raw, no need to convert to raw {{(pid=94394) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Aug 26 14:36:18 devstack cinder-volume[94394]: DEBUG dbcounter [-] [94394] Writing DB stats cinder:SELECT=24,cinder:UPDATE=19,cinder:INSERT=5,cinder:DELETE=1 {{(pid=94394) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 14:36:25 devstack cinder-volume[94394]: DEBUG dbcounter [-] [94394] Writing DB stats cinder:SELECT=18,cinder:INSERT=4,cinder:UPDATE=22,cinder:DELETE=2 {{(pid=94394) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 14:36:26 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f646332-f2ac-41d0-ba0f-6ff0fa438019 tempest-VolumeAndVolumeTypeFromImageTest-1970055207 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:36:26 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-6f646332-f2ac-41d0-ba0f-6ff0fa438019 tempest-VolumeAndVolumeTypeFromImageTest-1970055207 None] Flow 'volume_create_manager' (731aaf46-2e1a-49d6-af2d-30221d02624f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:36:26 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-6f646332-f2ac-41d0-ba0f-6ff0fa438019 tempest-VolumeAndVolumeTypeFromImageTest-1970055207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdf3da33-5a1a-4e89-a588-734e42ce509c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:36:26 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-6f646332-f2ac-41d0-ba0f-6ff0fa438019 tempest-VolumeAndVolumeTypeFromImageTest-1970055207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdf3da33-5a1a-4e89-a588-734e42ce509c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:36:26Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a964c720-e97a-4f99-a907-fea8d1d408d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26b9ec7ac8b4467a97b2a170cf541579',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:36:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:36:26Z,use_quota=True,user_id='c4d9e6a3e4de4b56bdc2cf12b4e779e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d9210ed-3d48-4777-b19c-95be68e30421),volume_type_id=2d9210ed-3d48-4777-b19c-95be68e30421)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:36:26 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-6f646332-f2ac-41d0-ba0f-6ff0fa438019 tempest-VolumeAndVolumeTypeFromImageTest-1970055207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b8a3d2e-e9fa-4e0b-9e17-c9c25b33df61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:36:26 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-6f646332-f2ac-41d0-ba0f-6ff0fa438019 tempest-VolumeAndVolumeTypeFromImageTest-1970055207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b8a3d2e-e9fa-4e0b-9e17-c9c25b33df61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:36:26 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-6f646332-f2ac-41d0-ba0f-6ff0fa438019 tempest-VolumeAndVolumeTypeFromImageTest-1970055207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f04ba68e-1a27-4b21-b355-bbab17d80b6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:36:26 devstack cinder-volume[94394]: DEBUG cinder.image.glance [None req-6f646332-f2ac-41d0-ba0f-6ff0fa438019 tempest-VolumeAndVolumeTypeFromImageTest-1970055207 None] Creating Keystone auth plugin from conf {{(pid=94394) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 26 14:36:26 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-6f646332-f2ac-41d0-ba0f-6ff0fa438019 tempest-VolumeAndVolumeTypeFromImageTest-1970055207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f04ba68e-1a27-4b21-b355-bbab17d80b6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a964c720-e97a-4f99-a907-fea8d1d408d7', 'volume_name': 'volume-a964c720-e97a-4f99-a907-fea8d1d408d7', 'volume_size': 1, 'image_id': '64498df3-8e58-4103-b845-11d46a0bc11a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/64498df3-8e58-4103-b845-11d46a0bc11a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7aaf51497bc6c322be4e521b2b45ebf7', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '26b9ec7ac8b4467a97b2a170cf541579', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5a661827d1866316578976853c51ddce34c4c83169c862c671d331ea3f51501273cc391c9c67ee76bc75f0350833d1bc798e998f53f7022e816a160f08743d1b', 'id': '64498df3-8e58-4103-b845-11d46a0bc11a', 'created_at': datetime.datetime(2026, 8, 26, 12, 36, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 12, 36, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/64498df3-8e58-4103-b845-11d46a0bc11a/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:36:26 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-6f646332-f2ac-41d0-ba0f-6ff0fa438019 tempest-VolumeAndVolumeTypeFromImageTest-1970055207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (638c759b-80c6-4615-b0c2-3bf09e7429fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:36:26 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-6f646332-f2ac-41d0-ba0f-6ff0fa438019 tempest-VolumeAndVolumeTypeFromImageTest-1970055207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (638c759b-80c6-4615-b0c2-3bf09e7429fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:36:26 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-6f646332-f2ac-41d0-ba0f-6ff0fa438019 tempest-VolumeAndVolumeTypeFromImageTest-1970055207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3ca2977-c5cb-4e5e-b90c-f49d3c6e5418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:36:26 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-6f646332-f2ac-41d0-ba0f-6ff0fa438019 tempest-VolumeAndVolumeTypeFromImageTest-1970055207 None] Volume a964c720-e97a-4f99-a907-fea8d1d408d7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a964c720-e97a-4f99-a907-fea8d1d408d7', 'volume_size': 1, 'image_id': '64498df3-8e58-4103-b845-11d46a0bc11a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/64498df3-8e58-4103-b845-11d46a0bc11a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7aaf51497bc6c322be4e521b2b45ebf7', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '26b9ec7ac8b4467a97b2a170cf541579', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5a661827d1866316578976853c51ddce34c4c83169c862c671d331ea3f51501273cc391c9c67ee76bc75f0350833d1bc798e998f53f7022e816a160f08743d1b', 'id': '64498df3-8e58-4103-b845-11d46a0bc11a', 'created_at': datetime.datetime(2026, 8, 26, 12, 36, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 12, 36, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/64498df3-8e58-4103-b845-11d46a0bc11a/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Aug 26 14:36:26 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f646332-f2ac-41d0-ba0f-6ff0fa438019 tempest-VolumeAndVolumeTypeFromImageTest-1970055207 None] Trying to clone a964c720-e97a-4f99-a907-fea8d1d408d7 from image 64498df3-8e58-4103-b845-11d46a0bc11a at location (None, [{'url': 'file:///opt/stack/data/glance/images/64498df3-8e58-4103-b845-11d46a0bc11a', 'metadata': {}}]). {{(pid=94394) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 26 14:36:27 devstack cinder-volume[94394]: DEBUG cinder.image.image_utils [None req-6f646332-f2ac-41d0-ba0f-6ff0fa438019 tempest-VolumeAndVolumeTypeFromImageTest-1970055207 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_64498df3-8e58-4103-b845-11d46a0bc11a_ofpg8id6devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=94394) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 26 14:36:27 devstack cinder-volume[94394]: INFO cinder.image.image_utils [None req-6f646332-f2ac-41d0-ba0f-6ff0fa438019 tempest-VolumeAndVolumeTypeFromImageTest-1970055207 None] Image download 0.00 MB at 0.00 MB/s Aug 26 14:36:27 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b1496e2-7ed6-46a7-a605-50c94a53eed0]: (4, 'raw') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:36:27 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-6f646332-f2ac-41d0-ba0f-6ff0fa438019 tempest-VolumeAndVolumeTypeFromImageTest-1970055207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_64498df3-8e58-4103-b845-11d46a0bc11a_ofpg8id6devstack@QuobyteHD {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:36:27 devstack sudo[110399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_64498df3-8e58-4103-b845-11d46a0bc11a_ofpg8id6devstack@QuobyteHD Aug 26 14:36:27 devstack sudo[110399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:36:27 devstack sudo[110399]: pam_unix(sudo:session): session closed for user root Aug 26 14:36:27 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-6f646332-f2ac-41d0-ba0f-6ff0fa438019 tempest-VolumeAndVolumeTypeFromImageTest-1970055207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_64498df3-8e58-4103-b845-11d46a0bc11a_ofpg8id6devstack@QuobyteHD" returned: 0 in 0.535s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:36:27 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-6f646332-f2ac-41d0-ba0f-6ff0fa438019 tempest-VolumeAndVolumeTypeFromImageTest-1970055207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_64498df3-8e58-4103-b845-11d46a0bc11a_ofpg8id6devstack@QuobyteHD {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:36:27 devstack sudo[110403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_64498df3-8e58-4103-b845-11d46a0bc11a_ofpg8id6devstack@QuobyteHD Aug 26 14:36:27 devstack sudo[110403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:36:28 devstack sudo[110403]: pam_unix(sudo:session): session closed for user root Aug 26 14:36:28 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-6f646332-f2ac-41d0-ba0f-6ff0fa438019 tempest-VolumeAndVolumeTypeFromImageTest-1970055207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_64498df3-8e58-4103-b845-11d46a0bc11a_ofpg8id6devstack@QuobyteHD" returned: 1 in 0.358s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:36:28 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-6f646332-f2ac-41d0-ba0f-6ff0fa438019 tempest-VolumeAndVolumeTypeFromImageTest-1970055207 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_64498df3-8e58-4103-b845-11d46a0bc11a_ofpg8id6devstack@QuobyteHD' failed. Not Retrying. {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 14:36:28 devstack cinder-volume[94394]: DEBUG cinder.image.image_utils [None req-6f646332-f2ac-41d0-ba0f-6ff0fa438019 tempest-VolumeAndVolumeTypeFromImageTest-1970055207 None] Temporary image 64498df3-8e58-4103-b845-11d46a0bc11a is fetched for user c4d9e6a3e4de4b56bdc2cf12b4e779e1. {{(pid=94394) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 26 14:36:28 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ed86550-665d-4aff-842d-9ee05015ae9b]: (4, 'raw') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:36:28 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-6f646332-f2ac-41d0-ba0f-6ff0fa438019 tempest-VolumeAndVolumeTypeFromImageTest-1970055207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_64498df3-8e58-4103-b845-11d46a0bc11a_ofpg8id6devstack@QuobyteHD {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:36:28 devstack sudo[110408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_64498df3-8e58-4103-b845-11d46a0bc11a_ofpg8id6devstack@QuobyteHD Aug 26 14:36:28 devstack sudo[110408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:36:28 devstack sudo[110408]: pam_unix(sudo:session): session closed for user root Aug 26 14:36:28 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-6f646332-f2ac-41d0-ba0f-6ff0fa438019 tempest-VolumeAndVolumeTypeFromImageTest-1970055207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_64498df3-8e58-4103-b845-11d46a0bc11a_ofpg8id6devstack@QuobyteHD" returned: 0 in 0.424s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:36:28 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-6f646332-f2ac-41d0-ba0f-6ff0fa438019 tempest-VolumeAndVolumeTypeFromImageTest-1970055207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_64498df3-8e58-4103-b845-11d46a0bc11a_ofpg8id6devstack@QuobyteHD {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:36:28 devstack sudo[110412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_64498df3-8e58-4103-b845-11d46a0bc11a_ofpg8id6devstack@QuobyteHD Aug 26 14:36:28 devstack sudo[110412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:36:28 devstack sudo[110412]: pam_unix(sudo:session): session closed for user root Aug 26 14:36:28 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-6f646332-f2ac-41d0-ba0f-6ff0fa438019 tempest-VolumeAndVolumeTypeFromImageTest-1970055207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_64498df3-8e58-4103-b845-11d46a0bc11a_ofpg8id6devstack@QuobyteHD" returned: 1 in 0.473s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:36:28 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-6f646332-f2ac-41d0-ba0f-6ff0fa438019 tempest-VolumeAndVolumeTypeFromImageTest-1970055207 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_64498df3-8e58-4103-b845-11d46a0bc11a_ofpg8id6devstack@QuobyteHD' failed. Not Retrying. {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 14:36:28 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-6f646332-f2ac-41d0-ba0f-6ff0fa438019 tempest-VolumeAndVolumeTypeFromImageTest-1970055207 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:36:33 devstack cinder-volume[94394]: DEBUG oslo_service.periodic_task [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94394) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 14:36:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:36:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:36:33 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:36:33 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:36:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:36:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:36:33 devstack sudo[110454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:36:33 devstack sudo[110454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:36:34 devstack sudo[110454]: pam_unix(sudo:session): session closed for user root Aug 26 14:36:34 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.413s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:36:34 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:36:34 devstack cinder-volume[94394]: DEBUG oslo_service.periodic_task [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Running periodic task VolumeManager._thread_info {{(pid=94394) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 14:36:34 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] thread count: 28 {{(pid=94394) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 14:36:34 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] thread info: [<_MainThread(MainThread, started 126600738033792)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94394) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 14:36:38 devstack cinder-volume[94394]: DEBUG dbcounter [-] [94394] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=94394) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 14:36:38 devstack cinder-volume[94394]: DEBUG dbcounter [-] [94394] Writing DB stats cinder:SELECT=1,cinder:INSERT=1 {{(pid=94394) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 14:36:38 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-6ddfa63e-bc0f-4554-b2f3-e5ab8edbfdfa tempest-TestImageHashVerification-1974320999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 29.864s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:36:38 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-6ddfa63e-bc0f-4554-b2f3-e5ab8edbfdfa tempest-TestImageHashVerification-1974320999 None] Uploaded volume to glance image-id: 65f0a6ae-79ef-4d62-873d-f5e71ea0b840. {{(pid=94394) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Aug 26 14:36:38 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-6f646332-f2ac-41d0-ba0f-6ff0fa438019 tempest-VolumeAndVolumeTypeFromImageTest-1970055207 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.283s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:36:38 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-6f646332-f2ac-41d0-ba0f-6ff0fa438019 tempest-VolumeAndVolumeTypeFromImageTest-1970055207 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:36:26Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a964c720-e97a-4f99-a907-fea8d1d408d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26b9ec7ac8b4467a97b2a170cf541579',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:36:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:36:26Z,use_quota=True,user_id='c4d9e6a3e4de4b56bdc2cf12b4e779e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d9210ed-3d48-4777-b19c-95be68e30421),volume_type_id=2d9210ed-3d48-4777-b19c-95be68e30421)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:36:38 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-6f646332-f2ac-41d0-ba0f-6ff0fa438019 tempest-VolumeAndVolumeTypeFromImageTest-1970055207 None] Creating volume a964c720-e97a-4f99-a907-fea8d1d408d7 {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:36:38 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-6f646332-f2ac-41d0-ba0f-6ff0fa438019 tempest-VolumeAndVolumeTypeFromImageTest-1970055207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:36:38 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-6f646332-f2ac-41d0-ba0f-6ff0fa438019 tempest-VolumeAndVolumeTypeFromImageTest-1970055207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:36:38 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-6f646332-f2ac-41d0-ba0f-6ff0fa438019 tempest-VolumeAndVolumeTypeFromImageTest-1970055207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:36:38 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-6f646332-f2ac-41d0-ba0f-6ff0fa438019 tempest-VolumeAndVolumeTypeFromImageTest-1970055207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:36:38 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-6f646332-f2ac-41d0-ba0f-6ff0fa438019 tempest-VolumeAndVolumeTypeFromImageTest-1970055207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:36:38 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-6f646332-f2ac-41d0-ba0f-6ff0fa438019 tempest-VolumeAndVolumeTypeFromImageTest-1970055207 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:36:38 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-6f646332-f2ac-41d0-ba0f-6ff0fa438019 tempest-VolumeAndVolumeTypeFromImageTest-1970055207 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:36:38 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-6f646332-f2ac-41d0-ba0f-6ff0fa438019 tempest-VolumeAndVolumeTypeFromImageTest-1970055207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-a964c720-e97a-4f99-a907-fea8d1d408d7 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:36:38 devstack sudo[110496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-a964c720-e97a-4f99-a907-fea8d1d408d7 1073741824 Aug 26 14:36:38 devstack sudo[110496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:36:38 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-6ddfa63e-bc0f-4554-b2f3-e5ab8edbfdfa tempest-TestImageHashVerification-1974320999 None] Copy volume to image completed successfully. Aug 26 14:36:38 devstack sudo[110496]: pam_unix(sudo:session): session closed for user root Aug 26 14:36:38 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-6f646332-f2ac-41d0-ba0f-6ff0fa438019 tempest-VolumeAndVolumeTypeFromImageTest-1970055207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-a964c720-e97a-4f99-a907-fea8d1d408d7 1073741824" returned: 0 in 0.676s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:36:39 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-6f646332-f2ac-41d0-ba0f-6ff0fa438019 tempest-VolumeAndVolumeTypeFromImageTest-1970055207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-a964c720-e97a-4f99-a907-fea8d1d408d7 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:36:39 devstack sudo[110546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-a964c720-e97a-4f99-a907-fea8d1d408d7 Aug 26 14:36:39 devstack sudo[110546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:36:39 devstack sudo[110546]: pam_unix(sudo:session): session closed for user root Aug 26 14:36:39 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-6f646332-f2ac-41d0-ba0f-6ff0fa438019 tempest-VolumeAndVolumeTypeFromImageTest-1970055207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-a964c720-e97a-4f99-a907-fea8d1d408d7" returned: 0 in 0.449s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:36:39 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-6f646332-f2ac-41d0-ba0f-6ff0fa438019 tempest-VolumeAndVolumeTypeFromImageTest-1970055207 None] <== create_volume: return (1191ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:36:39 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-6f646332-f2ac-41d0-ba0f-6ff0fa438019 tempest-VolumeAndVolumeTypeFromImageTest-1970055207 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.197s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:36:39 devstack cinder-volume[94394]: DEBUG cinder.volume.volume_utils [None req-6f646332-f2ac-41d0-ba0f-6ff0fa438019 tempest-VolumeAndVolumeTypeFromImageTest-1970055207 None] Attempting download of 64498df3-8e58-4103-b845-11d46a0bc11a ((None, [{'url': 'file:///opt/stack/data/glance/images/64498df3-8e58-4103-b845-11d46a0bc11a', 'metadata': {}}])) to volume a964c720-e97a-4f99-a907-fea8d1d408d7. {{(pid=94394) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 26 14:36:39 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[01cc58fe-fadd-4634-b043-fce4a366dc44]: (4, 'raw') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:36:39 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-6f646332-f2ac-41d0-ba0f-6ff0fa438019 tempest-VolumeAndVolumeTypeFromImageTest-1970055207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_64498df3-8e58-4103-b845-11d46a0bc11a_besob1n8 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:36:39 devstack sudo[110570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_64498df3-8e58-4103-b845-11d46a0bc11a_besob1n8 Aug 26 14:36:39 devstack sudo[110570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:36:39 devstack sudo[110570]: pam_unix(sudo:session): session closed for user root Aug 26 14:36:39 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-6f646332-f2ac-41d0-ba0f-6ff0fa438019 tempest-VolumeAndVolumeTypeFromImageTest-1970055207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_64498df3-8e58-4103-b845-11d46a0bc11a_besob1n8" returned: 0 in 0.369s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:36:39 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-6f646332-f2ac-41d0-ba0f-6ff0fa438019 tempest-VolumeAndVolumeTypeFromImageTest-1970055207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_64498df3-8e58-4103-b845-11d46a0bc11a_besob1n8 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:36:39 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-921467c7-f31f-46ea-9f89-69bcc7d0b86b tempest-TestImageHashVerification-1974320999 None] Acquiring lock "cinder-fcb7eb5e-ff4a-4669-8546-90a6bb417b25-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:36:39 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-921467c7-f31f-46ea-9f89-69bcc7d0b86b tempest-TestImageHashVerification-1974320999 None] Lock "cinder-fcb7eb5e-ff4a-4669-8546-90a6bb417b25-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:36:40 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-921467c7-f31f-46ea-9f89-69bcc7d0b86b tempest-TestImageHashVerification-1974320999 None] Acquiring lock "cinder-quobyte-fcb7eb5e-ff4a-4669-8546-90a6bb417b25" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:36:40 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-921467c7-f31f-46ea-9f89-69bcc7d0b86b tempest-TestImageHashVerification-1974320999 None] Lock "cinder-quobyte-fcb7eb5e-ff4a-4669-8546-90a6bb417b25" acquired by "delete_volume" :: waited 0.019s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:36:40 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[11840204-a71e-4252-989b-2c922a520ab1]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:36:40 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-921467c7-f31f-46ea-9f89-69bcc7d0b86b tempest-TestImageHashVerification-1974320999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-fcb7eb5e-ff4a-4669-8546-90a6bb417b25 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:36:40 devstack sudo[110590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_64498df3-8e58-4103-b845-11d46a0bc11a_besob1n8 Aug 26 14:36:40 devstack sudo[110590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:36:40 devstack sudo[110592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-fcb7eb5e-ff4a-4669-8546-90a6bb417b25 Aug 26 14:36:40 devstack sudo[110592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:36:40 devstack sudo[110590]: pam_unix(sudo:session): session closed for user root Aug 26 14:36:40 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-6f646332-f2ac-41d0-ba0f-6ff0fa438019 tempest-VolumeAndVolumeTypeFromImageTest-1970055207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_64498df3-8e58-4103-b845-11d46a0bc11a_besob1n8" returned: 1 in 0.361s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:36:40 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-6f646332-f2ac-41d0-ba0f-6ff0fa438019 tempest-VolumeAndVolumeTypeFromImageTest-1970055207 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_64498df3-8e58-4103-b845-11d46a0bc11a_besob1n8' failed. Not Retrying. {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 14:36:40 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[83c35703-44f6-4695-9ed7-dbb64e59a8c0]: (4, 'raw') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:36:40 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-6f646332-f2ac-41d0-ba0f-6ff0fa438019 tempest-VolumeAndVolumeTypeFromImageTest-1970055207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_64498df3-8e58-4103-b845-11d46a0bc11a_ofpg8id6devstack@QuobyteHD {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:36:40 devstack sudo[110596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_64498df3-8e58-4103-b845-11d46a0bc11a_ofpg8id6devstack@QuobyteHD Aug 26 14:36:40 devstack sudo[110596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:36:40 devstack sudo[110592]: pam_unix(sudo:session): session closed for user root Aug 26 14:36:40 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-921467c7-f31f-46ea-9f89-69bcc7d0b86b tempest-TestImageHashVerification-1974320999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-fcb7eb5e-ff4a-4669-8546-90a6bb417b25" returned: 0 in 0.441s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:36:40 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-921467c7-f31f-46ea-9f89-69bcc7d0b86b tempest-TestImageHashVerification-1974320999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-fcb7eb5e-ff4a-4669-8546-90a6bb417b25 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:36:40 devstack sudo[110602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-fcb7eb5e-ff4a-4669-8546-90a6bb417b25 Aug 26 14:36:40 devstack sudo[110602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:36:40 devstack sudo[110596]: pam_unix(sudo:session): session closed for user root Aug 26 14:36:40 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-6f646332-f2ac-41d0-ba0f-6ff0fa438019 tempest-VolumeAndVolumeTypeFromImageTest-1970055207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_64498df3-8e58-4103-b845-11d46a0bc11a_ofpg8id6devstack@QuobyteHD" returned: 0 in 0.414s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:36:40 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-6f646332-f2ac-41d0-ba0f-6ff0fa438019 tempest-VolumeAndVolumeTypeFromImageTest-1970055207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_64498df3-8e58-4103-b845-11d46a0bc11a_ofpg8id6devstack@QuobyteHD {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:36:40 devstack sudo[110602]: pam_unix(sudo:session): session closed for user root Aug 26 14:36:40 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-921467c7-f31f-46ea-9f89-69bcc7d0b86b tempest-TestImageHashVerification-1974320999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-fcb7eb5e-ff4a-4669-8546-90a6bb417b25" returned: 0 in 0.276s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:36:40 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-921467c7-f31f-46ea-9f89-69bcc7d0b86b tempest-TestImageHashVerification-1974320999 None] Lock "cinder-quobyte-fcb7eb5e-ff4a-4669-8546-90a6bb417b25" released by "delete_volume" :: held 0.766s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:36:40 devstack sudo[110606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_64498df3-8e58-4103-b845-11d46a0bc11a_ofpg8id6devstack@QuobyteHD Aug 26 14:36:40 devstack sudo[110606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:36:40 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-921467c7-f31f-46ea-9f89-69bcc7d0b86b tempest-TestImageHashVerification-1974320999 None] Created reservations ['2861323c-6589-480a-8064-5da1428f8099', 'cb7520d3-8085-4629-bcdf-14003c437db4', 'a4472621-1870-488f-8ef2-cd3f9f34942b', 'ac7ca0e6-681b-41b1-8d74-ad999933f597'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:36:41 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-921467c7-f31f-46ea-9f89-69bcc7d0b86b tempest-TestImageHashVerification-1974320999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:36:41 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-921467c7-f31f-46ea-9f89-69bcc7d0b86b tempest-TestImageHashVerification-1974320999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:36:41 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-921467c7-f31f-46ea-9f89-69bcc7d0b86b tempest-TestImageHashVerification-1974320999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:36:41 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-921467c7-f31f-46ea-9f89-69bcc7d0b86b tempest-TestImageHashVerification-1974320999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:36:41 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-921467c7-f31f-46ea-9f89-69bcc7d0b86b tempest-TestImageHashVerification-1974320999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:36:41 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-921467c7-f31f-46ea-9f89-69bcc7d0b86b tempest-TestImageHashVerification-1974320999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:36:41 devstack sudo[110611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:36:41 devstack sudo[110611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:36:41 devstack sudo[110606]: pam_unix(sudo:session): session closed for user root Aug 26 14:36:41 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-6f646332-f2ac-41d0-ba0f-6ff0fa438019 tempest-VolumeAndVolumeTypeFromImageTest-1970055207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_64498df3-8e58-4103-b845-11d46a0bc11a_ofpg8id6devstack@QuobyteHD" returned: 1 in 0.499s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:36:41 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-6f646332-f2ac-41d0-ba0f-6ff0fa438019 tempest-VolumeAndVolumeTypeFromImageTest-1970055207 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_64498df3-8e58-4103-b845-11d46a0bc11a_ofpg8id6devstack@QuobyteHD' failed. Not Retrying. {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 14:36:41 devstack cinder-volume[94394]: DEBUG cinder.image.image_utils [None req-6f646332-f2ac-41d0-ba0f-6ff0fa438019 tempest-VolumeAndVolumeTypeFromImageTest-1970055207 None] 64498df3-8e58-4103-b845-11d46a0bc11a was raw, converting to qcow2 {{(pid=94394) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 26 14:36:41 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-6f646332-f2ac-41d0-ba0f-6ff0fa438019 tempest-VolumeAndVolumeTypeFromImageTest-1970055207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_64498df3-8e58-4103-b845-11d46a0bc11a_ofpg8id6devstack@QuobyteHD /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-a964c720-e97a-4f99-a907-fea8d1d408d7 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:36:41 devstack sudo[110616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_64498df3-8e58-4103-b845-11d46a0bc11a_ofpg8id6devstack@QuobyteHD /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-a964c720-e97a-4f99-a907-fea8d1d408d7 Aug 26 14:36:41 devstack sudo[110616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:36:41 devstack sudo[110611]: pam_unix(sudo:session): session closed for user root Aug 26 14:36:41 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-921467c7-f31f-46ea-9f89-69bcc7d0b86b tempest-TestImageHashVerification-1974320999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.300s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:36:41 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-921467c7-f31f-46ea-9f89-69bcc7d0b86b tempest-TestImageHashVerification-1974320999 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:36:41 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-921467c7-f31f-46ea-9f89-69bcc7d0b86b tempest-TestImageHashVerification-1974320999 None] Deleted volume successfully. Aug 26 14:36:41 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-921467c7-f31f-46ea-9f89-69bcc7d0b86b tempest-TestImageHashVerification-1974320999 None] Lock "cinder-fcb7eb5e-ff4a-4669-8546-90a6bb417b25-delete_volume" released by "delete_volume" :: held 1.471s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:36:41 devstack sudo[110616]: pam_unix(sudo:session): session closed for user root Aug 26 14:36:41 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-6f646332-f2ac-41d0-ba0f-6ff0fa438019 tempest-VolumeAndVolumeTypeFromImageTest-1970055207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_64498df3-8e58-4103-b845-11d46a0bc11a_ofpg8id6devstack@QuobyteHD /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-a964c720-e97a-4f99-a907-fea8d1d408d7" returned: 0 in 0.657s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:36:41 devstack cinder-volume[94394]: DEBUG cinder.image.image_utils [None req-6f646332-f2ac-41d0-ba0f-6ff0fa438019 tempest-VolumeAndVolumeTypeFromImageTest-1970055207 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_64498df3-8e58-4103-b845-11d46a0bc11a_ofpg8id6devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-a964c720-e97a-4f99-a907-fea8d1d408d7 {{(pid=94394) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 14:36:41 devstack cinder-volume[94394]: INFO cinder.image.image_utils [None req-6f646332-f2ac-41d0-ba0f-6ff0fa438019 tempest-VolumeAndVolumeTypeFromImageTest-1970055207 None] Converted 0.00 MB image at 0.00 MB/s Aug 26 14:36:41 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-6f646332-f2ac-41d0-ba0f-6ff0fa438019 tempest-VolumeAndVolumeTypeFromImageTest-1970055207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-a964c720-e97a-4f99-a907-fea8d1d408d7 1G {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:36:41 devstack sudo[110623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-a964c720-e97a-4f99-a907-fea8d1d408d7 1G Aug 26 14:36:41 devstack sudo[110623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:36:42 devstack sudo[110623]: pam_unix(sudo:session): session closed for user root Aug 26 14:36:42 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-6f646332-f2ac-41d0-ba0f-6ff0fa438019 tempest-VolumeAndVolumeTypeFromImageTest-1970055207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-a964c720-e97a-4f99-a907-fea8d1d408d7 1G" returned: 0 in 0.671s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:36:42 devstack cinder-volume[94394]: DEBUG cinder.volume.volume_utils [None req-6f646332-f2ac-41d0-ba0f-6ff0fa438019 tempest-VolumeAndVolumeTypeFromImageTest-1970055207 None] Downloaded image 64498df3-8e58-4103-b845-11d46a0bc11a ((None, [{'url': 'file:///opt/stack/data/glance/images/64498df3-8e58-4103-b845-11d46a0bc11a', 'metadata': {}}])) to volume a964c720-e97a-4f99-a907-fea8d1d408d7 successfully. {{(pid=94394) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 26 14:36:42 devstack cinder-volume[94394]: DEBUG cinder.image.image_utils [None req-6f646332-f2ac-41d0-ba0f-6ff0fa438019 tempest-VolumeAndVolumeTypeFromImageTest-1970055207 None] Temporary image 64498df3-8e58-4103-b845-11d46a0bc11a for user c4d9e6a3e4de4b56bdc2cf12b4e779e1 is deleted. {{(pid=94394) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 26 14:36:42 devstack cinder-volume[94394]: DEBUG cinder.volume.volume_utils [None req-6f646332-f2ac-41d0-ba0f-6ff0fa438019 tempest-VolumeAndVolumeTypeFromImageTest-1970055207 None] Marking volume a964c720-e97a-4f99-a907-fea8d1d408d7 as bootable. {{(pid=94394) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 26 14:36:42 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f646332-f2ac-41d0-ba0f-6ff0fa438019 tempest-VolumeAndVolumeTypeFromImageTest-1970055207 None] Copying metadata from image 64498df3-8e58-4103-b845-11d46a0bc11a to a964c720-e97a-4f99-a907-fea8d1d408d7. {{(pid=94394) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 26 14:36:42 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f646332-f2ac-41d0-ba0f-6ff0fa438019 tempest-VolumeAndVolumeTypeFromImageTest-1970055207 None] Creating volume glance metadata for volume a964c720-e97a-4f99-a907-fea8d1d408d7 backed by image 64498df3-8e58-4103-b845-11d46a0bc11a with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '64498df3-8e58-4103-b845-11d46a0bc11a', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '7aaf51497bc6c322be4e521b2b45ebf7', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=94394) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 26 14:36:42 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-6f646332-f2ac-41d0-ba0f-6ff0fa438019 tempest-VolumeAndVolumeTypeFromImageTest-1970055207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3ca2977-c5cb-4e5e-b90c-f49d3c6e5418) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a964c720-e97a-4f99-a907-fea8d1d408d7', 'volume_size': 1, 'image_id': '64498df3-8e58-4103-b845-11d46a0bc11a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/64498df3-8e58-4103-b845-11d46a0bc11a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7aaf51497bc6c322be4e521b2b45ebf7', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '26b9ec7ac8b4467a97b2a170cf541579', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5a661827d1866316578976853c51ddce34c4c83169c862c671d331ea3f51501273cc391c9c67ee76bc75f0350833d1bc798e998f53f7022e816a160f08743d1b', 'id': '64498df3-8e58-4103-b845-11d46a0bc11a', 'created_at': datetime.datetime(2026, 8, 26, 12, 36, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 12, 36, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/64498df3-8e58-4103-b845-11d46a0bc11a/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:36:42 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-6f646332-f2ac-41d0-ba0f-6ff0fa438019 tempest-VolumeAndVolumeTypeFromImageTest-1970055207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b4b4d91-c973-4803-8aaa-40ad5d6edd36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:36:42 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-6f646332-f2ac-41d0-ba0f-6ff0fa438019 tempest-VolumeAndVolumeTypeFromImageTest-1970055207 None] Volume volume-a964c720-e97a-4f99-a907-fea8d1d408d7 (a964c720-e97a-4f99-a907-fea8d1d408d7): created successfully Aug 26 14:36:42 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-6f646332-f2ac-41d0-ba0f-6ff0fa438019 tempest-VolumeAndVolumeTypeFromImageTest-1970055207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b4b4d91-c973-4803-8aaa-40ad5d6edd36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:36:42 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-6f646332-f2ac-41d0-ba0f-6ff0fa438019 tempest-VolumeAndVolumeTypeFromImageTest-1970055207 None] Flow 'volume_create_manager' (731aaf46-2e1a-49d6-af2d-30221d02624f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:36:42 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-6f646332-f2ac-41d0-ba0f-6ff0fa438019 tempest-VolumeAndVolumeTypeFromImageTest-1970055207 None] Created volume successfully. Aug 26 14:36:43 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-55346537-21c3-4bb7-bd33-2e753ffb18b6 tempest-TestMinimumBasicScenario-1164867133 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:36:43 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-55346537-21c3-4bb7-bd33-2e753ffb18b6 tempest-TestMinimumBasicScenario-1164867133 None] Flow 'volume_create_manager' (a0b86588-b2c3-4ab8-8e0a-b5fdc1f7e756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:36:43 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-55346537-21c3-4bb7-bd33-2e753ffb18b6 tempest-TestMinimumBasicScenario-1164867133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a7bdc3b-723f-48c2-b0ba-a0a3ac066fc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:36:43 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-55346537-21c3-4bb7-bd33-2e753ffb18b6 tempest-TestMinimumBasicScenario-1164867133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a7bdc3b-723f-48c2-b0ba-a0a3ac066fc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:36:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1839621985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=148d0d07-61ca-4b8e-aae6-adb03371fe4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='970c106e6448407db68d7ac71c9e9c87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:36:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:36:44Z,use_quota=True,user_id='4b1b963078184918b260dd6d445b27b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:36:43 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-55346537-21c3-4bb7-bd33-2e753ffb18b6 tempest-TestMinimumBasicScenario-1164867133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b182079-b3c2-45ba-b979-c3cfb93af03c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:36:43 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-55346537-21c3-4bb7-bd33-2e753ffb18b6 tempest-TestMinimumBasicScenario-1164867133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b182079-b3c2-45ba-b979-c3cfb93af03c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:36:43 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-55346537-21c3-4bb7-bd33-2e753ffb18b6 tempest-TestMinimumBasicScenario-1164867133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75d754a7-a9d1-4948-b2e1-aeecd77274fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:36:43 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-55346537-21c3-4bb7-bd33-2e753ffb18b6 tempest-TestMinimumBasicScenario-1164867133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75d754a7-a9d1-4948-b2e1-aeecd77274fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '148d0d07-61ca-4b8e-aae6-adb03371fe4d', 'volume_name': 'volume-148d0d07-61ca-4b8e-aae6-adb03371fe4d', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:36:43 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-55346537-21c3-4bb7-bd33-2e753ffb18b6 tempest-TestMinimumBasicScenario-1164867133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f42688b7-db24-48d2-bb3d-4ae19c7e459f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:36:43 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-55346537-21c3-4bb7-bd33-2e753ffb18b6 tempest-TestMinimumBasicScenario-1164867133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f42688b7-db24-48d2-bb3d-4ae19c7e459f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:36:43 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-55346537-21c3-4bb7-bd33-2e753ffb18b6 tempest-TestMinimumBasicScenario-1164867133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8552b64b-a616-4b92-ace9-9da92c706629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:36:43 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-55346537-21c3-4bb7-bd33-2e753ffb18b6 tempest-TestMinimumBasicScenario-1164867133 None] Volume 148d0d07-61ca-4b8e-aae6-adb03371fe4d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-148d0d07-61ca-4b8e-aae6-adb03371fe4d', 'volume_size': 1} Aug 26 14:36:43 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-55346537-21c3-4bb7-bd33-2e753ffb18b6 tempest-TestMinimumBasicScenario-1164867133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:36:43 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-55346537-21c3-4bb7-bd33-2e753ffb18b6 tempest-TestMinimumBasicScenario-1164867133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:36:43 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-55346537-21c3-4bb7-bd33-2e753ffb18b6 tempest-TestMinimumBasicScenario-1164867133 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:36:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1839621985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=148d0d07-61ca-4b8e-aae6-adb03371fe4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='970c106e6448407db68d7ac71c9e9c87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:36:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:36:44Z,use_quota=True,user_id='4b1b963078184918b260dd6d445b27b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:36:43 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-55346537-21c3-4bb7-bd33-2e753ffb18b6 tempest-TestMinimumBasicScenario-1164867133 None] Creating volume 148d0d07-61ca-4b8e-aae6-adb03371fe4d {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:36:43 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-55346537-21c3-4bb7-bd33-2e753ffb18b6 tempest-TestMinimumBasicScenario-1164867133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:36:43 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-55346537-21c3-4bb7-bd33-2e753ffb18b6 tempest-TestMinimumBasicScenario-1164867133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:36:43 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-55346537-21c3-4bb7-bd33-2e753ffb18b6 tempest-TestMinimumBasicScenario-1164867133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:36:43 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-55346537-21c3-4bb7-bd33-2e753ffb18b6 tempest-TestMinimumBasicScenario-1164867133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:36:43 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-55346537-21c3-4bb7-bd33-2e753ffb18b6 tempest-TestMinimumBasicScenario-1164867133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:36:43 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-55346537-21c3-4bb7-bd33-2e753ffb18b6 tempest-TestMinimumBasicScenario-1164867133 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:36:43 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-55346537-21c3-4bb7-bd33-2e753ffb18b6 tempest-TestMinimumBasicScenario-1164867133 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:36:43 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-55346537-21c3-4bb7-bd33-2e753ffb18b6 tempest-TestMinimumBasicScenario-1164867133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-148d0d07-61ca-4b8e-aae6-adb03371fe4d 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:36:43 devstack sudo[110647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-148d0d07-61ca-4b8e-aae6-adb03371fe4d 1073741824 Aug 26 14:36:43 devstack sudo[110647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:36:43 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-11639635-5205-48f4-bd84-879ec862818f tempest-VolumeAndVolumeTypeFromImageTest-1970055207 None] Acquiring lock "cinder-a964c720-e97a-4f99-a907-fea8d1d408d7-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:36:44 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-11639635-5205-48f4-bd84-879ec862818f tempest-VolumeAndVolumeTypeFromImageTest-1970055207 None] Lock "cinder-a964c720-e97a-4f99-a907-fea8d1d408d7-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:36:44 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-11639635-5205-48f4-bd84-879ec862818f tempest-VolumeAndVolumeTypeFromImageTest-1970055207 None] Acquiring lock "cinder-quobyte-a964c720-e97a-4f99-a907-fea8d1d408d7" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:36:44 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-11639635-5205-48f4-bd84-879ec862818f tempest-VolumeAndVolumeTypeFromImageTest-1970055207 None] Lock "cinder-quobyte-a964c720-e97a-4f99-a907-fea8d1d408d7" acquired by "delete_volume" :: waited 0.020s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:36:44 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[60bba567-c72c-4f92-8aa4-06f5b33ecec6]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:36:44 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-11639635-5205-48f4-bd84-879ec862818f tempest-VolumeAndVolumeTypeFromImageTest-1970055207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-a964c720-e97a-4f99-a907-fea8d1d408d7 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:36:44 devstack sudo[110652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-a964c720-e97a-4f99-a907-fea8d1d408d7 Aug 26 14:36:44 devstack sudo[110652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:36:44 devstack sudo[110647]: pam_unix(sudo:session): session closed for user root Aug 26 14:36:44 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-55346537-21c3-4bb7-bd33-2e753ffb18b6 tempest-TestMinimumBasicScenario-1164867133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-148d0d07-61ca-4b8e-aae6-adb03371fe4d 1073741824" returned: 0 in 0.532s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:36:44 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-55346537-21c3-4bb7-bd33-2e753ffb18b6 tempest-TestMinimumBasicScenario-1164867133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-148d0d07-61ca-4b8e-aae6-adb03371fe4d {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:36:44 devstack sudo[110655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-148d0d07-61ca-4b8e-aae6-adb03371fe4d Aug 26 14:36:44 devstack sudo[110655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:36:44 devstack sudo[110652]: pam_unix(sudo:session): session closed for user root Aug 26 14:36:44 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-11639635-5205-48f4-bd84-879ec862818f tempest-VolumeAndVolumeTypeFromImageTest-1970055207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-a964c720-e97a-4f99-a907-fea8d1d408d7" returned: 0 in 0.466s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:36:44 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-11639635-5205-48f4-bd84-879ec862818f tempest-VolumeAndVolumeTypeFromImageTest-1970055207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-a964c720-e97a-4f99-a907-fea8d1d408d7 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:36:44 devstack sudo[110655]: pam_unix(sudo:session): session closed for user root Aug 26 14:36:44 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-55346537-21c3-4bb7-bd33-2e753ffb18b6 tempest-TestMinimumBasicScenario-1164867133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-148d0d07-61ca-4b8e-aae6-adb03371fe4d" returned: 0 in 0.298s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:36:44 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-55346537-21c3-4bb7-bd33-2e753ffb18b6 tempest-TestMinimumBasicScenario-1164867133 None] <== create_volume: return (880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:36:44 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-55346537-21c3-4bb7-bd33-2e753ffb18b6 tempest-TestMinimumBasicScenario-1164867133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:36:44 devstack sudo[110661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-a964c720-e97a-4f99-a907-fea8d1d408d7 Aug 26 14:36:44 devstack sudo[110661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:36:44 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-55346537-21c3-4bb7-bd33-2e753ffb18b6 tempest-TestMinimumBasicScenario-1164867133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8552b64b-a616-4b92-ace9-9da92c706629) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-148d0d07-61ca-4b8e-aae6-adb03371fe4d', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:36:44 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-55346537-21c3-4bb7-bd33-2e753ffb18b6 tempest-TestMinimumBasicScenario-1164867133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c90588ed-7d92-4856-8e49-57b002a1e856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:36:44 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-55346537-21c3-4bb7-bd33-2e753ffb18b6 tempest-TestMinimumBasicScenario-1164867133 None] Volume volume-148d0d07-61ca-4b8e-aae6-adb03371fe4d (148d0d07-61ca-4b8e-aae6-adb03371fe4d): created successfully Aug 26 14:36:44 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-55346537-21c3-4bb7-bd33-2e753ffb18b6 tempest-TestMinimumBasicScenario-1164867133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c90588ed-7d92-4856-8e49-57b002a1e856) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:36:44 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-55346537-21c3-4bb7-bd33-2e753ffb18b6 tempest-TestMinimumBasicScenario-1164867133 None] Flow 'volume_create_manager' (a0b86588-b2c3-4ab8-8e0a-b5fdc1f7e756) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:36:44 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-55346537-21c3-4bb7-bd33-2e753ffb18b6 tempest-TestMinimumBasicScenario-1164867133 None] Created volume successfully. Aug 26 14:36:44 devstack sudo[110661]: pam_unix(sudo:session): session closed for user root Aug 26 14:36:44 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-11639635-5205-48f4-bd84-879ec862818f tempest-VolumeAndVolumeTypeFromImageTest-1970055207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-a964c720-e97a-4f99-a907-fea8d1d408d7" returned: 0 in 0.331s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:36:44 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-11639635-5205-48f4-bd84-879ec862818f tempest-VolumeAndVolumeTypeFromImageTest-1970055207 None] Lock "cinder-quobyte-a964c720-e97a-4f99-a907-fea8d1d408d7" released by "delete_volume" :: held 0.847s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:36:44 devstack cinder-volume[94394]: WARNING cinder.quota [None req-11639635-5205-48f4-bd84-879ec862818f tempest-VolumeAndVolumeTypeFromImageTest-1970055207 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Aug 26 14:36:44 devstack cinder-volume[94394]: WARNING cinder.quota [None req-11639635-5205-48f4-bd84-879ec862818f tempest-VolumeAndVolumeTypeFromImageTest-1970055207 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Aug 26 14:36:44 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-11639635-5205-48f4-bd84-879ec862818f tempest-VolumeAndVolumeTypeFromImageTest-1970055207 None] Created reservations ['145cf105-bb7d-4628-b23d-74e1fdbddf21', 'fc787413-d782-41c7-b88c-e57b156e2917', '0d67a403-817e-4bd4-8815-4a1bf6b1caf1', 'a3123e85-2b54-4534-9e8e-d2ad7fa8e207'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:36:45 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-11639635-5205-48f4-bd84-879ec862818f tempest-VolumeAndVolumeTypeFromImageTest-1970055207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:36:45 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-11639635-5205-48f4-bd84-879ec862818f tempest-VolumeAndVolumeTypeFromImageTest-1970055207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:36:45 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-11639635-5205-48f4-bd84-879ec862818f tempest-VolumeAndVolumeTypeFromImageTest-1970055207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:36:45 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-11639635-5205-48f4-bd84-879ec862818f tempest-VolumeAndVolumeTypeFromImageTest-1970055207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:36:45 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-11639635-5205-48f4-bd84-879ec862818f tempest-VolumeAndVolumeTypeFromImageTest-1970055207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:36:45 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-11639635-5205-48f4-bd84-879ec862818f tempest-VolumeAndVolumeTypeFromImageTest-1970055207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:36:45 devstack sudo[110664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:36:45 devstack sudo[110664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:36:45 devstack sudo[110664]: pam_unix(sudo:session): session closed for user root Aug 26 14:36:45 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-11639635-5205-48f4-bd84-879ec862818f tempest-VolumeAndVolumeTypeFromImageTest-1970055207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.258s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:36:45 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-11639635-5205-48f4-bd84-879ec862818f tempest-VolumeAndVolumeTypeFromImageTest-1970055207 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:36:45 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-11639635-5205-48f4-bd84-879ec862818f tempest-VolumeAndVolumeTypeFromImageTest-1970055207 None] Deleted volume successfully. Aug 26 14:36:45 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-11639635-5205-48f4-bd84-879ec862818f tempest-VolumeAndVolumeTypeFromImageTest-1970055207 None] Lock "cinder-a964c720-e97a-4f99-a907-fea8d1d408d7-delete_volume" released by "delete_volume" :: held 1.326s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:36:47 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [req-e5910d5c-29e3-4d4e-8bcc-6ad3a5b66fc2 req-87ade7d8-4b7b-42f9-a5de-9f89cdac3ee7 tempest-TestMinimumBasicScenario-1164867133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:36:47 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [req-e5910d5c-29e3-4d4e-8bcc-6ad3a5b66fc2 req-87ade7d8-4b7b-42f9-a5de-9f89cdac3ee7 tempest-TestMinimumBasicScenario-1164867133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:36:47 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [req-e5910d5c-29e3-4d4e-8bcc-6ad3a5b66fc2 req-87ade7d8-4b7b-42f9-a5de-9f89cdac3ee7 tempest-TestMinimumBasicScenario-1164867133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.040s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:36:47 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [req-e5910d5c-29e3-4d4e-8bcc-6ad3a5b66fc2 req-87ade7d8-4b7b-42f9-a5de-9f89cdac3ee7 tempest-TestMinimumBasicScenario-1164867133 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b', 'name': 'volume-148d0d07-61ca-4b8e-aae6-adb03371fe4d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '865b58fc-3b31-4658-ab58-bbacd7b30fdd', 'enforce_multipath': True} {{(pid=94394) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 14:36:47 devstack cinder-volume[94394]: INFO cinder.volume.manager [req-e5910d5c-29e3-4d4e-8bcc-6ad3a5b66fc2 req-87ade7d8-4b7b-42f9-a5de-9f89cdac3ee7 tempest-TestMinimumBasicScenario-1164867133 None] attachment_update completed successfully. Aug 26 14:36:51 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-a45da2eb-1322-4f23-81d1-8c4df85407dd tempest-CinderUnicodeTest-413700163 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:36:51 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-a45da2eb-1322-4f23-81d1-8c4df85407dd tempest-CinderUnicodeTest-413700163 None] Flow 'volume_create_manager' (dbebacab-4d9e-47ab-a6a0-447a2394bedf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:36:51 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-a45da2eb-1322-4f23-81d1-8c4df85407dd tempest-CinderUnicodeTest-413700163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55bcfc72-b549-4b36-beb1-d2b8cea3ce3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:36:51 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-a45da2eb-1322-4f23-81d1-8c4df85407dd tempest-CinderUnicodeTest-413700163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55bcfc72-b549-4b36-beb1-d2b8cea3ce3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:36:51Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f52915a-e713-4359-ae3d-da06758d9ed9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ce633c6717b4ae6a1982f6632cc731f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:36:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:36:52Z,use_quota=True,user_id='9a589a2bed104df683e7730ff17f1148',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:36:51 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-a45da2eb-1322-4f23-81d1-8c4df85407dd tempest-CinderUnicodeTest-413700163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0915c475-84f7-4928-b7ae-98522601a777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:36:51 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-a45da2eb-1322-4f23-81d1-8c4df85407dd tempest-CinderUnicodeTest-413700163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0915c475-84f7-4928-b7ae-98522601a777) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:36:51 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-a45da2eb-1322-4f23-81d1-8c4df85407dd tempest-CinderUnicodeTest-413700163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50a1f8cf-48a2-4733-b0cc-2132ec2904a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:36:51 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-a45da2eb-1322-4f23-81d1-8c4df85407dd tempest-CinderUnicodeTest-413700163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50a1f8cf-48a2-4733-b0cc-2132ec2904a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f52915a-e713-4359-ae3d-da06758d9ed9', 'volume_name': 'volume-7f52915a-e713-4359-ae3d-da06758d9ed9', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:36:51 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-a45da2eb-1322-4f23-81d1-8c4df85407dd tempest-CinderUnicodeTest-413700163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a326607-7d5a-482e-90d8-553a7aeadbe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:36:51 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-a45da2eb-1322-4f23-81d1-8c4df85407dd tempest-CinderUnicodeTest-413700163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a326607-7d5a-482e-90d8-553a7aeadbe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:36:51 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-a45da2eb-1322-4f23-81d1-8c4df85407dd tempest-CinderUnicodeTest-413700163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5791fa4-34e2-41be-b712-06684be166f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:36:51 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-a45da2eb-1322-4f23-81d1-8c4df85407dd tempest-CinderUnicodeTest-413700163 None] Volume 7f52915a-e713-4359-ae3d-da06758d9ed9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f52915a-e713-4359-ae3d-da06758d9ed9', 'volume_size': 1} Aug 26 14:36:51 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-a45da2eb-1322-4f23-81d1-8c4df85407dd tempest-CinderUnicodeTest-413700163 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:36:51 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-a45da2eb-1322-4f23-81d1-8c4df85407dd tempest-CinderUnicodeTest-413700163 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:36:51 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-a45da2eb-1322-4f23-81d1-8c4df85407dd tempest-CinderUnicodeTest-413700163 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:36:51Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f52915a-e713-4359-ae3d-da06758d9ed9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ce633c6717b4ae6a1982f6632cc731f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:36:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:36:52Z,use_quota=True,user_id='9a589a2bed104df683e7730ff17f1148',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:36:51 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-a45da2eb-1322-4f23-81d1-8c4df85407dd tempest-CinderUnicodeTest-413700163 None] Creating volume 7f52915a-e713-4359-ae3d-da06758d9ed9 {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:36:51 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-a45da2eb-1322-4f23-81d1-8c4df85407dd tempest-CinderUnicodeTest-413700163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:36:51 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-a45da2eb-1322-4f23-81d1-8c4df85407dd tempest-CinderUnicodeTest-413700163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:36:51 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-a45da2eb-1322-4f23-81d1-8c4df85407dd tempest-CinderUnicodeTest-413700163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:36:51 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-a45da2eb-1322-4f23-81d1-8c4df85407dd tempest-CinderUnicodeTest-413700163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:36:51 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-a45da2eb-1322-4f23-81d1-8c4df85407dd tempest-CinderUnicodeTest-413700163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:36:51 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-a45da2eb-1322-4f23-81d1-8c4df85407dd tempest-CinderUnicodeTest-413700163 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:36:51 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-a45da2eb-1322-4f23-81d1-8c4df85407dd tempest-CinderUnicodeTest-413700163 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:36:51 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-a45da2eb-1322-4f23-81d1-8c4df85407dd tempest-CinderUnicodeTest-413700163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-7f52915a-e713-4359-ae3d-da06758d9ed9 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:36:51 devstack sudo[111066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-7f52915a-e713-4359-ae3d-da06758d9ed9 1073741824 Aug 26 14:36:51 devstack sudo[111066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:36:52 devstack sudo[111066]: pam_unix(sudo:session): session closed for user root Aug 26 14:36:52 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-a45da2eb-1322-4f23-81d1-8c4df85407dd tempest-CinderUnicodeTest-413700163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-7f52915a-e713-4359-ae3d-da06758d9ed9 1073741824" returned: 0 in 0.696s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:36:52 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-a45da2eb-1322-4f23-81d1-8c4df85407dd tempest-CinderUnicodeTest-413700163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-7f52915a-e713-4359-ae3d-da06758d9ed9 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:36:52 devstack sudo[111074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-7f52915a-e713-4359-ae3d-da06758d9ed9 Aug 26 14:36:52 devstack sudo[111074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:36:52 devstack sudo[111074]: pam_unix(sudo:session): session closed for user root Aug 26 14:36:52 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-a45da2eb-1322-4f23-81d1-8c4df85407dd tempest-CinderUnicodeTest-413700163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-7f52915a-e713-4359-ae3d-da06758d9ed9" returned: 0 in 0.355s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:36:52 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-a45da2eb-1322-4f23-81d1-8c4df85407dd tempest-CinderUnicodeTest-413700163 None] <== create_volume: return (1113ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:36:52 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-a45da2eb-1322-4f23-81d1-8c4df85407dd tempest-CinderUnicodeTest-413700163 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.116s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:36:52 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-a45da2eb-1322-4f23-81d1-8c4df85407dd tempest-CinderUnicodeTest-413700163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5791fa4-34e2-41be-b712-06684be166f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f52915a-e713-4359-ae3d-da06758d9ed9', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:36:52 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-a45da2eb-1322-4f23-81d1-8c4df85407dd tempest-CinderUnicodeTest-413700163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2aa525e-80c1-43c8-9a63-e4668293c878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:36:52 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-a45da2eb-1322-4f23-81d1-8c4df85407dd tempest-CinderUnicodeTest-413700163 None] Volume volume-7f52915a-e713-4359-ae3d-da06758d9ed9 (7f52915a-e713-4359-ae3d-da06758d9ed9): created successfully Aug 26 14:36:52 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-a45da2eb-1322-4f23-81d1-8c4df85407dd tempest-CinderUnicodeTest-413700163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2aa525e-80c1-43c8-9a63-e4668293c878) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:36:52 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-a45da2eb-1322-4f23-81d1-8c4df85407dd tempest-CinderUnicodeTest-413700163 None] Flow 'volume_create_manager' (dbebacab-4d9e-47ab-a6a0-447a2394bedf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:36:53 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-a45da2eb-1322-4f23-81d1-8c4df85407dd tempest-CinderUnicodeTest-413700163 None] Created volume successfully. Aug 26 14:36:54 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa1c0606-8a98-49bf-a1f4-632b2e724ae3 tempest-CinderUnicodeTest-413700163 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:36:54 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-fa1c0606-8a98-49bf-a1f4-632b2e724ae3 tempest-CinderUnicodeTest-413700163 None] Flow 'volume_create_manager' (5617e92b-d651-41d5-9f13-46509b41b376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:36:54 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-fa1c0606-8a98-49bf-a1f4-632b2e724ae3 tempest-CinderUnicodeTest-413700163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a62c6f10-0e0b-419e-8f62-6157ab532083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:36:54 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-fa1c0606-8a98-49bf-a1f4-632b2e724ae3 tempest-CinderUnicodeTest-413700163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a62c6f10-0e0b-419e-8f62-6157ab532083) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:36:54Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1590703652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=807db435-f0f1-4541-8538-8370ae7b89ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ce633c6717b4ae6a1982f6632cc731f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:36:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:36:55Z,use_quota=True,user_id='9a589a2bed104df683e7730ff17f1148',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:36:54 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-fa1c0606-8a98-49bf-a1f4-632b2e724ae3 tempest-CinderUnicodeTest-413700163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80d308d9-1b27-4b2a-a1f7-64a687af5620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:36:54 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-fa1c0606-8a98-49bf-a1f4-632b2e724ae3 tempest-CinderUnicodeTest-413700163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80d308d9-1b27-4b2a-a1f7-64a687af5620) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:36:54 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-fa1c0606-8a98-49bf-a1f4-632b2e724ae3 tempest-CinderUnicodeTest-413700163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d0888dd-e696-4b62-b7f6-2c2b3fd6b601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:36:54 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-fa1c0606-8a98-49bf-a1f4-632b2e724ae3 tempest-CinderUnicodeTest-413700163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d0888dd-e696-4b62-b7f6-2c2b3fd6b601) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '807db435-f0f1-4541-8538-8370ae7b89ac', 'volume_name': 'volume-807db435-f0f1-4541-8538-8370ae7b89ac', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:36:54 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-fa1c0606-8a98-49bf-a1f4-632b2e724ae3 tempest-CinderUnicodeTest-413700163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61c29902-dea9-4b98-bb78-8ad06b42c298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:36:54 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-fa1c0606-8a98-49bf-a1f4-632b2e724ae3 tempest-CinderUnicodeTest-413700163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61c29902-dea9-4b98-bb78-8ad06b42c298) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:36:54 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-fa1c0606-8a98-49bf-a1f4-632b2e724ae3 tempest-CinderUnicodeTest-413700163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bffdf0b3-9628-4011-be9b-99aee282d736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:36:54 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-fa1c0606-8a98-49bf-a1f4-632b2e724ae3 tempest-CinderUnicodeTest-413700163 None] Volume 807db435-f0f1-4541-8538-8370ae7b89ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-807db435-f0f1-4541-8538-8370ae7b89ac', 'volume_size': 1} Aug 26 14:36:54 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-fa1c0606-8a98-49bf-a1f4-632b2e724ae3 tempest-CinderUnicodeTest-413700163 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:36:54 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-fa1c0606-8a98-49bf-a1f4-632b2e724ae3 tempest-CinderUnicodeTest-413700163 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:36:54 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-fa1c0606-8a98-49bf-a1f4-632b2e724ae3 tempest-CinderUnicodeTest-413700163 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:36:54Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1590703652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=807db435-f0f1-4541-8538-8370ae7b89ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ce633c6717b4ae6a1982f6632cc731f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:36:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:36:55Z,use_quota=True,user_id='9a589a2bed104df683e7730ff17f1148',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:36:54 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-fa1c0606-8a98-49bf-a1f4-632b2e724ae3 tempest-CinderUnicodeTest-413700163 None] Creating volume 807db435-f0f1-4541-8538-8370ae7b89ac {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:36:54 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-fa1c0606-8a98-49bf-a1f4-632b2e724ae3 tempest-CinderUnicodeTest-413700163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:36:54 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-fa1c0606-8a98-49bf-a1f4-632b2e724ae3 tempest-CinderUnicodeTest-413700163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:36:54 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-fa1c0606-8a98-49bf-a1f4-632b2e724ae3 tempest-CinderUnicodeTest-413700163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:36:54 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-fa1c0606-8a98-49bf-a1f4-632b2e724ae3 tempest-CinderUnicodeTest-413700163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:36:54 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-fa1c0606-8a98-49bf-a1f4-632b2e724ae3 tempest-CinderUnicodeTest-413700163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:36:54 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-fa1c0606-8a98-49bf-a1f4-632b2e724ae3 tempest-CinderUnicodeTest-413700163 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:36:54 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-fa1c0606-8a98-49bf-a1f4-632b2e724ae3 tempest-CinderUnicodeTest-413700163 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:36:54 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-fa1c0606-8a98-49bf-a1f4-632b2e724ae3 tempest-CinderUnicodeTest-413700163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-807db435-f0f1-4541-8538-8370ae7b89ac 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:36:54 devstack sudo[111105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-807db435-f0f1-4541-8538-8370ae7b89ac 1073741824 Aug 26 14:36:54 devstack sudo[111105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:36:55 devstack sudo[111105]: pam_unix(sudo:session): session closed for user root Aug 26 14:36:55 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-fa1c0606-8a98-49bf-a1f4-632b2e724ae3 tempest-CinderUnicodeTest-413700163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-807db435-f0f1-4541-8538-8370ae7b89ac 1073741824" returned: 0 in 0.542s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:36:55 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-fa1c0606-8a98-49bf-a1f4-632b2e724ae3 tempest-CinderUnicodeTest-413700163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-807db435-f0f1-4541-8538-8370ae7b89ac {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:36:55 devstack sudo[111111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-807db435-f0f1-4541-8538-8370ae7b89ac Aug 26 14:36:55 devstack sudo[111111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:36:55 devstack sudo[111111]: pam_unix(sudo:session): session closed for user root Aug 26 14:36:55 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-fa1c0606-8a98-49bf-a1f4-632b2e724ae3 tempest-CinderUnicodeTest-413700163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-807db435-f0f1-4541-8538-8370ae7b89ac" returned: 0 in 0.297s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:36:55 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-fa1c0606-8a98-49bf-a1f4-632b2e724ae3 tempest-CinderUnicodeTest-413700163 None] <== create_volume: return (879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:36:55 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-fa1c0606-8a98-49bf-a1f4-632b2e724ae3 tempest-CinderUnicodeTest-413700163 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:36:55 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-fa1c0606-8a98-49bf-a1f4-632b2e724ae3 tempest-CinderUnicodeTest-413700163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bffdf0b3-9628-4011-be9b-99aee282d736) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-807db435-f0f1-4541-8538-8370ae7b89ac', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:36:55 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-fa1c0606-8a98-49bf-a1f4-632b2e724ae3 tempest-CinderUnicodeTest-413700163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7833db0c-fd7e-44e4-8950-5575eb46cbe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:36:55 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-fa1c0606-8a98-49bf-a1f4-632b2e724ae3 tempest-CinderUnicodeTest-413700163 None] Volume volume-807db435-f0f1-4541-8538-8370ae7b89ac (807db435-f0f1-4541-8538-8370ae7b89ac): created successfully Aug 26 14:36:55 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-fa1c0606-8a98-49bf-a1f4-632b2e724ae3 tempest-CinderUnicodeTest-413700163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7833db0c-fd7e-44e4-8950-5575eb46cbe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:36:55 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-fa1c0606-8a98-49bf-a1f4-632b2e724ae3 tempest-CinderUnicodeTest-413700163 None] Flow 'volume_create_manager' (5617e92b-d651-41d5-9f13-46509b41b376) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:36:55 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-fa1c0606-8a98-49bf-a1f4-632b2e724ae3 tempest-CinderUnicodeTest-413700163 None] Created volume successfully. Aug 26 14:36:57 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-7ed29178-9fbe-48a5-84e1-a4d9002c31c8 tempest-CinderUnicodeTest-413700163 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:36:57 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-7ed29178-9fbe-48a5-84e1-a4d9002c31c8 tempest-CinderUnicodeTest-413700163 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:36:57 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-7ed29178-9fbe-48a5-84e1-a4d9002c31c8 tempest-CinderUnicodeTest-413700163 None] Creating offline snapshot a9c911ff-4cc7-4d8c-b1cd-04a594ff680f of volume 807db435-f0f1-4541-8538-8370ae7b89ac {{(pid=94394) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 14:36:57 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[37db3a51-cbb2-4a5e-a852-72b21e2a59d1]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:36:57 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-7ed29178-9fbe-48a5-84e1-a4d9002c31c8 tempest-CinderUnicodeTest-413700163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-807db435-f0f1-4541-8538-8370ae7b89ac {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:36:57 devstack sudo[111116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-807db435-f0f1-4541-8538-8370ae7b89ac Aug 26 14:36:57 devstack sudo[111116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:36:57 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-97424b46-ed12-4f12-9e2a-596a2f42b200 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:36:57 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-97424b46-ed12-4f12-9e2a-596a2f42b200 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Flow 'volume_create_manager' (5d496fd4-34dd-4098-b486-9045f2cd2d1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:36:57 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-97424b46-ed12-4f12-9e2a-596a2f42b200 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8837d37-7706-4e1f-89cc-27c8b6051bb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:36:57 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-97424b46-ed12-4f12-9e2a-596a2f42b200 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8837d37-7706-4e1f-89cc-27c8b6051bb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:36:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2122946860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ea0380e-da02-4ee5-902c-ff3b55707d1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce866d2ad871488fb5414f44008f0876',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:36:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:36:57Z,use_quota=True,user_id='5798a42417424496a21d629d0b32ca6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:36:57 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-97424b46-ed12-4f12-9e2a-596a2f42b200 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d38318b-8535-4291-b7a8-34bfc0df6f1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:36:57 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-97424b46-ed12-4f12-9e2a-596a2f42b200 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d38318b-8535-4291-b7a8-34bfc0df6f1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:36:57 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-97424b46-ed12-4f12-9e2a-596a2f42b200 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b85eae3f-f2b8-46bd-97de-769997c6edc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:36:57 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-97424b46-ed12-4f12-9e2a-596a2f42b200 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b85eae3f-f2b8-46bd-97de-769997c6edc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ea0380e-da02-4ee5-902c-ff3b55707d1b', 'volume_name': 'volume-9ea0380e-da02-4ee5-902c-ff3b55707d1b', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:36:57 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-97424b46-ed12-4f12-9e2a-596a2f42b200 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e99f436d-3d1d-4877-be2c-4a316f648354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:36:57 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-97424b46-ed12-4f12-9e2a-596a2f42b200 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e99f436d-3d1d-4877-be2c-4a316f648354) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:36:57 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-97424b46-ed12-4f12-9e2a-596a2f42b200 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (649a08fa-514c-4c25-824c-408f712f1a3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:36:57 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-97424b46-ed12-4f12-9e2a-596a2f42b200 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Volume 9ea0380e-da02-4ee5-902c-ff3b55707d1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ea0380e-da02-4ee5-902c-ff3b55707d1b', 'volume_size': 1} Aug 26 14:36:57 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-97424b46-ed12-4f12-9e2a-596a2f42b200 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:36:57 devstack sudo[111116]: pam_unix(sudo:session): session closed for user root Aug 26 14:36:57 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-7ed29178-9fbe-48a5-84e1-a4d9002c31c8 tempest-CinderUnicodeTest-413700163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-807db435-f0f1-4541-8538-8370ae7b89ac" returned: 0 in 0.393s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:36:57 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-7ed29178-9fbe-48a5-84e1-a4d9002c31c8 tempest-CinderUnicodeTest-413700163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-807db435-f0f1-4541-8538-8370ae7b89ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-807db435-f0f1-4541-8538-8370ae7b89ac.a9c911ff-4cc7-4d8c-b1cd-04a594ff680f 1G {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:36:57 devstack sudo[111121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-807db435-f0f1-4541-8538-8370ae7b89ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-807db435-f0f1-4541-8538-8370ae7b89ac.a9c911ff-4cc7-4d8c-b1cd-04a594ff680f 1G Aug 26 14:36:57 devstack sudo[111121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:36:58 devstack sudo[111121]: pam_unix(sudo:session): session closed for user root Aug 26 14:36:58 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-7ed29178-9fbe-48a5-84e1-a4d9002c31c8 tempest-CinderUnicodeTest-413700163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-807db435-f0f1-4541-8538-8370ae7b89ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-807db435-f0f1-4541-8538-8370ae7b89ac.a9c911ff-4cc7-4d8c-b1cd-04a594ff680f 1G" returned: 0 in 0.380s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:36:58 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-7ed29178-9fbe-48a5-84e1-a4d9002c31c8 tempest-CinderUnicodeTest-413700163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-807db435-f0f1-4541-8538-8370ae7b89ac -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-807db435-f0f1-4541-8538-8370ae7b89ac.a9c911ff-4cc7-4d8c-b1cd-04a594ff680f {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:36:58 devstack sudo[111127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-807db435-f0f1-4541-8538-8370ae7b89ac -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-807db435-f0f1-4541-8538-8370ae7b89ac.a9c911ff-4cc7-4d8c-b1cd-04a594ff680f Aug 26 14:36:58 devstack sudo[111127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:36:58 devstack sudo[111127]: pam_unix(sudo:session): session closed for user root Aug 26 14:36:58 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-7ed29178-9fbe-48a5-84e1-a4d9002c31c8 tempest-CinderUnicodeTest-413700163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-807db435-f0f1-4541-8538-8370ae7b89ac -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-807db435-f0f1-4541-8538-8370ae7b89ac.a9c911ff-4cc7-4d8c-b1cd-04a594ff680f" returned: 0 in 0.286s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:36:58 devstack cinder-volume[94394]: WARNING cinder.volume.drivers.remotefs [None req-7ed29178-9fbe-48a5-84e1-a4d9002c31c8 tempest-CinderUnicodeTest-413700163 None] /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-807db435-f0f1-4541-8538-8370ae7b89ac.a9c911ff-4cc7-4d8c-b1cd-04a594ff680f is being set with open permissions: ugo+rw Aug 26 14:36:58 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-7ed29178-9fbe-48a5-84e1-a4d9002c31c8 tempest-CinderUnicodeTest-413700163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-807db435-f0f1-4541-8538-8370ae7b89ac.a9c911ff-4cc7-4d8c-b1cd-04a594ff680f {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:36:58 devstack sudo[111132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-807db435-f0f1-4541-8538-8370ae7b89ac.a9c911ff-4cc7-4d8c-b1cd-04a594ff680f Aug 26 14:36:58 devstack sudo[111132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:36:58 devstack sudo[111132]: pam_unix(sudo:session): session closed for user root Aug 26 14:36:58 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-7ed29178-9fbe-48a5-84e1-a4d9002c31c8 tempest-CinderUnicodeTest-413700163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-807db435-f0f1-4541-8538-8370ae7b89ac.a9c911ff-4cc7-4d8c-b1cd-04a594ff680f" returned: 0 in 0.231s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:36:58 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-7ed29178-9fbe-48a5-84e1-a4d9002c31c8 tempest-CinderUnicodeTest-413700163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-807db435-f0f1-4541-8538-8370ae7b89ac.info {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:36:58 devstack sudo[111135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-807db435-f0f1-4541-8538-8370ae7b89ac.info Aug 26 14:36:58 devstack sudo[111135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:36:58 devstack sudo[111135]: pam_unix(sudo:session): session closed for user root Aug 26 14:36:58 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-7ed29178-9fbe-48a5-84e1-a4d9002c31c8 tempest-CinderUnicodeTest-413700163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-807db435-f0f1-4541-8538-8370ae7b89ac.info" returned: 0 in 0.246s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:36:58 devstack cinder-volume[94394]: WARNING cinder.volume.drivers.remotefs [None req-7ed29178-9fbe-48a5-84e1-a4d9002c31c8 tempest-CinderUnicodeTest-413700163 None] /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-807db435-f0f1-4541-8538-8370ae7b89ac.info is being set with open permissions: ugo+rw Aug 26 14:36:58 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-7ed29178-9fbe-48a5-84e1-a4d9002c31c8 tempest-CinderUnicodeTest-413700163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-807db435-f0f1-4541-8538-8370ae7b89ac.info {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:36:58 devstack sudo[111138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-807db435-f0f1-4541-8538-8370ae7b89ac.info Aug 26 14:36:58 devstack sudo[111138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:36:59 devstack sudo[111138]: pam_unix(sudo:session): session closed for user root Aug 26 14:36:59 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-7ed29178-9fbe-48a5-84e1-a4d9002c31c8 tempest-CinderUnicodeTest-413700163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-807db435-f0f1-4541-8538-8370ae7b89ac.info" returned: 0 in 0.248s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:36:59 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-7ed29178-9fbe-48a5-84e1-a4d9002c31c8 tempest-CinderUnicodeTest-413700163 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.894s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:36:59 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-97424b46-ed12-4f12-9e2a-596a2f42b200 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.585s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:36:59 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-97424b46-ed12-4f12-9e2a-596a2f42b200 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:36:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2122946860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ea0380e-da02-4ee5-902c-ff3b55707d1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce866d2ad871488fb5414f44008f0876',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:36:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:36:57Z,use_quota=True,user_id='5798a42417424496a21d629d0b32ca6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:36:59 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-97424b46-ed12-4f12-9e2a-596a2f42b200 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Creating volume 9ea0380e-da02-4ee5-902c-ff3b55707d1b {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:36:59 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-97424b46-ed12-4f12-9e2a-596a2f42b200 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:36:59 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-97424b46-ed12-4f12-9e2a-596a2f42b200 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:36:59 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-97424b46-ed12-4f12-9e2a-596a2f42b200 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:36:59 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-97424b46-ed12-4f12-9e2a-596a2f42b200 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:36:59 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-97424b46-ed12-4f12-9e2a-596a2f42b200 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:36:59 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-97424b46-ed12-4f12-9e2a-596a2f42b200 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:36:59 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-97424b46-ed12-4f12-9e2a-596a2f42b200 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:36:59 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-97424b46-ed12-4f12-9e2a-596a2f42b200 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9ea0380e-da02-4ee5-902c-ff3b55707d1b 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:36:59 devstack sudo[111141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9ea0380e-da02-4ee5-902c-ff3b55707d1b 1073741824 Aug 26 14:36:59 devstack sudo[111141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:36:59 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-7ed29178-9fbe-48a5-84e1-a4d9002c31c8 tempest-CinderUnicodeTest-413700163 None] Create snapshot completed successfully Aug 26 14:36:59 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-b4be9f3c-52a1-46c1-bd3c-db29bf4beb6d tempest-CinderUnicodeTest-413700163 None] Acquiring lock "cinder-a9c911ff-4cc7-4d8c-b1cd-04a594ff680f-delete_snapshot" by "delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:36:59 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-b4be9f3c-52a1-46c1-bd3c-db29bf4beb6d tempest-CinderUnicodeTest-413700163 None] Lock "cinder-a9c911ff-4cc7-4d8c-b1cd-04a594ff680f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:36:59 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-b4be9f3c-52a1-46c1-bd3c-db29bf4beb6d tempest-CinderUnicodeTest-413700163 None] Acquiring lock "cinder-quobyte-807db435-f0f1-4541-8538-8370ae7b89ac" by "delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:36:59 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-b4be9f3c-52a1-46c1-bd3c-db29bf4beb6d tempest-CinderUnicodeTest-413700163 None] Lock "cinder-quobyte-807db435-f0f1-4541-8538-8370ae7b89ac" acquired by "delete_snapshot" :: waited 0.014s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:36:59 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-b4be9f3c-52a1-46c1-bd3c-db29bf4beb6d tempest-CinderUnicodeTest-413700163 None] Acquiring lock "cinder-quobyte-a9c911ff-4cc7-4d8c-b1cd-04a594ff680f" by "_delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:36:59 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-b4be9f3c-52a1-46c1-bd3c-db29bf4beb6d tempest-CinderUnicodeTest-413700163 None] Lock "cinder-quobyte-a9c911ff-4cc7-4d8c-b1cd-04a594ff680f" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:36:59 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-b4be9f3c-52a1-46c1-bd3c-db29bf4beb6d tempest-CinderUnicodeTest-413700163 None] Deleting offline snapshot a9c911ff-4cc7-4d8c-b1cd-04a594ff680f of volume 807db435-f0f1-4541-8538-8370ae7b89ac {{(pid=94394) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 14:36:59 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-b4be9f3c-52a1-46c1-bd3c-db29bf4beb6d tempest-CinderUnicodeTest-413700163 None] snapshot_file for this snap is: volume-807db435-f0f1-4541-8538-8370ae7b89ac.a9c911ff-4cc7-4d8c-b1cd-04a594ff680f {{(pid=94394) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 14:36:59 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[684ab088-017f-4f86-9c8c-46b149be4b36]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:36:59 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-b4be9f3c-52a1-46c1-bd3c-db29bf4beb6d tempest-CinderUnicodeTest-413700163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-807db435-f0f1-4541-8538-8370ae7b89ac.a9c911ff-4cc7-4d8c-b1cd-04a594ff680f {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:36:59 devstack sudo[111146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-807db435-f0f1-4541-8538-8370ae7b89ac.a9c911ff-4cc7-4d8c-b1cd-04a594ff680f Aug 26 14:36:59 devstack sudo[111146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:36:59 devstack sudo[111141]: pam_unix(sudo:session): session closed for user root Aug 26 14:36:59 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-97424b46-ed12-4f12-9e2a-596a2f42b200 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9ea0380e-da02-4ee5-902c-ff3b55707d1b 1073741824" returned: 0 in 0.449s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:36:59 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-97424b46-ed12-4f12-9e2a-596a2f42b200 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9ea0380e-da02-4ee5-902c-ff3b55707d1b {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:36:59 devstack sudo[111148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9ea0380e-da02-4ee5-902c-ff3b55707d1b Aug 26 14:36:59 devstack sudo[111148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:36:59 devstack sudo[111146]: pam_unix(sudo:session): session closed for user root Aug 26 14:36:59 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-b4be9f3c-52a1-46c1-bd3c-db29bf4beb6d tempest-CinderUnicodeTest-413700163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-807db435-f0f1-4541-8538-8370ae7b89ac.a9c911ff-4cc7-4d8c-b1cd-04a594ff680f" returned: 0 in 0.363s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:36:59 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-b4be9f3c-52a1-46c1-bd3c-db29bf4beb6d tempest-CinderUnicodeTest-413700163 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-807db435-f0f1-4541-8538-8370ae7b89ac(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94394) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 14:36:59 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eda7913-add8-4a40-82b5-277df3ae4795]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:36:59 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-b4be9f3c-52a1-46c1-bd3c-db29bf4beb6d tempest-CinderUnicodeTest-413700163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-807db435-f0f1-4541-8538-8370ae7b89ac {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:36:59 devstack sudo[111148]: pam_unix(sudo:session): session closed for user root Aug 26 14:36:59 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-97424b46-ed12-4f12-9e2a-596a2f42b200 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9ea0380e-da02-4ee5-902c-ff3b55707d1b" returned: 0 in 0.250s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:36:59 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-97424b46-ed12-4f12-9e2a-596a2f42b200 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] <== create_volume: return (747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:36:59 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-97424b46-ed12-4f12-9e2a-596a2f42b200 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.749s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:36:59 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-97424b46-ed12-4f12-9e2a-596a2f42b200 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (649a08fa-514c-4c25-824c-408f712f1a3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ea0380e-da02-4ee5-902c-ff3b55707d1b', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:36:59 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-97424b46-ed12-4f12-9e2a-596a2f42b200 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e704c0b4-79df-4841-a185-d23300d7e9d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:36:59 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-97424b46-ed12-4f12-9e2a-596a2f42b200 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Volume volume-9ea0380e-da02-4ee5-902c-ff3b55707d1b (9ea0380e-da02-4ee5-902c-ff3b55707d1b): created successfully Aug 26 14:36:59 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-97424b46-ed12-4f12-9e2a-596a2f42b200 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e704c0b4-79df-4841-a185-d23300d7e9d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:36:59 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-97424b46-ed12-4f12-9e2a-596a2f42b200 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Flow 'volume_create_manager' (5d496fd4-34dd-4098-b486-9045f2cd2d1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:36:59 devstack sudo[111153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-807db435-f0f1-4541-8538-8370ae7b89ac Aug 26 14:36:59 devstack sudo[111153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:36:59 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-97424b46-ed12-4f12-9e2a-596a2f42b200 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Created volume successfully. Aug 26 14:37:00 devstack sudo[111153]: pam_unix(sudo:session): session closed for user root Aug 26 14:37:00 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-b4be9f3c-52a1-46c1-bd3c-db29bf4beb6d tempest-CinderUnicodeTest-413700163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-807db435-f0f1-4541-8538-8370ae7b89ac" returned: 0 in 0.355s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:37:00 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-b4be9f3c-52a1-46c1-bd3c-db29bf4beb6d tempest-CinderUnicodeTest-413700163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-807db435-f0f1-4541-8538-8370ae7b89ac.a9c911ff-4cc7-4d8c-b1cd-04a594ff680f {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:37:00 devstack sudo[111159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-807db435-f0f1-4541-8538-8370ae7b89ac.a9c911ff-4cc7-4d8c-b1cd-04a594ff680f Aug 26 14:37:00 devstack sudo[111159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:37:00 devstack sudo[111159]: pam_unix(sudo:session): session closed for user root Aug 26 14:37:00 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-b4be9f3c-52a1-46c1-bd3c-db29bf4beb6d tempest-CinderUnicodeTest-413700163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-807db435-f0f1-4541-8538-8370ae7b89ac.a9c911ff-4cc7-4d8c-b1cd-04a594ff680f" returned: 0 in 0.331s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:37:00 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-b4be9f3c-52a1-46c1-bd3c-db29bf4beb6d tempest-CinderUnicodeTest-413700163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-807db435-f0f1-4541-8538-8370ae7b89ac.a9c911ff-4cc7-4d8c-b1cd-04a594ff680f {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:37:00 devstack sudo[111165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-807db435-f0f1-4541-8538-8370ae7b89ac.a9c911ff-4cc7-4d8c-b1cd-04a594ff680f Aug 26 14:37:00 devstack sudo[111165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:37:00 devstack sudo[111165]: pam_unix(sudo:session): session closed for user root Aug 26 14:37:00 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-b4be9f3c-52a1-46c1-bd3c-db29bf4beb6d tempest-CinderUnicodeTest-413700163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-807db435-f0f1-4541-8538-8370ae7b89ac.a9c911ff-4cc7-4d8c-b1cd-04a594ff680f" returned: 0 in 0.246s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:37:00 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-b4be9f3c-52a1-46c1-bd3c-db29bf4beb6d tempest-CinderUnicodeTest-413700163 None] Lock "cinder-quobyte-a9c911ff-4cc7-4d8c-b1cd-04a594ff680f" released by "_delete_snapshot" :: held 1.399s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:37:00 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-b4be9f3c-52a1-46c1-bd3c-db29bf4beb6d tempest-CinderUnicodeTest-413700163 None] Lock "cinder-quobyte-807db435-f0f1-4541-8538-8370ae7b89ac" released by "delete_snapshot" :: held 1.424s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:37:00 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-b4be9f3c-52a1-46c1-bd3c-db29bf4beb6d tempest-CinderUnicodeTest-413700163 None] Created reservations ['1f350f54-34e5-4ff9-b3ea-6067f8450cea', '5b6c86f0-b5a6-40cb-8f69-fa37d60ba89f', '73546ba5-5913-4897-a12a-15c6dbf67923', 'a35d660a-f986-4d48-8319-2dd8935fe5f7'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:37:00 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-b4be9f3c-52a1-46c1-bd3c-db29bf4beb6d tempest-CinderUnicodeTest-413700163 None] Delete snapshot completed successfully. Aug 26 14:37:00 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-b4be9f3c-52a1-46c1-bd3c-db29bf4beb6d tempest-CinderUnicodeTest-413700163 None] Lock "cinder-a9c911ff-4cc7-4d8c-b1cd-04a594ff680f-delete_snapshot" released by "delete_snapshot" :: held 1.579s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:37:00 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-497839e2-fb81-4a61-a883-333a147bf203 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:37:00 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-497839e2-fb81-4a61-a883-333a147bf203 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Flow 'volume_create_manager' (6052bb5c-9021-4a6f-a18b-749ed5bc49ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:37:00 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-497839e2-fb81-4a61-a883-333a147bf203 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56ab6205-2bd4-41ce-91a3-85a3e7401c32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:37:01 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-497839e2-fb81-4a61-a883-333a147bf203 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56ab6205-2bd4-41ce-91a3-85a3e7401c32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:37:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1563216243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48416d4b-562f-45ad-8243-b0d5d50fb70d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce866d2ad871488fb5414f44008f0876',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:37:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:37:01Z,use_quota=True,user_id='5798a42417424496a21d629d0b32ca6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:37:01 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-497839e2-fb81-4a61-a883-333a147bf203 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (123eaeac-4f75-44cb-b5fe-8f06f632ec3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:37:01 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-497839e2-fb81-4a61-a883-333a147bf203 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (123eaeac-4f75-44cb-b5fe-8f06f632ec3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:37:01 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-497839e2-fb81-4a61-a883-333a147bf203 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13d4ad38-bb5b-4520-8d0d-f3182d4faeb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:37:01 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-497839e2-fb81-4a61-a883-333a147bf203 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13d4ad38-bb5b-4520-8d0d-f3182d4faeb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48416d4b-562f-45ad-8243-b0d5d50fb70d', 'volume_name': 'volume-48416d4b-562f-45ad-8243-b0d5d50fb70d', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:37:01 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-497839e2-fb81-4a61-a883-333a147bf203 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88cc55a6-5366-463e-b933-caff061e31e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:37:01 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-497839e2-fb81-4a61-a883-333a147bf203 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88cc55a6-5366-463e-b933-caff061e31e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:37:01 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-497839e2-fb81-4a61-a883-333a147bf203 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (046e27eb-9a13-458c-b765-048c4c31ebde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:37:01 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-497839e2-fb81-4a61-a883-333a147bf203 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Volume 48416d4b-562f-45ad-8243-b0d5d50fb70d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48416d4b-562f-45ad-8243-b0d5d50fb70d', 'volume_size': 1} Aug 26 14:37:01 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-497839e2-fb81-4a61-a883-333a147bf203 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:37:01 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-497839e2-fb81-4a61-a883-333a147bf203 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:37:01 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-497839e2-fb81-4a61-a883-333a147bf203 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:37:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1563216243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48416d4b-562f-45ad-8243-b0d5d50fb70d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce866d2ad871488fb5414f44008f0876',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:37:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:37:01Z,use_quota=True,user_id='5798a42417424496a21d629d0b32ca6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:37:01 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-497839e2-fb81-4a61-a883-333a147bf203 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Creating volume 48416d4b-562f-45ad-8243-b0d5d50fb70d {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:37:01 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-497839e2-fb81-4a61-a883-333a147bf203 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:37:01 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-497839e2-fb81-4a61-a883-333a147bf203 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:37:01 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-497839e2-fb81-4a61-a883-333a147bf203 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:37:01 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-497839e2-fb81-4a61-a883-333a147bf203 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:37:01 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-497839e2-fb81-4a61-a883-333a147bf203 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:37:01 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-497839e2-fb81-4a61-a883-333a147bf203 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:37:01 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-497839e2-fb81-4a61-a883-333a147bf203 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:37:01 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-497839e2-fb81-4a61-a883-333a147bf203 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-48416d4b-562f-45ad-8243-b0d5d50fb70d 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:37:01 devstack sudo[111168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-48416d4b-562f-45ad-8243-b0d5d50fb70d 1073741824 Aug 26 14:37:01 devstack sudo[111168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:37:01 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-94e33fd3-436f-464c-a50f-42f013dcf596 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:37:01 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-94e33fd3-436f-464c-a50f-42f013dcf596 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Flow 'volume_create_manager' (24c18e9e-f983-4e1f-a894-88942f828a81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:37:01 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-94e33fd3-436f-464c-a50f-42f013dcf596 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d38fe9f9-5b3d-4a63-89e7-09ecc87b42e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:37:01 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-89b183b7-bbb8-44bb-bf19-071055095709 tempest-CinderUnicodeTest-413700163 None] Acquiring lock "cinder-807db435-f0f1-4541-8538-8370ae7b89ac-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:37:01 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-94e33fd3-436f-464c-a50f-42f013dcf596 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d38fe9f9-5b3d-4a63-89e7-09ecc87b42e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:37:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-85566255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef0094f8-9500-4023-837c-0061b9bde6d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce866d2ad871488fb5414f44008f0876',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:37:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:37:01Z,use_quota=True,user_id='5798a42417424496a21d629d0b32ca6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:37:01 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-94e33fd3-436f-464c-a50f-42f013dcf596 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f919004-c08b-4735-a0b9-55faa474f7bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:37:01 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-94e33fd3-436f-464c-a50f-42f013dcf596 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f919004-c08b-4735-a0b9-55faa474f7bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:37:01 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-94e33fd3-436f-464c-a50f-42f013dcf596 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (066c677d-fc27-45b0-b372-35b77a08d24f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:37:01 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-94e33fd3-436f-464c-a50f-42f013dcf596 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (066c677d-fc27-45b0-b372-35b77a08d24f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef0094f8-9500-4023-837c-0061b9bde6d3', 'volume_name': 'volume-ef0094f8-9500-4023-837c-0061b9bde6d3', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:37:01 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-94e33fd3-436f-464c-a50f-42f013dcf596 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9334df3-4b32-4ea3-9fb2-177ec1ff0d2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:37:01 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-94e33fd3-436f-464c-a50f-42f013dcf596 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9334df3-4b32-4ea3-9fb2-177ec1ff0d2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:37:01 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-94e33fd3-436f-464c-a50f-42f013dcf596 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (432baeab-a769-48c2-93fe-0e2b8ad77a2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:37:01 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-94e33fd3-436f-464c-a50f-42f013dcf596 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Volume ef0094f8-9500-4023-837c-0061b9bde6d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef0094f8-9500-4023-837c-0061b9bde6d3', 'volume_size': 1} Aug 26 14:37:01 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-94e33fd3-436f-464c-a50f-42f013dcf596 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:37:01 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-89b183b7-bbb8-44bb-bf19-071055095709 tempest-CinderUnicodeTest-413700163 None] Lock "cinder-807db435-f0f1-4541-8538-8370ae7b89ac-delete_volume" acquired by "delete_volume" :: waited 0.127s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:37:01 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-89b183b7-bbb8-44bb-bf19-071055095709 tempest-CinderUnicodeTest-413700163 None] Acquiring lock "cinder-quobyte-807db435-f0f1-4541-8538-8370ae7b89ac" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:37:01 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-89b183b7-bbb8-44bb-bf19-071055095709 tempest-CinderUnicodeTest-413700163 None] Lock "cinder-quobyte-807db435-f0f1-4541-8538-8370ae7b89ac" acquired by "delete_volume" :: waited 0.034s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:37:01 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[18d337a7-ee4b-4ab5-bf3a-e834c122d448]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:37:01 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-89b183b7-bbb8-44bb-bf19-071055095709 tempest-CinderUnicodeTest-413700163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-807db435-f0f1-4541-8538-8370ae7b89ac {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:37:01 devstack sudo[111168]: pam_unix(sudo:session): session closed for user root Aug 26 14:37:01 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-497839e2-fb81-4a61-a883-333a147bf203 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-48416d4b-562f-45ad-8243-b0d5d50fb70d 1073741824" returned: 0 in 0.740s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:37:01 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-497839e2-fb81-4a61-a883-333a147bf203 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-48416d4b-562f-45ad-8243-b0d5d50fb70d {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:37:01 devstack sudo[111175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-48416d4b-562f-45ad-8243-b0d5d50fb70d Aug 26 14:37:01 devstack sudo[111175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:37:01 devstack sudo[111174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-807db435-f0f1-4541-8538-8370ae7b89ac Aug 26 14:37:01 devstack sudo[111174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:37:02 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-75c571ac-a592-4ef0-8f28-aedafd6301d7 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:37:02 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-75c571ac-a592-4ef0-8f28-aedafd6301d7 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Flow 'volume_create_manager' (b3eaa644-3c49-404a-a104-4b7d55328263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:37:02 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-75c571ac-a592-4ef0-8f28-aedafd6301d7 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33af7ab8-dbcf-4a08-85bd-d16e13477139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:37:02 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-75c571ac-a592-4ef0-8f28-aedafd6301d7 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33af7ab8-dbcf-4a08-85bd-d16e13477139) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:37:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1033615723',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=058048f7-1d65-4821-a098-2a4ad2240848,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce866d2ad871488fb5414f44008f0876',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:37:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:37:02Z,use_quota=True,user_id='5798a42417424496a21d629d0b32ca6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:37:02 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-75c571ac-a592-4ef0-8f28-aedafd6301d7 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a81cc53-4203-447e-8ccc-e48306702a0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:37:02 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-75c571ac-a592-4ef0-8f28-aedafd6301d7 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a81cc53-4203-447e-8ccc-e48306702a0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:37:02 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-75c571ac-a592-4ef0-8f28-aedafd6301d7 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cad985c0-8b09-4c8f-8557-3937d19c74b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:37:02 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-75c571ac-a592-4ef0-8f28-aedafd6301d7 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cad985c0-8b09-4c8f-8557-3937d19c74b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '058048f7-1d65-4821-a098-2a4ad2240848', 'volume_name': 'volume-058048f7-1d65-4821-a098-2a4ad2240848', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:37:02 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-75c571ac-a592-4ef0-8f28-aedafd6301d7 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f65123d8-58d6-4090-af58-cf3d3af01de4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:37:02 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-75c571ac-a592-4ef0-8f28-aedafd6301d7 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f65123d8-58d6-4090-af58-cf3d3af01de4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:37:02 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-75c571ac-a592-4ef0-8f28-aedafd6301d7 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4db6183c-7731-4a7f-8b2c-2137d1595d3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:37:02 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-75c571ac-a592-4ef0-8f28-aedafd6301d7 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Volume 058048f7-1d65-4821-a098-2a4ad2240848: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-058048f7-1d65-4821-a098-2a4ad2240848', 'volume_size': 1} Aug 26 14:37:02 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-75c571ac-a592-4ef0-8f28-aedafd6301d7 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:37:02 devstack sudo[111175]: pam_unix(sudo:session): session closed for user root Aug 26 14:37:02 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-497839e2-fb81-4a61-a883-333a147bf203 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-48416d4b-562f-45ad-8243-b0d5d50fb70d" returned: 0 in 0.349s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:37:02 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-497839e2-fb81-4a61-a883-333a147bf203 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] <== create_volume: return (1171ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:37:02 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-497839e2-fb81-4a61-a883-333a147bf203 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.174s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:37:02 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-94e33fd3-436f-464c-a50f-42f013dcf596 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.616s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:37:02 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-94e33fd3-436f-464c-a50f-42f013dcf596 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:37:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-85566255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef0094f8-9500-4023-837c-0061b9bde6d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce866d2ad871488fb5414f44008f0876',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:37:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:37:01Z,use_quota=True,user_id='5798a42417424496a21d629d0b32ca6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:37:02 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-94e33fd3-436f-464c-a50f-42f013dcf596 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Creating volume ef0094f8-9500-4023-837c-0061b9bde6d3 {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:37:02 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-94e33fd3-436f-464c-a50f-42f013dcf596 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:37:02 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-94e33fd3-436f-464c-a50f-42f013dcf596 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:37:02 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-94e33fd3-436f-464c-a50f-42f013dcf596 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:37:02 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-94e33fd3-436f-464c-a50f-42f013dcf596 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:37:02 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-94e33fd3-436f-464c-a50f-42f013dcf596 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:37:02 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-94e33fd3-436f-464c-a50f-42f013dcf596 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:37:02 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-94e33fd3-436f-464c-a50f-42f013dcf596 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:37:02 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-94e33fd3-436f-464c-a50f-42f013dcf596 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ef0094f8-9500-4023-837c-0061b9bde6d3 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:37:02 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-497839e2-fb81-4a61-a883-333a147bf203 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (046e27eb-9a13-458c-b765-048c4c31ebde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48416d4b-562f-45ad-8243-b0d5d50fb70d', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:37:02 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-497839e2-fb81-4a61-a883-333a147bf203 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (303dab0c-f7d8-4157-948e-ed4afc7d91d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:37:02 devstack sudo[111179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ef0094f8-9500-4023-837c-0061b9bde6d3 1073741824 Aug 26 14:37:02 devstack sudo[111179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:37:02 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-497839e2-fb81-4a61-a883-333a147bf203 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Volume volume-48416d4b-562f-45ad-8243-b0d5d50fb70d (48416d4b-562f-45ad-8243-b0d5d50fb70d): created successfully Aug 26 14:37:02 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-497839e2-fb81-4a61-a883-333a147bf203 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (303dab0c-f7d8-4157-948e-ed4afc7d91d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:37:02 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-497839e2-fb81-4a61-a883-333a147bf203 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Flow 'volume_create_manager' (6052bb5c-9021-4a6f-a18b-749ed5bc49ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:37:02 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-497839e2-fb81-4a61-a883-333a147bf203 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Created volume successfully. Aug 26 14:37:02 devstack sudo[111174]: pam_unix(sudo:session): session closed for user root Aug 26 14:37:02 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-89b183b7-bbb8-44bb-bf19-071055095709 tempest-CinderUnicodeTest-413700163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-807db435-f0f1-4541-8538-8370ae7b89ac" returned: 0 in 0.686s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:37:02 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-89b183b7-bbb8-44bb-bf19-071055095709 tempest-CinderUnicodeTest-413700163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-807db435-f0f1-4541-8538-8370ae7b89ac {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:37:02 devstack sudo[111184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-807db435-f0f1-4541-8538-8370ae7b89ac Aug 26 14:37:02 devstack sudo[111184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:37:02 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-7be21bb3-77de-4ea8-9db6-465f635f1957 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:37:02 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-7be21bb3-77de-4ea8-9db6-465f635f1957 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Flow 'volume_create_manager' (5a80ef87-2581-4293-ba6e-7af8c2a5510b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:37:02 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-7be21bb3-77de-4ea8-9db6-465f635f1957 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd14fb08-d3c9-480b-b729-89ae77391315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:37:02 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-7be21bb3-77de-4ea8-9db6-465f635f1957 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd14fb08-d3c9-480b-b729-89ae77391315) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:37:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-342331896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a32ccb5a-c5aa-45d8-a47e-c611ac28ff15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce866d2ad871488fb5414f44008f0876',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:37:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:37:02Z,use_quota=True,user_id='5798a42417424496a21d629d0b32ca6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:37:02 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-7be21bb3-77de-4ea8-9db6-465f635f1957 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e477cea-c2fd-4bfb-8794-4ee8632e8fd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:37:02 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-7be21bb3-77de-4ea8-9db6-465f635f1957 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e477cea-c2fd-4bfb-8794-4ee8632e8fd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:37:02 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-7be21bb3-77de-4ea8-9db6-465f635f1957 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (263c91d8-7f55-48ba-be49-e494320ea4bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:37:02 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-7be21bb3-77de-4ea8-9db6-465f635f1957 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (263c91d8-7f55-48ba-be49-e494320ea4bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a32ccb5a-c5aa-45d8-a47e-c611ac28ff15', 'volume_name': 'volume-a32ccb5a-c5aa-45d8-a47e-c611ac28ff15', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:37:02 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-7be21bb3-77de-4ea8-9db6-465f635f1957 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ce71541-cf52-4b0b-a5ea-0d9cadb0560e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:37:02 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-7be21bb3-77de-4ea8-9db6-465f635f1957 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ce71541-cf52-4b0b-a5ea-0d9cadb0560e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:37:02 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-7be21bb3-77de-4ea8-9db6-465f635f1957 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f92ede63-9958-4d43-9820-34e84d6836a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:37:02 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-7be21bb3-77de-4ea8-9db6-465f635f1957 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Volume a32ccb5a-c5aa-45d8-a47e-c611ac28ff15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a32ccb5a-c5aa-45d8-a47e-c611ac28ff15', 'volume_size': 1} Aug 26 14:37:02 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-7be21bb3-77de-4ea8-9db6-465f635f1957 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:37:02 devstack sudo[111184]: pam_unix(sudo:session): session closed for user root Aug 26 14:37:02 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-89b183b7-bbb8-44bb-bf19-071055095709 tempest-CinderUnicodeTest-413700163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-807db435-f0f1-4541-8538-8370ae7b89ac" returned: 0 in 0.461s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:37:02 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-89b183b7-bbb8-44bb-bf19-071055095709 tempest-CinderUnicodeTest-413700163 None] Lock "cinder-quobyte-807db435-f0f1-4541-8538-8370ae7b89ac" released by "delete_volume" :: held 1.272s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:37:03 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-89b183b7-bbb8-44bb-bf19-071055095709 tempest-CinderUnicodeTest-413700163 None] Created reservations ['35547080-b6bd-486b-92ea-26ecd2e27af9', '8b02b407-35bb-4124-97c9-ca217d3304e9', 'f6717dea-4b3b-426f-b44b-662665623881', 'e4d9c209-9a95-4e86-9be3-5b063d71c43e'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:37:03 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bdbbb7c-c41d-4483-8b87-b786e86b04de tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:37:03 devstack sudo[111179]: pam_unix(sudo:session): session closed for user root Aug 26 14:37:03 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-5bdbbb7c-c41d-4483-8b87-b786e86b04de tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Flow 'volume_create_manager' (eddab7fa-3170-4885-84da-1848a612e737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:37:03 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-5bdbbb7c-c41d-4483-8b87-b786e86b04de tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (705bafcd-c263-4f47-9323-80c6cc97a287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:37:03 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-94e33fd3-436f-464c-a50f-42f013dcf596 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ef0094f8-9500-4023-837c-0061b9bde6d3 1073741824" returned: 0 in 0.851s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:37:03 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-5bdbbb7c-c41d-4483-8b87-b786e86b04de tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (705bafcd-c263-4f47-9323-80c6cc97a287) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:37:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2118916427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43856a65-fe49-4b33-957e-94b9c66ae290,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce866d2ad871488fb5414f44008f0876',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:37:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:37:03Z,use_quota=True,user_id='5798a42417424496a21d629d0b32ca6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:37:03 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-5bdbbb7c-c41d-4483-8b87-b786e86b04de tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (633916f7-7988-4069-82ba-69b86c1ec75d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:37:03 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-5bdbbb7c-c41d-4483-8b87-b786e86b04de tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (633916f7-7988-4069-82ba-69b86c1ec75d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:37:03 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-5bdbbb7c-c41d-4483-8b87-b786e86b04de tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f66a0711-5537-407a-a195-0981fe806ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:37:03 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-5bdbbb7c-c41d-4483-8b87-b786e86b04de tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f66a0711-5537-407a-a195-0981fe806ce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43856a65-fe49-4b33-957e-94b9c66ae290', 'volume_name': 'volume-43856a65-fe49-4b33-957e-94b9c66ae290', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:37:03 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-5bdbbb7c-c41d-4483-8b87-b786e86b04de tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf23d82f-624e-41de-aa89-d9764d27f658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:37:03 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-5bdbbb7c-c41d-4483-8b87-b786e86b04de tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf23d82f-624e-41de-aa89-d9764d27f658) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:37:03 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-5bdbbb7c-c41d-4483-8b87-b786e86b04de tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d4358be-6aaf-49e3-a62c-109acc9c5e62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:37:03 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-5bdbbb7c-c41d-4483-8b87-b786e86b04de tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Volume 43856a65-fe49-4b33-957e-94b9c66ae290: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43856a65-fe49-4b33-957e-94b9c66ae290', 'volume_size': 1} Aug 26 14:37:03 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-5bdbbb7c-c41d-4483-8b87-b786e86b04de tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:37:03 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-94e33fd3-436f-464c-a50f-42f013dcf596 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ef0094f8-9500-4023-837c-0061b9bde6d3 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:37:03 devstack sudo[111190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ef0094f8-9500-4023-837c-0061b9bde6d3 Aug 26 14:37:03 devstack sudo[111190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:37:03 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-89b183b7-bbb8-44bb-bf19-071055095709 tempest-CinderUnicodeTest-413700163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:37:03 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-89b183b7-bbb8-44bb-bf19-071055095709 tempest-CinderUnicodeTest-413700163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:37:03 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-89b183b7-bbb8-44bb-bf19-071055095709 tempest-CinderUnicodeTest-413700163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:37:03 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-89b183b7-bbb8-44bb-bf19-071055095709 tempest-CinderUnicodeTest-413700163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:37:03 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-89b183b7-bbb8-44bb-bf19-071055095709 tempest-CinderUnicodeTest-413700163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:37:03 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-89b183b7-bbb8-44bb-bf19-071055095709 tempest-CinderUnicodeTest-413700163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:37:03 devstack sudo[111192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:37:03 devstack sudo[111192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:37:03 devstack sudo[111190]: pam_unix(sudo:session): session closed for user root Aug 26 14:37:03 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-94e33fd3-436f-464c-a50f-42f013dcf596 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ef0094f8-9500-4023-837c-0061b9bde6d3" returned: 0 in 0.270s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:37:03 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-94e33fd3-436f-464c-a50f-42f013dcf596 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] <== create_volume: return (1216ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:37:03 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-94e33fd3-436f-464c-a50f-42f013dcf596 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.222s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:37:03 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-75c571ac-a592-4ef0-8f28-aedafd6301d7 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.334s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:37:03 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-75c571ac-a592-4ef0-8f28-aedafd6301d7 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:37:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1033615723',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=058048f7-1d65-4821-a098-2a4ad2240848,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce866d2ad871488fb5414f44008f0876',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:37:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:37:02Z,use_quota=True,user_id='5798a42417424496a21d629d0b32ca6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:37:03 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-75c571ac-a592-4ef0-8f28-aedafd6301d7 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Creating volume 058048f7-1d65-4821-a098-2a4ad2240848 {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:37:03 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-75c571ac-a592-4ef0-8f28-aedafd6301d7 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:37:03 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-75c571ac-a592-4ef0-8f28-aedafd6301d7 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:37:03 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-75c571ac-a592-4ef0-8f28-aedafd6301d7 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:37:03 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-75c571ac-a592-4ef0-8f28-aedafd6301d7 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:37:03 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-75c571ac-a592-4ef0-8f28-aedafd6301d7 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:37:03 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-75c571ac-a592-4ef0-8f28-aedafd6301d7 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:37:03 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-75c571ac-a592-4ef0-8f28-aedafd6301d7 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:37:03 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-75c571ac-a592-4ef0-8f28-aedafd6301d7 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-058048f7-1d65-4821-a098-2a4ad2240848 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:37:03 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-94e33fd3-436f-464c-a50f-42f013dcf596 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (432baeab-a769-48c2-93fe-0e2b8ad77a2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef0094f8-9500-4023-837c-0061b9bde6d3', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:37:03 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-94e33fd3-436f-464c-a50f-42f013dcf596 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b736e9c6-a480-45a5-9dd9-b9f6d3b6bb72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:37:03 devstack sudo[111196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-058048f7-1d65-4821-a098-2a4ad2240848 1073741824 Aug 26 14:37:03 devstack sudo[111196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:37:03 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-94e33fd3-436f-464c-a50f-42f013dcf596 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Volume volume-ef0094f8-9500-4023-837c-0061b9bde6d3 (ef0094f8-9500-4023-837c-0061b9bde6d3): created successfully Aug 26 14:37:03 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-94e33fd3-436f-464c-a50f-42f013dcf596 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b736e9c6-a480-45a5-9dd9-b9f6d3b6bb72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:37:03 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-94e33fd3-436f-464c-a50f-42f013dcf596 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Flow 'volume_create_manager' (24c18e9e-f983-4e1f-a894-88942f828a81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:37:03 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-94e33fd3-436f-464c-a50f-42f013dcf596 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Created volume successfully. Aug 26 14:37:03 devstack sudo[111192]: pam_unix(sudo:session): session closed for user root Aug 26 14:37:03 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-89b183b7-bbb8-44bb-bf19-071055095709 tempest-CinderUnicodeTest-413700163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.316s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:37:03 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-89b183b7-bbb8-44bb-bf19-071055095709 tempest-CinderUnicodeTest-413700163 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:37:03 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-89b183b7-bbb8-44bb-bf19-071055095709 tempest-CinderUnicodeTest-413700163 None] Deleted volume successfully. Aug 26 14:37:03 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-89b183b7-bbb8-44bb-bf19-071055095709 tempest-CinderUnicodeTest-413700163 None] Lock "cinder-807db435-f0f1-4541-8538-8370ae7b89ac-delete_volume" released by "delete_volume" :: held 1.956s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:37:03 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-3c20255b-2513-45c4-9260-833a6e3ba50b tempest-CinderUnicodeTest-413700163 None] Acquiring lock "cinder-7f52915a-e713-4359-ae3d-da06758d9ed9-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:37:03 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-3c20255b-2513-45c4-9260-833a6e3ba50b tempest-CinderUnicodeTest-413700163 None] Lock "cinder-7f52915a-e713-4359-ae3d-da06758d9ed9-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:37:03 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-3c20255b-2513-45c4-9260-833a6e3ba50b tempest-CinderUnicodeTest-413700163 None] Acquiring lock "cinder-quobyte-7f52915a-e713-4359-ae3d-da06758d9ed9" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:37:03 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-3c20255b-2513-45c4-9260-833a6e3ba50b tempest-CinderUnicodeTest-413700163 None] Lock "cinder-quobyte-7f52915a-e713-4359-ae3d-da06758d9ed9" acquired by "delete_volume" :: waited 0.018s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:37:03 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[43046564-07fe-4193-b9dc-239408755cb5]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:37:03 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-3c20255b-2513-45c4-9260-833a6e3ba50b tempest-CinderUnicodeTest-413700163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-7f52915a-e713-4359-ae3d-da06758d9ed9 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:37:04 devstack sudo[111196]: pam_unix(sudo:session): session closed for user root Aug 26 14:37:04 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-75c571ac-a592-4ef0-8f28-aedafd6301d7 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-058048f7-1d65-4821-a098-2a4ad2240848 1073741824" returned: 0 in 0.537s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:37:04 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-75c571ac-a592-4ef0-8f28-aedafd6301d7 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-058048f7-1d65-4821-a098-2a4ad2240848 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:37:04 devstack sudo[111205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-058048f7-1d65-4821-a098-2a4ad2240848 Aug 26 14:37:04 devstack sudo[111205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:37:04 devstack sudo[111204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-7f52915a-e713-4359-ae3d-da06758d9ed9 Aug 26 14:37:04 devstack sudo[111204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:37:04 devstack sudo[111205]: pam_unix(sudo:session): session closed for user root Aug 26 14:37:04 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-75c571ac-a592-4ef0-8f28-aedafd6301d7 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-058048f7-1d65-4821-a098-2a4ad2240848" returned: 0 in 0.281s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:37:04 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-75c571ac-a592-4ef0-8f28-aedafd6301d7 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] <== create_volume: return (869ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:37:04 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-75c571ac-a592-4ef0-8f28-aedafd6301d7 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.872s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:37:04 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-7be21bb3-77de-4ea8-9db6-465f635f1957 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.578s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:37:04 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-7be21bb3-77de-4ea8-9db6-465f635f1957 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:37:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-342331896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a32ccb5a-c5aa-45d8-a47e-c611ac28ff15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce866d2ad871488fb5414f44008f0876',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:37:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:37:02Z,use_quota=True,user_id='5798a42417424496a21d629d0b32ca6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:37:04 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-7be21bb3-77de-4ea8-9db6-465f635f1957 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Creating volume a32ccb5a-c5aa-45d8-a47e-c611ac28ff15 {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:37:04 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-7be21bb3-77de-4ea8-9db6-465f635f1957 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:37:04 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-7be21bb3-77de-4ea8-9db6-465f635f1957 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:37:04 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-7be21bb3-77de-4ea8-9db6-465f635f1957 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:37:04 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-7be21bb3-77de-4ea8-9db6-465f635f1957 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:37:04 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-7be21bb3-77de-4ea8-9db6-465f635f1957 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:37:04 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-7be21bb3-77de-4ea8-9db6-465f635f1957 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:37:04 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-7be21bb3-77de-4ea8-9db6-465f635f1957 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:37:04 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-7be21bb3-77de-4ea8-9db6-465f635f1957 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-a32ccb5a-c5aa-45d8-a47e-c611ac28ff15 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:37:04 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-75c571ac-a592-4ef0-8f28-aedafd6301d7 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4db6183c-7731-4a7f-8b2c-2137d1595d3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-058048f7-1d65-4821-a098-2a4ad2240848', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:37:04 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-75c571ac-a592-4ef0-8f28-aedafd6301d7 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1294e61e-2bf0-4327-9801-c52a26e1010f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:37:04 devstack sudo[111209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-a32ccb5a-c5aa-45d8-a47e-c611ac28ff15 1073741824 Aug 26 14:37:04 devstack sudo[111209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:37:04 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-75c571ac-a592-4ef0-8f28-aedafd6301d7 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Volume volume-058048f7-1d65-4821-a098-2a4ad2240848 (058048f7-1d65-4821-a098-2a4ad2240848): created successfully Aug 26 14:37:04 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-75c571ac-a592-4ef0-8f28-aedafd6301d7 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1294e61e-2bf0-4327-9801-c52a26e1010f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:37:04 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-75c571ac-a592-4ef0-8f28-aedafd6301d7 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Flow 'volume_create_manager' (b3eaa644-3c49-404a-a104-4b7d55328263) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:37:04 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-75c571ac-a592-4ef0-8f28-aedafd6301d7 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Created volume successfully. Aug 26 14:37:04 devstack sudo[111204]: pam_unix(sudo:session): session closed for user root Aug 26 14:37:04 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-3c20255b-2513-45c4-9260-833a6e3ba50b tempest-CinderUnicodeTest-413700163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-7f52915a-e713-4359-ae3d-da06758d9ed9" returned: 0 in 0.506s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:37:04 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-3c20255b-2513-45c4-9260-833a6e3ba50b tempest-CinderUnicodeTest-413700163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-7f52915a-e713-4359-ae3d-da06758d9ed9 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:37:04 devstack sudo[111214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-7f52915a-e713-4359-ae3d-da06758d9ed9 Aug 26 14:37:04 devstack sudo[111214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:37:04 devstack sudo[111214]: pam_unix(sudo:session): session closed for user root Aug 26 14:37:04 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-3c20255b-2513-45c4-9260-833a6e3ba50b tempest-CinderUnicodeTest-413700163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-7f52915a-e713-4359-ae3d-da06758d9ed9" returned: 0 in 0.277s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:37:04 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-3c20255b-2513-45c4-9260-833a6e3ba50b tempest-CinderUnicodeTest-413700163 None] Lock "cinder-quobyte-7f52915a-e713-4359-ae3d-da06758d9ed9" released by "delete_volume" :: held 0.828s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:37:04 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-3c20255b-2513-45c4-9260-833a6e3ba50b tempest-CinderUnicodeTest-413700163 None] Created reservations ['83a54997-149a-4637-aa8d-7f070c5c4041', 'f8bd4535-2a1a-4821-9b9c-c3632416d858', '76a257a4-714d-4ed7-ab0e-b121c8ce7959', 'a44f9ba2-ae2e-4064-912e-48b2b8316c5b'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:37:04 devstack sudo[111209]: pam_unix(sudo:session): session closed for user root Aug 26 14:37:04 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-7be21bb3-77de-4ea8-9db6-465f635f1957 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-a32ccb5a-c5aa-45d8-a47e-c611ac28ff15 1073741824" returned: 0 in 0.544s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:37:04 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-3c20255b-2513-45c4-9260-833a6e3ba50b tempest-CinderUnicodeTest-413700163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:37:04 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-3c20255b-2513-45c4-9260-833a6e3ba50b tempest-CinderUnicodeTest-413700163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:37:04 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-3c20255b-2513-45c4-9260-833a6e3ba50b tempest-CinderUnicodeTest-413700163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:37:04 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-3c20255b-2513-45c4-9260-833a6e3ba50b tempest-CinderUnicodeTest-413700163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:37:04 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-3c20255b-2513-45c4-9260-833a6e3ba50b tempest-CinderUnicodeTest-413700163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:37:04 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-3c20255b-2513-45c4-9260-833a6e3ba50b tempest-CinderUnicodeTest-413700163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:37:04 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-7be21bb3-77de-4ea8-9db6-465f635f1957 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-a32ccb5a-c5aa-45d8-a47e-c611ac28ff15 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:37:04 devstack sudo[111221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:37:04 devstack sudo[111221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:37:05 devstack sudo[111222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-a32ccb5a-c5aa-45d8-a47e-c611ac28ff15 Aug 26 14:37:05 devstack sudo[111222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:37:05 devstack sudo[111221]: pam_unix(sudo:session): session closed for user root Aug 26 14:37:05 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-3c20255b-2513-45c4-9260-833a6e3ba50b tempest-CinderUnicodeTest-413700163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.313s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:37:05 devstack sudo[111222]: pam_unix(sudo:session): session closed for user root Aug 26 14:37:05 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-3c20255b-2513-45c4-9260-833a6e3ba50b tempest-CinderUnicodeTest-413700163 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:37:05 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-7be21bb3-77de-4ea8-9db6-465f635f1957 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-a32ccb5a-c5aa-45d8-a47e-c611ac28ff15" returned: 0 in 0.301s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:37:05 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-7be21bb3-77de-4ea8-9db6-465f635f1957 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] <== create_volume: return (933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:37:05 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-7be21bb3-77de-4ea8-9db6-465f635f1957 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:37:05 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-5bdbbb7c-c41d-4483-8b87-b786e86b04de tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.129s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:37:05 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-5bdbbb7c-c41d-4483-8b87-b786e86b04de tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:37:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2118916427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43856a65-fe49-4b33-957e-94b9c66ae290,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce866d2ad871488fb5414f44008f0876',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:37:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:37:03Z,use_quota=True,user_id='5798a42417424496a21d629d0b32ca6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:37:05 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-5bdbbb7c-c41d-4483-8b87-b786e86b04de tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Creating volume 43856a65-fe49-4b33-957e-94b9c66ae290 {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:37:05 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-5bdbbb7c-c41d-4483-8b87-b786e86b04de tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:37:05 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-5bdbbb7c-c41d-4483-8b87-b786e86b04de tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:37:05 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-5bdbbb7c-c41d-4483-8b87-b786e86b04de tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:37:05 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-5bdbbb7c-c41d-4483-8b87-b786e86b04de tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:37:05 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-5bdbbb7c-c41d-4483-8b87-b786e86b04de tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:37:05 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-5bdbbb7c-c41d-4483-8b87-b786e86b04de tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:37:05 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-5bdbbb7c-c41d-4483-8b87-b786e86b04de tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:37:05 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-5bdbbb7c-c41d-4483-8b87-b786e86b04de tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-43856a65-fe49-4b33-957e-94b9c66ae290 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:37:05 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-3c20255b-2513-45c4-9260-833a6e3ba50b tempest-CinderUnicodeTest-413700163 None] Deleted volume successfully. Aug 26 14:37:05 devstack sudo[111227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-43856a65-fe49-4b33-957e-94b9c66ae290 1073741824 Aug 26 14:37:05 devstack sudo[111227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:37:05 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-7be21bb3-77de-4ea8-9db6-465f635f1957 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f92ede63-9958-4d43-9820-34e84d6836a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a32ccb5a-c5aa-45d8-a47e-c611ac28ff15', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:37:05 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-7be21bb3-77de-4ea8-9db6-465f635f1957 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93399e34-6851-447d-9a57-a60267d627ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:37:05 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-3c20255b-2513-45c4-9260-833a6e3ba50b tempest-CinderUnicodeTest-413700163 None] Lock "cinder-7f52915a-e713-4359-ae3d-da06758d9ed9-delete_volume" released by "delete_volume" :: held 1.461s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:37:05 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-7be21bb3-77de-4ea8-9db6-465f635f1957 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Volume volume-a32ccb5a-c5aa-45d8-a47e-c611ac28ff15 (a32ccb5a-c5aa-45d8-a47e-c611ac28ff15): created successfully Aug 26 14:37:05 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-7be21bb3-77de-4ea8-9db6-465f635f1957 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93399e34-6851-447d-9a57-a60267d627ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:37:05 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-7be21bb3-77de-4ea8-9db6-465f635f1957 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Flow 'volume_create_manager' (5a80ef87-2581-4293-ba6e-7af8c2a5510b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:37:05 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-7be21bb3-77de-4ea8-9db6-465f635f1957 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Created volume successfully. Aug 26 14:37:05 devstack sudo[111227]: pam_unix(sudo:session): session closed for user root Aug 26 14:37:05 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-5bdbbb7c-c41d-4483-8b87-b786e86b04de tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-43856a65-fe49-4b33-957e-94b9c66ae290 1073741824" returned: 0 in 0.507s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:37:05 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-5bdbbb7c-c41d-4483-8b87-b786e86b04de tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-43856a65-fe49-4b33-957e-94b9c66ae290 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:37:05 devstack sudo[111232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-43856a65-fe49-4b33-957e-94b9c66ae290 Aug 26 14:37:05 devstack sudo[111232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:37:06 devstack sudo[111232]: pam_unix(sudo:session): session closed for user root Aug 26 14:37:06 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-5bdbbb7c-c41d-4483-8b87-b786e86b04de tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-43856a65-fe49-4b33-957e-94b9c66ae290" returned: 0 in 0.264s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:37:06 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-5bdbbb7c-c41d-4483-8b87-b786e86b04de tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] <== create_volume: return (812ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:37:06 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-5bdbbb7c-c41d-4483-8b87-b786e86b04de tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.816s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:37:06 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-5bdbbb7c-c41d-4483-8b87-b786e86b04de tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d4358be-6aaf-49e3-a62c-109acc9c5e62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43856a65-fe49-4b33-957e-94b9c66ae290', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:37:06 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-5bdbbb7c-c41d-4483-8b87-b786e86b04de tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26693e45-443f-48db-9f34-f72e44c7bb97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:37:06 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-5bdbbb7c-c41d-4483-8b87-b786e86b04de tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Volume volume-43856a65-fe49-4b33-957e-94b9c66ae290 (43856a65-fe49-4b33-957e-94b9c66ae290): created successfully Aug 26 14:37:06 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-5bdbbb7c-c41d-4483-8b87-b786e86b04de tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26693e45-443f-48db-9f34-f72e44c7bb97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:37:06 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-5bdbbb7c-c41d-4483-8b87-b786e86b04de tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Flow 'volume_create_manager' (eddab7fa-3170-4885-84da-1848a612e737) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:37:06 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-5bdbbb7c-c41d-4483-8b87-b786e86b04de tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Created volume successfully. Aug 26 14:37:06 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-7e95f479-cc76-40b9-a988-cc5d783530de tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Acquiring lock "cinder-43856a65-fe49-4b33-957e-94b9c66ae290-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:37:06 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-7e95f479-cc76-40b9-a988-cc5d783530de tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Lock "cinder-43856a65-fe49-4b33-957e-94b9c66ae290-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:37:06 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-7e95f479-cc76-40b9-a988-cc5d783530de tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Acquiring lock "cinder-quobyte-43856a65-fe49-4b33-957e-94b9c66ae290" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:37:06 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-7e95f479-cc76-40b9-a988-cc5d783530de tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Lock "cinder-quobyte-43856a65-fe49-4b33-957e-94b9c66ae290" acquired by "delete_volume" :: waited 0.020s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:37:06 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[d56d9193-e8cd-43e0-860d-cbb60c66d6b0]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:37:06 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-7e95f479-cc76-40b9-a988-cc5d783530de tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-43856a65-fe49-4b33-957e-94b9c66ae290 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:37:06 devstack sudo[111235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-43856a65-fe49-4b33-957e-94b9c66ae290 Aug 26 14:37:06 devstack sudo[111235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:37:07 devstack sudo[111235]: pam_unix(sudo:session): session closed for user root Aug 26 14:37:07 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-7e95f479-cc76-40b9-a988-cc5d783530de tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-43856a65-fe49-4b33-957e-94b9c66ae290" returned: 0 in 0.381s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:37:07 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-7e95f479-cc76-40b9-a988-cc5d783530de tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-43856a65-fe49-4b33-957e-94b9c66ae290 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:37:07 devstack sudo[111241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-43856a65-fe49-4b33-957e-94b9c66ae290 Aug 26 14:37:07 devstack sudo[111241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:37:07 devstack sudo[111241]: pam_unix(sudo:session): session closed for user root Aug 26 14:37:07 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-7e95f479-cc76-40b9-a988-cc5d783530de tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-43856a65-fe49-4b33-957e-94b9c66ae290" returned: 0 in 0.268s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:37:07 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-7e95f479-cc76-40b9-a988-cc5d783530de tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Lock "cinder-quobyte-43856a65-fe49-4b33-957e-94b9c66ae290" released by "delete_volume" :: held 0.692s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:37:07 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-7e95f479-cc76-40b9-a988-cc5d783530de tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Created reservations ['647e7efa-0ea0-49eb-b7a7-2037b504f983', '51e00de3-e7d9-4dc3-a53a-17e55659d791', '8db2efea-8009-4eb9-961d-7d282018b810', '68135559-9aee-4899-8a5d-51644300412a'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:37:07 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-7e95f479-cc76-40b9-a988-cc5d783530de tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:37:07 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-7e95f479-cc76-40b9-a988-cc5d783530de tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:37:07 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-7e95f479-cc76-40b9-a988-cc5d783530de tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:37:07 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-7e95f479-cc76-40b9-a988-cc5d783530de tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:37:07 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-7e95f479-cc76-40b9-a988-cc5d783530de tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:37:07 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-7e95f479-cc76-40b9-a988-cc5d783530de tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:37:07 devstack sudo[111248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:37:07 devstack sudo[111248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:37:07 devstack sudo[111248]: pam_unix(sudo:session): session closed for user root Aug 26 14:37:07 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-7e95f479-cc76-40b9-a988-cc5d783530de tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.266s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:37:07 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-7e95f479-cc76-40b9-a988-cc5d783530de tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:37:07 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-7e95f479-cc76-40b9-a988-cc5d783530de tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Deleted volume successfully. Aug 26 14:37:07 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-7e95f479-cc76-40b9-a988-cc5d783530de tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Lock "cinder-43856a65-fe49-4b33-957e-94b9c66ae290-delete_volume" released by "delete_volume" :: held 1.171s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:37:07 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-ee6afcf1-3318-48fc-b553-4478542204f0 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Acquiring lock "cinder-a32ccb5a-c5aa-45d8-a47e-c611ac28ff15-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:37:07 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-ee6afcf1-3318-48fc-b553-4478542204f0 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Lock "cinder-a32ccb5a-c5aa-45d8-a47e-c611ac28ff15-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:37:07 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-ee6afcf1-3318-48fc-b553-4478542204f0 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Acquiring lock "cinder-quobyte-a32ccb5a-c5aa-45d8-a47e-c611ac28ff15" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:37:07 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-ee6afcf1-3318-48fc-b553-4478542204f0 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Lock "cinder-quobyte-a32ccb5a-c5aa-45d8-a47e-c611ac28ff15" acquired by "delete_volume" :: waited 0.015s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:37:07 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[26049968-56ff-4fbf-b1c7-d3882da99d0c]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:37:07 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-ee6afcf1-3318-48fc-b553-4478542204f0 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-a32ccb5a-c5aa-45d8-a47e-c611ac28ff15 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:37:07 devstack sudo[111281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-a32ccb5a-c5aa-45d8-a47e-c611ac28ff15 Aug 26 14:37:08 devstack sudo[111281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:37:08 devstack sudo[111281]: pam_unix(sudo:session): session closed for user root Aug 26 14:37:08 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-ee6afcf1-3318-48fc-b553-4478542204f0 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-a32ccb5a-c5aa-45d8-a47e-c611ac28ff15" returned: 0 in 0.402s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:37:08 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-ee6afcf1-3318-48fc-b553-4478542204f0 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-a32ccb5a-c5aa-45d8-a47e-c611ac28ff15 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:37:08 devstack sudo[111291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-a32ccb5a-c5aa-45d8-a47e-c611ac28ff15 Aug 26 14:37:08 devstack sudo[111291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:37:08 devstack sudo[111291]: pam_unix(sudo:session): session closed for user root Aug 26 14:37:08 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-ee6afcf1-3318-48fc-b553-4478542204f0 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-a32ccb5a-c5aa-45d8-a47e-c611ac28ff15" returned: 0 in 0.292s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:37:08 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-ee6afcf1-3318-48fc-b553-4478542204f0 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Lock "cinder-quobyte-a32ccb5a-c5aa-45d8-a47e-c611ac28ff15" released by "delete_volume" :: held 0.744s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:37:08 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-ee6afcf1-3318-48fc-b553-4478542204f0 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Created reservations ['e15b6e5c-ef2d-4e0e-904d-fb61ed87143c', '1927502d-9b49-4243-b69b-9e9de56c6723', 'f774be7a-02e2-4eb2-9bc7-e4b533b8e8b8', '6e27f1c3-47ab-4762-b284-2c2cae0bf45f'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:37:08 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-ee6afcf1-3318-48fc-b553-4478542204f0 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:37:08 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-ee6afcf1-3318-48fc-b553-4478542204f0 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:37:08 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-ee6afcf1-3318-48fc-b553-4478542204f0 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:37:08 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-ee6afcf1-3318-48fc-b553-4478542204f0 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:37:08 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-ee6afcf1-3318-48fc-b553-4478542204f0 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:37:08 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-ee6afcf1-3318-48fc-b553-4478542204f0 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:37:08 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d4c6689-d1b2-426a-97cd-83013be50c23 tempest-ProjectReaderTests-226416731 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:37:08 devstack sudo[111303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:37:08 devstack sudo[111303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:37:08 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-1d4c6689-d1b2-426a-97cd-83013be50c23 tempest-ProjectReaderTests-226416731 None] Flow 'volume_create_manager' (0d2a9608-2e26-4a03-94b6-623d0b1be07c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:37:08 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-1d4c6689-d1b2-426a-97cd-83013be50c23 tempest-ProjectReaderTests-226416731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37e03b9a-90c5-4c08-b92e-9336fa3994aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:37:08 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-1d4c6689-d1b2-426a-97cd-83013be50c23 tempest-ProjectReaderTests-226416731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37e03b9a-90c5-4c08-b92e-9336fa3994aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:37:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-510773236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95fdb6c7-3dd5-46bf-ad58-1ed6fe788bef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='372c125e5e8e4029b1741e0f26e42df2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:37:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:37:09Z,use_quota=True,user_id='2e0edd64adcb4ae69ae4b37d853e4630',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:37:08 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-1d4c6689-d1b2-426a-97cd-83013be50c23 tempest-ProjectReaderTests-226416731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bae70c0-2d7a-4bc5-bfdf-b2ed199ff400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:37:08 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-1d4c6689-d1b2-426a-97cd-83013be50c23 tempest-ProjectReaderTests-226416731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bae70c0-2d7a-4bc5-bfdf-b2ed199ff400) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:37:08 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-1d4c6689-d1b2-426a-97cd-83013be50c23 tempest-ProjectReaderTests-226416731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74f9c503-0bd0-4901-9ef1-b1c76773c3e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:37:08 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-1d4c6689-d1b2-426a-97cd-83013be50c23 tempest-ProjectReaderTests-226416731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74f9c503-0bd0-4901-9ef1-b1c76773c3e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95fdb6c7-3dd5-46bf-ad58-1ed6fe788bef', 'volume_name': 'volume-95fdb6c7-3dd5-46bf-ad58-1ed6fe788bef', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:37:08 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-1d4c6689-d1b2-426a-97cd-83013be50c23 tempest-ProjectReaderTests-226416731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (745c3dcb-6dc6-4937-ab1e-b372079eebe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:37:08 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-1d4c6689-d1b2-426a-97cd-83013be50c23 tempest-ProjectReaderTests-226416731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (745c3dcb-6dc6-4937-ab1e-b372079eebe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:37:08 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-1d4c6689-d1b2-426a-97cd-83013be50c23 tempest-ProjectReaderTests-226416731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7b9de35-319f-480e-9943-1348637a846d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:37:08 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-1d4c6689-d1b2-426a-97cd-83013be50c23 tempest-ProjectReaderTests-226416731 None] Volume 95fdb6c7-3dd5-46bf-ad58-1ed6fe788bef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95fdb6c7-3dd5-46bf-ad58-1ed6fe788bef', 'volume_size': 1} Aug 26 14:37:08 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-1d4c6689-d1b2-426a-97cd-83013be50c23 tempest-ProjectReaderTests-226416731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:37:08 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-1d4c6689-d1b2-426a-97cd-83013be50c23 tempest-ProjectReaderTests-226416731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:37:08 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-1d4c6689-d1b2-426a-97cd-83013be50c23 tempest-ProjectReaderTests-226416731 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:37:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-510773236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95fdb6c7-3dd5-46bf-ad58-1ed6fe788bef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='372c125e5e8e4029b1741e0f26e42df2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:37:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:37:09Z,use_quota=True,user_id='2e0edd64adcb4ae69ae4b37d853e4630',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:37:08 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-1d4c6689-d1b2-426a-97cd-83013be50c23 tempest-ProjectReaderTests-226416731 None] Creating volume 95fdb6c7-3dd5-46bf-ad58-1ed6fe788bef {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:37:08 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-1d4c6689-d1b2-426a-97cd-83013be50c23 tempest-ProjectReaderTests-226416731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:37:08 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-1d4c6689-d1b2-426a-97cd-83013be50c23 tempest-ProjectReaderTests-226416731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:37:08 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-1d4c6689-d1b2-426a-97cd-83013be50c23 tempest-ProjectReaderTests-226416731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:37:08 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-1d4c6689-d1b2-426a-97cd-83013be50c23 tempest-ProjectReaderTests-226416731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:37:08 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-1d4c6689-d1b2-426a-97cd-83013be50c23 tempest-ProjectReaderTests-226416731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:37:08 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-1d4c6689-d1b2-426a-97cd-83013be50c23 tempest-ProjectReaderTests-226416731 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:37:08 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-1d4c6689-d1b2-426a-97cd-83013be50c23 tempest-ProjectReaderTests-226416731 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:37:08 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-1d4c6689-d1b2-426a-97cd-83013be50c23 tempest-ProjectReaderTests-226416731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-95fdb6c7-3dd5-46bf-ad58-1ed6fe788bef 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:37:08 devstack sudo[111307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-95fdb6c7-3dd5-46bf-ad58-1ed6fe788bef 1073741824 Aug 26 14:37:08 devstack sudo[111307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:37:08 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-d7f147e1-7f0c-43d1-bd79-2da9a5e779f3 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Acquiring lock "cinder-058048f7-1d65-4821-a098-2a4ad2240848-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:37:09 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-d7f147e1-7f0c-43d1-bd79-2da9a5e779f3 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Lock "cinder-058048f7-1d65-4821-a098-2a4ad2240848-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:37:09 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-d7f147e1-7f0c-43d1-bd79-2da9a5e779f3 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Acquiring lock "cinder-quobyte-058048f7-1d65-4821-a098-2a4ad2240848" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:37:09 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-d7f147e1-7f0c-43d1-bd79-2da9a5e779f3 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Lock "cinder-quobyte-058048f7-1d65-4821-a098-2a4ad2240848" acquired by "delete_volume" :: waited 0.031s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:37:09 devstack sudo[111303]: pam_unix(sudo:session): session closed for user root Aug 26 14:37:09 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-ee6afcf1-3318-48fc-b553-4478542204f0 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.346s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:37:09 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-ee6afcf1-3318-48fc-b553-4478542204f0 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:37:09 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-ee6afcf1-3318-48fc-b553-4478542204f0 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Deleted volume successfully. Aug 26 14:37:09 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f67e46c-d16b-4af8-8124-96218efa9e89]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:37:09 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-d7f147e1-7f0c-43d1-bd79-2da9a5e779f3 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-058048f7-1d65-4821-a098-2a4ad2240848 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:37:09 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-ee6afcf1-3318-48fc-b553-4478542204f0 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Lock "cinder-a32ccb5a-c5aa-45d8-a47e-c611ac28ff15-delete_volume" released by "delete_volume" :: held 1.353s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:37:09 devstack sudo[111317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-058048f7-1d65-4821-a098-2a4ad2240848 Aug 26 14:37:09 devstack sudo[111317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:37:09 devstack sudo[111307]: pam_unix(sudo:session): session closed for user root Aug 26 14:37:09 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-1d4c6689-d1b2-426a-97cd-83013be50c23 tempest-ProjectReaderTests-226416731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-95fdb6c7-3dd5-46bf-ad58-1ed6fe788bef 1073741824" returned: 0 in 0.560s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:37:09 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-1d4c6689-d1b2-426a-97cd-83013be50c23 tempest-ProjectReaderTests-226416731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-95fdb6c7-3dd5-46bf-ad58-1ed6fe788bef {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:37:09 devstack sudo[111336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-95fdb6c7-3dd5-46bf-ad58-1ed6fe788bef Aug 26 14:37:09 devstack sudo[111336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:37:09 devstack sudo[111317]: pam_unix(sudo:session): session closed for user root Aug 26 14:37:09 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-d7f147e1-7f0c-43d1-bd79-2da9a5e779f3 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-058048f7-1d65-4821-a098-2a4ad2240848" returned: 0 in 0.462s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:37:09 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-d7f147e1-7f0c-43d1-bd79-2da9a5e779f3 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-058048f7-1d65-4821-a098-2a4ad2240848 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:37:09 devstack sudo[111342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-058048f7-1d65-4821-a098-2a4ad2240848 Aug 26 14:37:09 devstack sudo[111342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:37:09 devstack sudo[111336]: pam_unix(sudo:session): session closed for user root Aug 26 14:37:09 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-1d4c6689-d1b2-426a-97cd-83013be50c23 tempest-ProjectReaderTests-226416731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-95fdb6c7-3dd5-46bf-ad58-1ed6fe788bef" returned: 0 in 0.316s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:37:09 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-1d4c6689-d1b2-426a-97cd-83013be50c23 tempest-ProjectReaderTests-226416731 None] <== create_volume: return (927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:37:09 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-1d4c6689-d1b2-426a-97cd-83013be50c23 tempest-ProjectReaderTests-226416731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.930s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:37:09 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-1d4c6689-d1b2-426a-97cd-83013be50c23 tempest-ProjectReaderTests-226416731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7b9de35-319f-480e-9943-1348637a846d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95fdb6c7-3dd5-46bf-ad58-1ed6fe788bef', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:37:09 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-1d4c6689-d1b2-426a-97cd-83013be50c23 tempest-ProjectReaderTests-226416731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a278fc7a-72b8-499c-bd46-d838a2b62376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:37:09 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-1d4c6689-d1b2-426a-97cd-83013be50c23 tempest-ProjectReaderTests-226416731 None] Volume volume-95fdb6c7-3dd5-46bf-ad58-1ed6fe788bef (95fdb6c7-3dd5-46bf-ad58-1ed6fe788bef): created successfully Aug 26 14:37:09 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-1d4c6689-d1b2-426a-97cd-83013be50c23 tempest-ProjectReaderTests-226416731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a278fc7a-72b8-499c-bd46-d838a2b62376) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:37:09 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-1d4c6689-d1b2-426a-97cd-83013be50c23 tempest-ProjectReaderTests-226416731 None] Flow 'volume_create_manager' (0d2a9608-2e26-4a03-94b6-623d0b1be07c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:37:09 devstack sudo[111342]: pam_unix(sudo:session): session closed for user root Aug 26 14:37:09 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-d7f147e1-7f0c-43d1-bd79-2da9a5e779f3 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-058048f7-1d65-4821-a098-2a4ad2240848" returned: 0 in 0.276s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:37:09 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-1d4c6689-d1b2-426a-97cd-83013be50c23 tempest-ProjectReaderTests-226416731 None] Created volume successfully. Aug 26 14:37:09 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-d7f147e1-7f0c-43d1-bd79-2da9a5e779f3 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Lock "cinder-quobyte-058048f7-1d65-4821-a098-2a4ad2240848" released by "delete_volume" :: held 0.801s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:37:09 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-d7f147e1-7f0c-43d1-bd79-2da9a5e779f3 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Created reservations ['2a10b54a-e60d-4e80-8a21-47e2665d9c94', '37e5515e-7b52-46eb-9f73-cf739244d3d7', '77e27cec-45d1-4c93-b20a-56db7591cbe7', 'e1e177c2-c49f-4ddd-b6dd-46229c2c68cd'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:37:10 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-d7f147e1-7f0c-43d1-bd79-2da9a5e779f3 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:37:10 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-d7f147e1-7f0c-43d1-bd79-2da9a5e779f3 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:37:10 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-d7f147e1-7f0c-43d1-bd79-2da9a5e779f3 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:37:10 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-d7f147e1-7f0c-43d1-bd79-2da9a5e779f3 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:37:10 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-d7f147e1-7f0c-43d1-bd79-2da9a5e779f3 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:37:10 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-d7f147e1-7f0c-43d1-bd79-2da9a5e779f3 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:37:10 devstack sudo[111346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:37:10 devstack sudo[111346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:37:10 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-5226b881-fdab-4ea5-827c-e69e0ee5a4f5 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Acquiring lock "cinder-ef0094f8-9500-4023-837c-0061b9bde6d3-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:37:10 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-5226b881-fdab-4ea5-827c-e69e0ee5a4f5 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Lock "cinder-ef0094f8-9500-4023-837c-0061b9bde6d3-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:37:10 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-5226b881-fdab-4ea5-827c-e69e0ee5a4f5 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Acquiring lock "cinder-quobyte-ef0094f8-9500-4023-837c-0061b9bde6d3" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:37:10 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-5226b881-fdab-4ea5-827c-e69e0ee5a4f5 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Lock "cinder-quobyte-ef0094f8-9500-4023-837c-0061b9bde6d3" acquired by "delete_volume" :: waited 0.019s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:37:10 devstack sudo[111346]: pam_unix(sudo:session): session closed for user root Aug 26 14:37:10 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-d7f147e1-7f0c-43d1-bd79-2da9a5e779f3 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.313s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:37:10 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-d7f147e1-7f0c-43d1-bd79-2da9a5e779f3 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:37:10 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-d7f147e1-7f0c-43d1-bd79-2da9a5e779f3 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Deleted volume successfully. Aug 26 14:37:10 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc71a4a1-7ea3-4cae-a08d-91e3217471c5]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:37:10 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-5226b881-fdab-4ea5-827c-e69e0ee5a4f5 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ef0094f8-9500-4023-837c-0061b9bde6d3 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:37:10 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-d7f147e1-7f0c-43d1-bd79-2da9a5e779f3 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Lock "cinder-058048f7-1d65-4821-a098-2a4ad2240848-delete_volume" released by "delete_volume" :: held 1.361s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:37:10 devstack sudo[111350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ef0094f8-9500-4023-837c-0061b9bde6d3 Aug 26 14:37:10 devstack sudo[111350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:37:10 devstack sudo[111350]: pam_unix(sudo:session): session closed for user root Aug 26 14:37:10 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-5226b881-fdab-4ea5-827c-e69e0ee5a4f5 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ef0094f8-9500-4023-837c-0061b9bde6d3" returned: 0 in 0.445s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:37:10 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-5226b881-fdab-4ea5-827c-e69e0ee5a4f5 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ef0094f8-9500-4023-837c-0061b9bde6d3 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:37:10 devstack sudo[111357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ef0094f8-9500-4023-837c-0061b9bde6d3 Aug 26 14:37:10 devstack sudo[111357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:37:11 devstack sudo[111357]: pam_unix(sudo:session): session closed for user root Aug 26 14:37:11 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-edf78d08-3604-4945-bd51-e1dc9e9c2227 tempest-ProjectReaderTests-226416731 None] Acquiring lock "cinder-95fdb6c7-3dd5-46bf-ad58-1ed6fe788bef-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:37:11 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-5226b881-fdab-4ea5-827c-e69e0ee5a4f5 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ef0094f8-9500-4023-837c-0061b9bde6d3" returned: 0 in 0.289s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:37:11 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-5226b881-fdab-4ea5-827c-e69e0ee5a4f5 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Lock "cinder-quobyte-ef0094f8-9500-4023-837c-0061b9bde6d3" released by "delete_volume" :: held 0.798s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:37:11 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-edf78d08-3604-4945-bd51-e1dc9e9c2227 tempest-ProjectReaderTests-226416731 None] Lock "cinder-95fdb6c7-3dd5-46bf-ad58-1ed6fe788bef-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:37:11 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-edf78d08-3604-4945-bd51-e1dc9e9c2227 tempest-ProjectReaderTests-226416731 None] Acquiring lock "cinder-quobyte-95fdb6c7-3dd5-46bf-ad58-1ed6fe788bef" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:37:11 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-5226b881-fdab-4ea5-827c-e69e0ee5a4f5 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Created reservations ['d4aec179-3f1d-4ef0-a6eb-b7151d93beb1', '8c0aa953-d777-4d97-b361-7cbf1c5416a5', '947ff353-92c1-422b-b0e9-7d55889bc088', 'c9cce6bb-a6e2-454d-8a56-714e62da5985'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:37:11 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-edf78d08-3604-4945-bd51-e1dc9e9c2227 tempest-ProjectReaderTests-226416731 None] Lock "cinder-quobyte-95fdb6c7-3dd5-46bf-ad58-1ed6fe788bef" acquired by "delete_volume" :: waited 0.028s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:37:11 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[4911d686-ae29-495b-9779-4f97abdac184]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:37:11 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-edf78d08-3604-4945-bd51-e1dc9e9c2227 tempest-ProjectReaderTests-226416731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-95fdb6c7-3dd5-46bf-ad58-1ed6fe788bef {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:37:11 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-5226b881-fdab-4ea5-827c-e69e0ee5a4f5 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:37:11 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-5226b881-fdab-4ea5-827c-e69e0ee5a4f5 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:37:11 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-5226b881-fdab-4ea5-827c-e69e0ee5a4f5 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:37:11 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-5226b881-fdab-4ea5-827c-e69e0ee5a4f5 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:37:11 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-5226b881-fdab-4ea5-827c-e69e0ee5a4f5 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:37:11 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-5226b881-fdab-4ea5-827c-e69e0ee5a4f5 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:37:11 devstack sudo[111362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:37:11 devstack sudo[111362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:37:11 devstack sudo[111360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-95fdb6c7-3dd5-46bf-ad58-1ed6fe788bef Aug 26 14:37:11 devstack sudo[111360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:37:11 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-bc3672b6-1def-4e45-a226-cc811c0a76d7 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Acquiring lock "cinder-48416d4b-562f-45ad-8243-b0d5d50fb70d-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:37:11 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-bc3672b6-1def-4e45-a226-cc811c0a76d7 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Lock "cinder-48416d4b-562f-45ad-8243-b0d5d50fb70d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:37:11 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-bc3672b6-1def-4e45-a226-cc811c0a76d7 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Acquiring lock "cinder-quobyte-48416d4b-562f-45ad-8243-b0d5d50fb70d" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:37:11 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-bc3672b6-1def-4e45-a226-cc811c0a76d7 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Lock "cinder-quobyte-48416d4b-562f-45ad-8243-b0d5d50fb70d" acquired by "delete_volume" :: waited 0.031s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:37:11 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[02ec4479-249f-408d-9fbd-7dcf3cd7613b]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:37:11 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-bc3672b6-1def-4e45-a226-cc811c0a76d7 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-48416d4b-562f-45ad-8243-b0d5d50fb70d {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:37:11 devstack sudo[111362]: pam_unix(sudo:session): session closed for user root Aug 26 14:37:11 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-5226b881-fdab-4ea5-827c-e69e0ee5a4f5 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.350s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:37:11 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-5226b881-fdab-4ea5-827c-e69e0ee5a4f5 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:37:11 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-5226b881-fdab-4ea5-827c-e69e0ee5a4f5 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Deleted volume successfully. Aug 26 14:37:11 devstack sudo[111360]: pam_unix(sudo:session): session closed for user root Aug 26 14:37:11 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-5226b881-fdab-4ea5-827c-e69e0ee5a4f5 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Lock "cinder-ef0094f8-9500-4023-837c-0061b9bde6d3-delete_volume" released by "delete_volume" :: held 1.475s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:37:11 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-edf78d08-3604-4945-bd51-e1dc9e9c2227 tempest-ProjectReaderTests-226416731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-95fdb6c7-3dd5-46bf-ad58-1ed6fe788bef" returned: 0 in 0.484s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:37:11 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-edf78d08-3604-4945-bd51-e1dc9e9c2227 tempest-ProjectReaderTests-226416731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-95fdb6c7-3dd5-46bf-ad58-1ed6fe788bef {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:37:11 devstack sudo[111366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-48416d4b-562f-45ad-8243-b0d5d50fb70d Aug 26 14:37:11 devstack sudo[111366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:37:11 devstack sudo[111371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-95fdb6c7-3dd5-46bf-ad58-1ed6fe788bef Aug 26 14:37:11 devstack sudo[111371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:37:12 devstack sudo[111366]: pam_unix(sudo:session): session closed for user root Aug 26 14:37:12 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-bc3672b6-1def-4e45-a226-cc811c0a76d7 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-48416d4b-562f-45ad-8243-b0d5d50fb70d" returned: 0 in 0.426s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:37:12 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-bc3672b6-1def-4e45-a226-cc811c0a76d7 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-48416d4b-562f-45ad-8243-b0d5d50fb70d {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:37:12 devstack sudo[111371]: pam_unix(sudo:session): session closed for user root Aug 26 14:37:12 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-edf78d08-3604-4945-bd51-e1dc9e9c2227 tempest-ProjectReaderTests-226416731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-95fdb6c7-3dd5-46bf-ad58-1ed6fe788bef" returned: 0 in 0.311s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:37:12 devstack sudo[111378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-48416d4b-562f-45ad-8243-b0d5d50fb70d Aug 26 14:37:12 devstack sudo[111378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:37:12 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-edf78d08-3604-4945-bd51-e1dc9e9c2227 tempest-ProjectReaderTests-226416731 None] Lock "cinder-quobyte-95fdb6c7-3dd5-46bf-ad58-1ed6fe788bef" released by "delete_volume" :: held 0.844s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:37:12 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-edf78d08-3604-4945-bd51-e1dc9e9c2227 tempest-ProjectReaderTests-226416731 None] Created reservations ['73abf06a-6c4c-4ab5-838e-809ea7c0314f', '17d87171-f1f1-423a-b1cc-62aa4edc5f67', 'e125a52e-75fc-47db-9132-628af0da5ae3', '09e50eed-835f-41d8-942e-3c8bfa71616f'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:37:12 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-edf78d08-3604-4945-bd51-e1dc9e9c2227 tempest-ProjectReaderTests-226416731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:37:12 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-edf78d08-3604-4945-bd51-e1dc9e9c2227 tempest-ProjectReaderTests-226416731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:37:12 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-edf78d08-3604-4945-bd51-e1dc9e9c2227 tempest-ProjectReaderTests-226416731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:37:12 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-edf78d08-3604-4945-bd51-e1dc9e9c2227 tempest-ProjectReaderTests-226416731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:37:12 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-edf78d08-3604-4945-bd51-e1dc9e9c2227 tempest-ProjectReaderTests-226416731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:37:12 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-edf78d08-3604-4945-bd51-e1dc9e9c2227 tempest-ProjectReaderTests-226416731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:37:12 devstack sudo[111380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:37:12 devstack sudo[111380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:37:12 devstack sudo[111378]: pam_unix(sudo:session): session closed for user root Aug 26 14:37:12 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-bc3672b6-1def-4e45-a226-cc811c0a76d7 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-48416d4b-562f-45ad-8243-b0d5d50fb70d" returned: 0 in 0.337s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:37:12 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-bc3672b6-1def-4e45-a226-cc811c0a76d7 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Lock "cinder-quobyte-48416d4b-562f-45ad-8243-b0d5d50fb70d" released by "delete_volume" :: held 0.825s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:37:12 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-bc3672b6-1def-4e45-a226-cc811c0a76d7 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Created reservations ['d6aae2fc-b290-49df-858f-f33c0c08a689', '6db7ea7b-c5fc-4c1f-9dec-50b2d05dbff7', '6dd71be4-8998-46b7-8b7f-7768ade66fe8', 'f547a3d9-4856-4d92-bf45-736f0eb947d7'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:37:12 devstack sudo[111380]: pam_unix(sudo:session): session closed for user root Aug 26 14:37:12 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-bc3672b6-1def-4e45-a226-cc811c0a76d7 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:37:12 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-bc3672b6-1def-4e45-a226-cc811c0a76d7 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:37:12 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-bc3672b6-1def-4e45-a226-cc811c0a76d7 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:37:12 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-bc3672b6-1def-4e45-a226-cc811c0a76d7 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:37:12 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-bc3672b6-1def-4e45-a226-cc811c0a76d7 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:37:12 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-bc3672b6-1def-4e45-a226-cc811c0a76d7 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:37:12 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-edf78d08-3604-4945-bd51-e1dc9e9c2227 tempest-ProjectReaderTests-226416731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.391s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:37:12 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-edf78d08-3604-4945-bd51-e1dc9e9c2227 tempest-ProjectReaderTests-226416731 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:37:12 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-edf78d08-3604-4945-bd51-e1dc9e9c2227 tempest-ProjectReaderTests-226416731 None] Deleted volume successfully. Aug 26 14:37:12 devstack sudo[111384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:37:12 devstack sudo[111384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:37:12 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-edf78d08-3604-4945-bd51-e1dc9e9c2227 tempest-ProjectReaderTests-226416731 None] Lock "cinder-95fdb6c7-3dd5-46bf-ad58-1ed6fe788bef-delete_volume" released by "delete_volume" :: held 1.512s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:37:12 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-1a04ba3d-8521-4f28-89a4-461c50a619f4 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Acquiring lock "cinder-9ea0380e-da02-4ee5-902c-ff3b55707d1b-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:37:12 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-1a04ba3d-8521-4f28-89a4-461c50a619f4 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Lock "cinder-9ea0380e-da02-4ee5-902c-ff3b55707d1b-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:37:12 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-1a04ba3d-8521-4f28-89a4-461c50a619f4 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Acquiring lock "cinder-quobyte-9ea0380e-da02-4ee5-902c-ff3b55707d1b" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:37:12 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-1a04ba3d-8521-4f28-89a4-461c50a619f4 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Lock "cinder-quobyte-9ea0380e-da02-4ee5-902c-ff3b55707d1b" acquired by "delete_volume" :: waited 0.027s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:37:12 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eb7a7f9-c5c4-44f7-a5cd-1a6cae1e7051]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:37:12 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-1a04ba3d-8521-4f28-89a4-461c50a619f4 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9ea0380e-da02-4ee5-902c-ff3b55707d1b {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:37:13 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e2064aa-6a08-4fa8-a84e-e4408808e44b tempest-ProjectReaderTests-226416731 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:37:13 devstack sudo[111384]: pam_unix(sudo:session): session closed for user root Aug 26 14:37:13 devstack sudo[111386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9ea0380e-da02-4ee5-902c-ff3b55707d1b Aug 26 14:37:13 devstack sudo[111386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:37:13 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-0e2064aa-6a08-4fa8-a84e-e4408808e44b tempest-ProjectReaderTests-226416731 None] Flow 'volume_create_manager' (aa1fa788-379e-4bcb-a48c-ef046eb359de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:37:13 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-0e2064aa-6a08-4fa8-a84e-e4408808e44b tempest-ProjectReaderTests-226416731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80e1f4a7-9155-4b19-8269-e4f1b2bc3c8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:37:13 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-bc3672b6-1def-4e45-a226-cc811c0a76d7 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.525s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:37:13 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-bc3672b6-1def-4e45-a226-cc811c0a76d7 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:37:13 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-bc3672b6-1def-4e45-a226-cc811c0a76d7 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Deleted volume successfully. Aug 26 14:37:13 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-0e2064aa-6a08-4fa8-a84e-e4408808e44b tempest-ProjectReaderTests-226416731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80e1f4a7-9155-4b19-8269-e4f1b2bc3c8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:37:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-612436558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd2b7491-a8d0-40b4-90bb-617af66874b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='372c125e5e8e4029b1741e0f26e42df2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:37:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:37:13Z,use_quota=True,user_id='2e0edd64adcb4ae69ae4b37d853e4630',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:37:13 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-0e2064aa-6a08-4fa8-a84e-e4408808e44b tempest-ProjectReaderTests-226416731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d9db88a-976b-4088-970c-13ad306cdd99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:37:13 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-0e2064aa-6a08-4fa8-a84e-e4408808e44b tempest-ProjectReaderTests-226416731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d9db88a-976b-4088-970c-13ad306cdd99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:37:13 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-0e2064aa-6a08-4fa8-a84e-e4408808e44b tempest-ProjectReaderTests-226416731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a238351c-cc30-4bbe-9022-70d6b682ef50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:37:13 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-0e2064aa-6a08-4fa8-a84e-e4408808e44b tempest-ProjectReaderTests-226416731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a238351c-cc30-4bbe-9022-70d6b682ef50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd2b7491-a8d0-40b4-90bb-617af66874b0', 'volume_name': 'volume-bd2b7491-a8d0-40b4-90bb-617af66874b0', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:37:13 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-0e2064aa-6a08-4fa8-a84e-e4408808e44b tempest-ProjectReaderTests-226416731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1d95638-574b-4f84-b332-b94a8ec9e4fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:37:13 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-0e2064aa-6a08-4fa8-a84e-e4408808e44b tempest-ProjectReaderTests-226416731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1d95638-574b-4f84-b332-b94a8ec9e4fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:37:13 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-0e2064aa-6a08-4fa8-a84e-e4408808e44b tempest-ProjectReaderTests-226416731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c8fdfaf-36c4-4730-940d-fb22c7b00d4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:37:13 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-0e2064aa-6a08-4fa8-a84e-e4408808e44b tempest-ProjectReaderTests-226416731 None] Volume bd2b7491-a8d0-40b4-90bb-617af66874b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd2b7491-a8d0-40b4-90bb-617af66874b0', 'volume_size': 1} Aug 26 14:37:13 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-0e2064aa-6a08-4fa8-a84e-e4408808e44b tempest-ProjectReaderTests-226416731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:37:13 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-0e2064aa-6a08-4fa8-a84e-e4408808e44b tempest-ProjectReaderTests-226416731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:37:13 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-0e2064aa-6a08-4fa8-a84e-e4408808e44b tempest-ProjectReaderTests-226416731 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:37:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-612436558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd2b7491-a8d0-40b4-90bb-617af66874b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='372c125e5e8e4029b1741e0f26e42df2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:37:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:37:13Z,use_quota=True,user_id='2e0edd64adcb4ae69ae4b37d853e4630',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:37:13 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-0e2064aa-6a08-4fa8-a84e-e4408808e44b tempest-ProjectReaderTests-226416731 None] Creating volume bd2b7491-a8d0-40b4-90bb-617af66874b0 {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:37:13 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-0e2064aa-6a08-4fa8-a84e-e4408808e44b tempest-ProjectReaderTests-226416731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:37:13 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-0e2064aa-6a08-4fa8-a84e-e4408808e44b tempest-ProjectReaderTests-226416731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:37:13 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-0e2064aa-6a08-4fa8-a84e-e4408808e44b tempest-ProjectReaderTests-226416731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:37:13 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-0e2064aa-6a08-4fa8-a84e-e4408808e44b tempest-ProjectReaderTests-226416731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:37:13 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-0e2064aa-6a08-4fa8-a84e-e4408808e44b tempest-ProjectReaderTests-226416731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:37:13 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-0e2064aa-6a08-4fa8-a84e-e4408808e44b tempest-ProjectReaderTests-226416731 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:37:13 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-0e2064aa-6a08-4fa8-a84e-e4408808e44b tempest-ProjectReaderTests-226416731 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:37:13 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-0e2064aa-6a08-4fa8-a84e-e4408808e44b tempest-ProjectReaderTests-226416731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-bd2b7491-a8d0-40b4-90bb-617af66874b0 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:37:13 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-bc3672b6-1def-4e45-a226-cc811c0a76d7 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Lock "cinder-48416d4b-562f-45ad-8243-b0d5d50fb70d-delete_volume" released by "delete_volume" :: held 1.765s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:37:13 devstack sudo[111389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-bd2b7491-a8d0-40b4-90bb-617af66874b0 1073741824 Aug 26 14:37:13 devstack sudo[111389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:37:13 devstack sudo[111386]: pam_unix(sudo:session): session closed for user root Aug 26 14:37:13 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-1a04ba3d-8521-4f28-89a4-461c50a619f4 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9ea0380e-da02-4ee5-902c-ff3b55707d1b" returned: 0 in 0.458s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:37:13 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-1a04ba3d-8521-4f28-89a4-461c50a619f4 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9ea0380e-da02-4ee5-902c-ff3b55707d1b {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:37:13 devstack sudo[111394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9ea0380e-da02-4ee5-902c-ff3b55707d1b Aug 26 14:37:13 devstack sudo[111394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:37:13 devstack sudo[111394]: pam_unix(sudo:session): session closed for user root Aug 26 14:37:13 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-1a04ba3d-8521-4f28-89a4-461c50a619f4 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9ea0380e-da02-4ee5-902c-ff3b55707d1b" returned: 0 in 0.281s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:37:13 devstack sudo[111389]: pam_unix(sudo:session): session closed for user root Aug 26 14:37:13 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-1a04ba3d-8521-4f28-89a4-461c50a619f4 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Lock "cinder-quobyte-9ea0380e-da02-4ee5-902c-ff3b55707d1b" released by "delete_volume" :: held 0.798s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:37:13 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-0e2064aa-6a08-4fa8-a84e-e4408808e44b tempest-ProjectReaderTests-226416731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-bd2b7491-a8d0-40b4-90bb-617af66874b0 1073741824" returned: 0 in 0.465s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:37:13 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-0e2064aa-6a08-4fa8-a84e-e4408808e44b tempest-ProjectReaderTests-226416731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-bd2b7491-a8d0-40b4-90bb-617af66874b0 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:37:13 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-1a04ba3d-8521-4f28-89a4-461c50a619f4 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Created reservations ['221352cf-a77c-42ae-850e-987c388979b6', '8e052ed4-cd4c-45b0-82d5-d542184ff0dd', 'fed206f3-f462-460e-b340-6bbee4644db2', 'e328be97-4f86-4edb-aee6-791309f22746'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:37:13 devstack sudo[111400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-bd2b7491-a8d0-40b4-90bb-617af66874b0 Aug 26 14:37:13 devstack sudo[111400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:37:13 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-1a04ba3d-8521-4f28-89a4-461c50a619f4 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:37:13 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-1a04ba3d-8521-4f28-89a4-461c50a619f4 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:37:13 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-1a04ba3d-8521-4f28-89a4-461c50a619f4 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:37:13 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-1a04ba3d-8521-4f28-89a4-461c50a619f4 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:37:13 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-1a04ba3d-8521-4f28-89a4-461c50a619f4 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:37:13 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-1a04ba3d-8521-4f28-89a4-461c50a619f4 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:37:13 devstack sudo[111402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:37:13 devstack sudo[111402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:37:13 devstack sudo[111400]: pam_unix(sudo:session): session closed for user root Aug 26 14:37:13 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-0e2064aa-6a08-4fa8-a84e-e4408808e44b tempest-ProjectReaderTests-226416731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-bd2b7491-a8d0-40b4-90bb-617af66874b0" returned: 0 in 0.264s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:37:13 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-0e2064aa-6a08-4fa8-a84e-e4408808e44b tempest-ProjectReaderTests-226416731 None] <== create_volume: return (784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:37:13 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-0e2064aa-6a08-4fa8-a84e-e4408808e44b tempest-ProjectReaderTests-226416731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.786s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:37:13 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-0e2064aa-6a08-4fa8-a84e-e4408808e44b tempest-ProjectReaderTests-226416731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c8fdfaf-36c4-4730-940d-fb22c7b00d4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd2b7491-a8d0-40b4-90bb-617af66874b0', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:37:13 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-0e2064aa-6a08-4fa8-a84e-e4408808e44b tempest-ProjectReaderTests-226416731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d33c2d2-d32d-4e1a-8dc5-e6553949fbf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:37:13 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-0e2064aa-6a08-4fa8-a84e-e4408808e44b tempest-ProjectReaderTests-226416731 None] Volume volume-bd2b7491-a8d0-40b4-90bb-617af66874b0 (bd2b7491-a8d0-40b4-90bb-617af66874b0): created successfully Aug 26 14:37:13 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-0e2064aa-6a08-4fa8-a84e-e4408808e44b tempest-ProjectReaderTests-226416731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d33c2d2-d32d-4e1a-8dc5-e6553949fbf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:37:14 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-0e2064aa-6a08-4fa8-a84e-e4408808e44b tempest-ProjectReaderTests-226416731 None] Flow 'volume_create_manager' (aa1fa788-379e-4bcb-a48c-ef046eb359de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:37:14 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-0e2064aa-6a08-4fa8-a84e-e4408808e44b tempest-ProjectReaderTests-226416731 None] Created volume successfully. Aug 26 14:37:14 devstack sudo[111402]: pam_unix(sudo:session): session closed for user root Aug 26 14:37:14 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-1a04ba3d-8521-4f28-89a4-461c50a619f4 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.331s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:37:14 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-1a04ba3d-8521-4f28-89a4-461c50a619f4 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:37:14 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-1a04ba3d-8521-4f28-89a4-461c50a619f4 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Deleted volume successfully. Aug 26 14:37:14 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-1a04ba3d-8521-4f28-89a4-461c50a619f4 tempest-CreateVolumesFromSourceVolumeTest-1323756590 None] Lock "cinder-9ea0380e-da02-4ee5-902c-ff3b55707d1b-delete_volume" released by "delete_volume" :: held 1.429s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:37:15 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-505c5144-cd2b-4c37-963c-77b1c6ecf6a4 tempest-ProjectReaderTests-226416731 None] Acquiring lock "cinder-bd2b7491-a8d0-40b4-90bb-617af66874b0-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:37:15 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-505c5144-cd2b-4c37-963c-77b1c6ecf6a4 tempest-ProjectReaderTests-226416731 None] Lock "cinder-bd2b7491-a8d0-40b4-90bb-617af66874b0-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:37:15 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-505c5144-cd2b-4c37-963c-77b1c6ecf6a4 tempest-ProjectReaderTests-226416731 None] Acquiring lock "cinder-quobyte-bd2b7491-a8d0-40b4-90bb-617af66874b0" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:37:15 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-505c5144-cd2b-4c37-963c-77b1c6ecf6a4 tempest-ProjectReaderTests-226416731 None] Lock "cinder-quobyte-bd2b7491-a8d0-40b4-90bb-617af66874b0" acquired by "delete_volume" :: waited 0.021s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:37:15 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[e47e67b5-2507-497f-877f-65dca210318b]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:37:15 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-505c5144-cd2b-4c37-963c-77b1c6ecf6a4 tempest-ProjectReaderTests-226416731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-bd2b7491-a8d0-40b4-90bb-617af66874b0 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:37:15 devstack sudo[111406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-bd2b7491-a8d0-40b4-90bb-617af66874b0 Aug 26 14:37:15 devstack sudo[111406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:37:15 devstack sudo[111406]: pam_unix(sudo:session): session closed for user root Aug 26 14:37:15 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-505c5144-cd2b-4c37-963c-77b1c6ecf6a4 tempest-ProjectReaderTests-226416731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-bd2b7491-a8d0-40b4-90bb-617af66874b0" returned: 0 in 0.408s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:37:15 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-505c5144-cd2b-4c37-963c-77b1c6ecf6a4 tempest-ProjectReaderTests-226416731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-bd2b7491-a8d0-40b4-90bb-617af66874b0 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:37:15 devstack sudo[111411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-bd2b7491-a8d0-40b4-90bb-617af66874b0 Aug 26 14:37:15 devstack sudo[111411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:37:15 devstack sudo[111411]: pam_unix(sudo:session): session closed for user root Aug 26 14:37:15 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-505c5144-cd2b-4c37-963c-77b1c6ecf6a4 tempest-ProjectReaderTests-226416731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-bd2b7491-a8d0-40b4-90bb-617af66874b0" returned: 0 in 0.278s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:37:15 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-505c5144-cd2b-4c37-963c-77b1c6ecf6a4 tempest-ProjectReaderTests-226416731 None] Lock "cinder-quobyte-bd2b7491-a8d0-40b4-90bb-617af66874b0" released by "delete_volume" :: held 0.733s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:37:15 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-505c5144-cd2b-4c37-963c-77b1c6ecf6a4 tempest-ProjectReaderTests-226416731 None] Created reservations ['eec9b6c0-c885-44eb-9bb7-872ebf128227', 'ee6f968b-5a14-4843-bd06-2f2387f0cf83', 'bc7d3281-274d-4b38-9409-5bce8ccfee9d', 'd197e187-91a6-40a4-be2d-c4db10f60c03'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:37:15 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-505c5144-cd2b-4c37-963c-77b1c6ecf6a4 tempest-ProjectReaderTests-226416731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:37:15 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-505c5144-cd2b-4c37-963c-77b1c6ecf6a4 tempest-ProjectReaderTests-226416731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:37:15 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-505c5144-cd2b-4c37-963c-77b1c6ecf6a4 tempest-ProjectReaderTests-226416731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:37:16 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-505c5144-cd2b-4c37-963c-77b1c6ecf6a4 tempest-ProjectReaderTests-226416731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:37:16 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-505c5144-cd2b-4c37-963c-77b1c6ecf6a4 tempest-ProjectReaderTests-226416731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:37:16 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-505c5144-cd2b-4c37-963c-77b1c6ecf6a4 tempest-ProjectReaderTests-226416731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:37:16 devstack sudo[111414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:37:16 devstack sudo[111414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:37:16 devstack sudo[111414]: pam_unix(sudo:session): session closed for user root Aug 26 14:37:16 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-505c5144-cd2b-4c37-963c-77b1c6ecf6a4 tempest-ProjectReaderTests-226416731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.311s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:37:16 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-505c5144-cd2b-4c37-963c-77b1c6ecf6a4 tempest-ProjectReaderTests-226416731 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:37:16 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-505c5144-cd2b-4c37-963c-77b1c6ecf6a4 tempest-ProjectReaderTests-226416731 None] Deleted volume successfully. Aug 26 14:37:16 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-505c5144-cd2b-4c37-963c-77b1c6ecf6a4 tempest-ProjectReaderTests-226416731 None] Lock "cinder-bd2b7491-a8d0-40b4-90bb-617af66874b0-delete_volume" released by "delete_volume" :: held 1.327s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:37:17 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-a808a0ec-639c-4da5-8e0c-3163c467755b tempest-VolumeDependencyTests-1203196349 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:37:17 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-a808a0ec-639c-4da5-8e0c-3163c467755b tempest-VolumeDependencyTests-1203196349 None] Flow 'volume_create_manager' (8322db80-5304-492e-a375-191ba457112b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:37:17 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-a808a0ec-639c-4da5-8e0c-3163c467755b tempest-VolumeDependencyTests-1203196349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e07ee7ea-fc97-46c8-a521-6fc8198125eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:37:17 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-a808a0ec-639c-4da5-8e0c-3163c467755b tempest-VolumeDependencyTests-1203196349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e07ee7ea-fc97-46c8-a521-6fc8198125eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:37:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-555171953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b7e3597-1e2e-42f9-83c8-1d4437341b0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df9b19b2f43943c4a0d5ae0deec9837b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:37:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:37:17Z,use_quota=True,user_id='fda9a86ede834d678dd12e8581c5292f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:37:17 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-a808a0ec-639c-4da5-8e0c-3163c467755b tempest-VolumeDependencyTests-1203196349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aad0ed3a-9fec-4245-8837-66452115b7fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:37:17 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-a808a0ec-639c-4da5-8e0c-3163c467755b tempest-VolumeDependencyTests-1203196349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aad0ed3a-9fec-4245-8837-66452115b7fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:37:17 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-a808a0ec-639c-4da5-8e0c-3163c467755b tempest-VolumeDependencyTests-1203196349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f51d8388-2ed4-4707-9827-7761848e44ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:37:17 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-a808a0ec-639c-4da5-8e0c-3163c467755b tempest-VolumeDependencyTests-1203196349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f51d8388-2ed4-4707-9827-7761848e44ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b7e3597-1e2e-42f9-83c8-1d4437341b0f', 'volume_name': 'volume-0b7e3597-1e2e-42f9-83c8-1d4437341b0f', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:37:17 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-a808a0ec-639c-4da5-8e0c-3163c467755b tempest-VolumeDependencyTests-1203196349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5164dd55-82bb-4551-a652-55ec2105c3cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:37:17 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-a808a0ec-639c-4da5-8e0c-3163c467755b tempest-VolumeDependencyTests-1203196349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5164dd55-82bb-4551-a652-55ec2105c3cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:37:17 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-a808a0ec-639c-4da5-8e0c-3163c467755b tempest-VolumeDependencyTests-1203196349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50cc1f03-273c-4da9-8464-f6c6ed74ce3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:37:17 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-a808a0ec-639c-4da5-8e0c-3163c467755b tempest-VolumeDependencyTests-1203196349 None] Volume 0b7e3597-1e2e-42f9-83c8-1d4437341b0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b7e3597-1e2e-42f9-83c8-1d4437341b0f', 'volume_size': 1} Aug 26 14:37:17 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-a808a0ec-639c-4da5-8e0c-3163c467755b tempest-VolumeDependencyTests-1203196349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:37:17 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-a808a0ec-639c-4da5-8e0c-3163c467755b tempest-VolumeDependencyTests-1203196349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:37:17 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-a808a0ec-639c-4da5-8e0c-3163c467755b tempest-VolumeDependencyTests-1203196349 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:37:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-555171953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b7e3597-1e2e-42f9-83c8-1d4437341b0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df9b19b2f43943c4a0d5ae0deec9837b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:37:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:37:17Z,use_quota=True,user_id='fda9a86ede834d678dd12e8581c5292f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:37:17 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-a808a0ec-639c-4da5-8e0c-3163c467755b tempest-VolumeDependencyTests-1203196349 None] Creating volume 0b7e3597-1e2e-42f9-83c8-1d4437341b0f {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:37:17 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-a808a0ec-639c-4da5-8e0c-3163c467755b tempest-VolumeDependencyTests-1203196349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:37:17 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-a808a0ec-639c-4da5-8e0c-3163c467755b tempest-VolumeDependencyTests-1203196349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:37:17 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-a808a0ec-639c-4da5-8e0c-3163c467755b tempest-VolumeDependencyTests-1203196349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:37:17 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-a808a0ec-639c-4da5-8e0c-3163c467755b tempest-VolumeDependencyTests-1203196349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:37:17 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-a808a0ec-639c-4da5-8e0c-3163c467755b tempest-VolumeDependencyTests-1203196349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:37:17 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-a808a0ec-639c-4da5-8e0c-3163c467755b tempest-VolumeDependencyTests-1203196349 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:37:17 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-a808a0ec-639c-4da5-8e0c-3163c467755b tempest-VolumeDependencyTests-1203196349 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:37:17 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-a808a0ec-639c-4da5-8e0c-3163c467755b tempest-VolumeDependencyTests-1203196349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0b7e3597-1e2e-42f9-83c8-1d4437341b0f 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:37:17 devstack sudo[111418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0b7e3597-1e2e-42f9-83c8-1d4437341b0f 1073741824 Aug 26 14:37:17 devstack sudo[111418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:37:17 devstack sudo[111418]: pam_unix(sudo:session): session closed for user root Aug 26 14:37:17 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-a808a0ec-639c-4da5-8e0c-3163c467755b tempest-VolumeDependencyTests-1203196349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0b7e3597-1e2e-42f9-83c8-1d4437341b0f 1073741824" returned: 0 in 0.572s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:37:17 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-a808a0ec-639c-4da5-8e0c-3163c467755b tempest-VolumeDependencyTests-1203196349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0b7e3597-1e2e-42f9-83c8-1d4437341b0f {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:37:17 devstack sudo[111425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0b7e3597-1e2e-42f9-83c8-1d4437341b0f Aug 26 14:37:17 devstack sudo[111425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:37:18 devstack sudo[111425]: pam_unix(sudo:session): session closed for user root Aug 26 14:37:18 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-a808a0ec-639c-4da5-8e0c-3163c467755b tempest-VolumeDependencyTests-1203196349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0b7e3597-1e2e-42f9-83c8-1d4437341b0f" returned: 0 in 0.343s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:37:18 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-a808a0ec-639c-4da5-8e0c-3163c467755b tempest-VolumeDependencyTests-1203196349 None] <== create_volume: return (970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:37:18 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-a808a0ec-639c-4da5-8e0c-3163c467755b tempest-VolumeDependencyTests-1203196349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:37:18 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-a808a0ec-639c-4da5-8e0c-3163c467755b tempest-VolumeDependencyTests-1203196349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50cc1f03-273c-4da9-8464-f6c6ed74ce3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b7e3597-1e2e-42f9-83c8-1d4437341b0f', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:37:18 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-a808a0ec-639c-4da5-8e0c-3163c467755b tempest-VolumeDependencyTests-1203196349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbef15b3-534d-4101-a2d0-13d1163d13e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:37:18 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-a808a0ec-639c-4da5-8e0c-3163c467755b tempest-VolumeDependencyTests-1203196349 None] Volume volume-0b7e3597-1e2e-42f9-83c8-1d4437341b0f (0b7e3597-1e2e-42f9-83c8-1d4437341b0f): created successfully Aug 26 14:37:18 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-a808a0ec-639c-4da5-8e0c-3163c467755b tempest-VolumeDependencyTests-1203196349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbef15b3-534d-4101-a2d0-13d1163d13e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:37:18 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-a808a0ec-639c-4da5-8e0c-3163c467755b tempest-VolumeDependencyTests-1203196349 None] Flow 'volume_create_manager' (8322db80-5304-492e-a375-191ba457112b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:37:18 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-a808a0ec-639c-4da5-8e0c-3163c467755b tempest-VolumeDependencyTests-1203196349 None] Created volume successfully. Aug 26 14:37:19 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-ebe3a856-aad2-4466-aad8-894dc2bc9301 tempest-VolumeDependencyTests-1203196349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:37:19 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-ebe3a856-aad2-4466-aad8-894dc2bc9301 tempest-VolumeDependencyTests-1203196349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:37:19 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-ebe3a856-aad2-4466-aad8-894dc2bc9301 tempest-VolumeDependencyTests-1203196349 None] Creating offline snapshot d35ce706-b909-4493-8219-0a53f83b350a of volume 0b7e3597-1e2e-42f9-83c8-1d4437341b0f {{(pid=94394) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 14:37:19 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9a6372a-014e-44c6-9eab-8fa80cfe9f36]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:37:19 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-ebe3a856-aad2-4466-aad8-894dc2bc9301 tempest-VolumeDependencyTests-1203196349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0b7e3597-1e2e-42f9-83c8-1d4437341b0f {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:37:19 devstack sudo[111430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0b7e3597-1e2e-42f9-83c8-1d4437341b0f Aug 26 14:37:19 devstack sudo[111430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:37:19 devstack sudo[111430]: pam_unix(sudo:session): session closed for user root Aug 26 14:37:19 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-ebe3a856-aad2-4466-aad8-894dc2bc9301 tempest-VolumeDependencyTests-1203196349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0b7e3597-1e2e-42f9-83c8-1d4437341b0f" returned: 0 in 0.408s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:37:19 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-ebe3a856-aad2-4466-aad8-894dc2bc9301 tempest-VolumeDependencyTests-1203196349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0b7e3597-1e2e-42f9-83c8-1d4437341b0f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0b7e3597-1e2e-42f9-83c8-1d4437341b0f.d35ce706-b909-4493-8219-0a53f83b350a 1G {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:37:19 devstack sudo[111436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0b7e3597-1e2e-42f9-83c8-1d4437341b0f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0b7e3597-1e2e-42f9-83c8-1d4437341b0f.d35ce706-b909-4493-8219-0a53f83b350a 1G Aug 26 14:37:19 devstack sudo[111436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:37:20 devstack sudo[111436]: pam_unix(sudo:session): session closed for user root Aug 26 14:37:20 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-ebe3a856-aad2-4466-aad8-894dc2bc9301 tempest-VolumeDependencyTests-1203196349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0b7e3597-1e2e-42f9-83c8-1d4437341b0f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0b7e3597-1e2e-42f9-83c8-1d4437341b0f.d35ce706-b909-4493-8219-0a53f83b350a 1G" returned: 0 in 0.514s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:37:20 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-ebe3a856-aad2-4466-aad8-894dc2bc9301 tempest-VolumeDependencyTests-1203196349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b7e3597-1e2e-42f9-83c8-1d4437341b0f -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0b7e3597-1e2e-42f9-83c8-1d4437341b0f.d35ce706-b909-4493-8219-0a53f83b350a {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:37:20 devstack sudo[111442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b7e3597-1e2e-42f9-83c8-1d4437341b0f -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0b7e3597-1e2e-42f9-83c8-1d4437341b0f.d35ce706-b909-4493-8219-0a53f83b350a Aug 26 14:37:20 devstack sudo[111442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:37:20 devstack sudo[111442]: pam_unix(sudo:session): session closed for user root Aug 26 14:37:20 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-ebe3a856-aad2-4466-aad8-894dc2bc9301 tempest-VolumeDependencyTests-1203196349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b7e3597-1e2e-42f9-83c8-1d4437341b0f -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0b7e3597-1e2e-42f9-83c8-1d4437341b0f.d35ce706-b909-4493-8219-0a53f83b350a" returned: 0 in 0.340s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:37:20 devstack cinder-volume[94394]: WARNING cinder.volume.drivers.remotefs [None req-ebe3a856-aad2-4466-aad8-894dc2bc9301 tempest-VolumeDependencyTests-1203196349 None] /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0b7e3597-1e2e-42f9-83c8-1d4437341b0f.d35ce706-b909-4493-8219-0a53f83b350a is being set with open permissions: ugo+rw Aug 26 14:37:20 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-ebe3a856-aad2-4466-aad8-894dc2bc9301 tempest-VolumeDependencyTests-1203196349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0b7e3597-1e2e-42f9-83c8-1d4437341b0f.d35ce706-b909-4493-8219-0a53f83b350a {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:37:20 devstack sudo[111447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0b7e3597-1e2e-42f9-83c8-1d4437341b0f.d35ce706-b909-4493-8219-0a53f83b350a Aug 26 14:37:20 devstack sudo[111447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:37:21 devstack sudo[111447]: pam_unix(sudo:session): session closed for user root Aug 26 14:37:21 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-ebe3a856-aad2-4466-aad8-894dc2bc9301 tempest-VolumeDependencyTests-1203196349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0b7e3597-1e2e-42f9-83c8-1d4437341b0f.d35ce706-b909-4493-8219-0a53f83b350a" returned: 0 in 0.284s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:37:21 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-ebe3a856-aad2-4466-aad8-894dc2bc9301 tempest-VolumeDependencyTests-1203196349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0b7e3597-1e2e-42f9-83c8-1d4437341b0f.info {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:37:21 devstack sudo[111450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0b7e3597-1e2e-42f9-83c8-1d4437341b0f.info Aug 26 14:37:21 devstack sudo[111450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:37:21 devstack sudo[111450]: pam_unix(sudo:session): session closed for user root Aug 26 14:37:21 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-ebe3a856-aad2-4466-aad8-894dc2bc9301 tempest-VolumeDependencyTests-1203196349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0b7e3597-1e2e-42f9-83c8-1d4437341b0f.info" returned: 0 in 0.272s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:37:21 devstack cinder-volume[94394]: WARNING cinder.volume.drivers.remotefs [None req-ebe3a856-aad2-4466-aad8-894dc2bc9301 tempest-VolumeDependencyTests-1203196349 None] /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0b7e3597-1e2e-42f9-83c8-1d4437341b0f.info is being set with open permissions: ugo+rw Aug 26 14:37:21 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-ebe3a856-aad2-4466-aad8-894dc2bc9301 tempest-VolumeDependencyTests-1203196349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0b7e3597-1e2e-42f9-83c8-1d4437341b0f.info {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:37:21 devstack sudo[111453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0b7e3597-1e2e-42f9-83c8-1d4437341b0f.info Aug 26 14:37:21 devstack sudo[111453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:37:21 devstack sudo[111453]: pam_unix(sudo:session): session closed for user root Aug 26 14:37:21 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-ebe3a856-aad2-4466-aad8-894dc2bc9301 tempest-VolumeDependencyTests-1203196349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0b7e3597-1e2e-42f9-83c8-1d4437341b0f.info" returned: 0 in 0.250s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:37:21 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-ebe3a856-aad2-4466-aad8-894dc2bc9301 tempest-VolumeDependencyTests-1203196349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.179s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:37:21 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-ebe3a856-aad2-4466-aad8-894dc2bc9301 tempest-VolumeDependencyTests-1203196349 None] Create snapshot completed successfully Aug 26 14:37:23 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5c1baf8-f55d-4c54-891f-ac821b47f5b6 tempest-VolumeDependencyTests-1203196349 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:37:23 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-f5c1baf8-f55d-4c54-891f-ac821b47f5b6 tempest-VolumeDependencyTests-1203196349 None] Flow 'volume_create_manager' (efa1f949-43e8-4675-8c8e-14d8d596802e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:37:23 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-f5c1baf8-f55d-4c54-891f-ac821b47f5b6 tempest-VolumeDependencyTests-1203196349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7388b68e-6ed5-494a-93a7-55aa77b71a8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:37:23 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-f5c1baf8-f55d-4c54-891f-ac821b47f5b6 tempest-VolumeDependencyTests-1203196349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7388b68e-6ed5-494a-93a7-55aa77b71a8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:37:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-844262016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26387912-2f85-4cf0-9874-2f90bb211dae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df9b19b2f43943c4a0d5ae0deec9837b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:37:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d35ce706-b909-4493-8219-0a53f83b350a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:37:23Z,use_quota=True,user_id='fda9a86ede834d678dd12e8581c5292f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:37:23 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-f5c1baf8-f55d-4c54-891f-ac821b47f5b6 tempest-VolumeDependencyTests-1203196349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2b4353d-d08f-48d8-943f-2aa9c56c5832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:37:23 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-f5c1baf8-f55d-4c54-891f-ac821b47f5b6 tempest-VolumeDependencyTests-1203196349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2b4353d-d08f-48d8-943f-2aa9c56c5832) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:37:23 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-f5c1baf8-f55d-4c54-891f-ac821b47f5b6 tempest-VolumeDependencyTests-1203196349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (080332c5-79b7-4813-9740-e95834dae9c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:37:23 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-f5c1baf8-f55d-4c54-891f-ac821b47f5b6 tempest-VolumeDependencyTests-1203196349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (080332c5-79b7-4813-9740-e95834dae9c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '26387912-2f85-4cf0-9874-2f90bb211dae', 'volume_name': 'volume-26387912-2f85-4cf0-9874-2f90bb211dae', 'volume_size': 1, 'snapshot_id': 'd35ce706-b909-4493-8219-0a53f83b350a'}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:37:23 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-f5c1baf8-f55d-4c54-891f-ac821b47f5b6 tempest-VolumeDependencyTests-1203196349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fda8a6e7-9157-4970-afcd-50de9b6e2433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:37:23 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-f5c1baf8-f55d-4c54-891f-ac821b47f5b6 tempest-VolumeDependencyTests-1203196349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fda8a6e7-9157-4970-afcd-50de9b6e2433) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:37:23 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-f5c1baf8-f55d-4c54-891f-ac821b47f5b6 tempest-VolumeDependencyTests-1203196349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4569bf35-6150-4a32-97ce-12d6ff11d5e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:37:23 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-f5c1baf8-f55d-4c54-891f-ac821b47f5b6 tempest-VolumeDependencyTests-1203196349 None] Volume 26387912-2f85-4cf0-9874-2f90bb211dae: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-26387912-2f85-4cf0-9874-2f90bb211dae', 'volume_size': 1, 'snapshot_id': 'd35ce706-b909-4493-8219-0a53f83b350a'} Aug 26 14:37:23 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-f5c1baf8-f55d-4c54-891f-ac821b47f5b6 tempest-VolumeDependencyTests-1203196349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:37:23 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-f5c1baf8-f55d-4c54-891f-ac821b47f5b6 tempest-VolumeDependencyTests-1203196349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:37:23 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-f5c1baf8-f55d-4c54-891f-ac821b47f5b6 tempest-VolumeDependencyTests-1203196349 None] Acquiring lock "cinder-quobyte-d35ce706-b909-4493-8219-0a53f83b350a-26387912-2f85-4cf0-9874-2f90bb211dae" by "_create_volume_from_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:37:23 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-f5c1baf8-f55d-4c54-891f-ac821b47f5b6 tempest-VolumeDependencyTests-1203196349 None] Lock "cinder-quobyte-d35ce706-b909-4493-8219-0a53f83b350a-26387912-2f85-4cf0-9874-2f90bb211dae" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:37:23 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-f5c1baf8-f55d-4c54-891f-ac821b47f5b6 tempest-VolumeDependencyTests-1203196349 None] Creating volume 26387912-2f85-4cf0-9874-2f90bb211dae from snapshot d35ce706-b909-4493-8219-0a53f83b350a {{(pid=94394) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Aug 26 14:37:23 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-f5c1baf8-f55d-4c54-891f-ac821b47f5b6 tempest-VolumeDependencyTests-1203196349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:37:23 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-f5c1baf8-f55d-4c54-891f-ac821b47f5b6 tempest-VolumeDependencyTests-1203196349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:37:23 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-f5c1baf8-f55d-4c54-891f-ac821b47f5b6 tempest-VolumeDependencyTests-1203196349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:37:23 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-f5c1baf8-f55d-4c54-891f-ac821b47f5b6 tempest-VolumeDependencyTests-1203196349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:37:23 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-f5c1baf8-f55d-4c54-891f-ac821b47f5b6 tempest-VolumeDependencyTests-1203196349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:37:23 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-f5c1baf8-f55d-4c54-891f-ac821b47f5b6 tempest-VolumeDependencyTests-1203196349 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:37:23 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-f5c1baf8-f55d-4c54-891f-ac821b47f5b6 tempest-VolumeDependencyTests-1203196349 None] Acquiring lock "cinder-quobyte-26387912-2f85-4cf0-9874-2f90bb211dae" by "_copy_volume_from_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:37:23 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-f5c1baf8-f55d-4c54-891f-ac821b47f5b6 tempest-VolumeDependencyTests-1203196349 None] Lock "cinder-quobyte-26387912-2f85-4cf0-9874-2f90bb211dae" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:37:23 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-f5c1baf8-f55d-4c54-891f-ac821b47f5b6 tempest-VolumeDependencyTests-1203196349 None] snapshot: d35ce706-b909-4493-8219-0a53f83b350a, volume: 26387912-2f85-4cf0-9874-2f90bb211dae, {{(pid=94394) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 26 14:37:23 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-f5c1baf8-f55d-4c54-891f-ac821b47f5b6 tempest-VolumeDependencyTests-1203196349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:37:23 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-f5c1baf8-f55d-4c54-891f-ac821b47f5b6 tempest-VolumeDependencyTests-1203196349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:37:23 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-f5c1baf8-f55d-4c54-891f-ac821b47f5b6 tempest-VolumeDependencyTests-1203196349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:37:23 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-f5c1baf8-f55d-4c54-891f-ac821b47f5b6 tempest-VolumeDependencyTests-1203196349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:37:23 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-f5c1baf8-f55d-4c54-891f-ac821b47f5b6 tempest-VolumeDependencyTests-1203196349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:37:23 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[de428660-f725-4103-b886-e122901aa5f3]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:37:23 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-f5c1baf8-f55d-4c54-891f-ac821b47f5b6 tempest-VolumeDependencyTests-1203196349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0b7e3597-1e2e-42f9-83c8-1d4437341b0f.d35ce706-b909-4493-8219-0a53f83b350a {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:37:23 devstack sudo[111457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0b7e3597-1e2e-42f9-83c8-1d4437341b0f.d35ce706-b909-4493-8219-0a53f83b350a Aug 26 14:37:23 devstack sudo[111457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:37:23 devstack sudo[111457]: pam_unix(sudo:session): session closed for user root Aug 26 14:37:23 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-f5c1baf8-f55d-4c54-891f-ac821b47f5b6 tempest-VolumeDependencyTests-1203196349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0b7e3597-1e2e-42f9-83c8-1d4437341b0f.d35ce706-b909-4493-8219-0a53f83b350a" returned: 0 in 0.378s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:37:23 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-f5c1baf8-f55d-4c54-891f-ac821b47f5b6 tempest-VolumeDependencyTests-1203196349 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0b7e3597-1e2e-42f9-83c8-1d4437341b0f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94394) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 14:37:23 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[c01a20f5-015a-4ec4-bcb7-8542a277603d]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:37:23 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-f5c1baf8-f55d-4c54-891f-ac821b47f5b6 tempest-VolumeDependencyTests-1203196349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0b7e3597-1e2e-42f9-83c8-1d4437341b0f {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:37:24 devstack sudo[111462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0b7e3597-1e2e-42f9-83c8-1d4437341b0f Aug 26 14:37:24 devstack sudo[111462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:37:24 devstack sudo[111462]: pam_unix(sudo:session): session closed for user root Aug 26 14:37:24 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-f5c1baf8-f55d-4c54-891f-ac821b47f5b6 tempest-VolumeDependencyTests-1203196349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0b7e3597-1e2e-42f9-83c8-1d4437341b0f" returned: 0 in 0.397s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:37:24 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-f5c1baf8-f55d-4c54-891f-ac821b47f5b6 tempest-VolumeDependencyTests-1203196349 None] will copy from snapshot at /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0b7e3597-1e2e-42f9-83c8-1d4437341b0f {{(pid=94394) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 26 14:37:24 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-f5c1baf8-f55d-4c54-891f-ac821b47f5b6 tempest-VolumeDependencyTests-1203196349 None] Creating direct copy from snapshot {{(pid=94394) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 26 14:37:24 devstack cinder-volume[94394]: DEBUG cinder.utils [None req-f5c1baf8-f55d-4c54-891f-ac821b47f5b6 tempest-VolumeDependencyTests-1203196349 None] Path /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-26387912-2f85-4cf0-9874-2f90bb211dae not found in is_blk_device check {{(pid=94394) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 26 14:37:24 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-f5c1baf8-f55d-4c54-891f-ac821b47f5b6 tempest-VolumeDependencyTests-1203196349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0b7e3597-1e2e-42f9-83c8-1d4437341b0f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-26387912-2f85-4cf0-9874-2f90bb211dae {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:37:24 devstack sudo[111467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0b7e3597-1e2e-42f9-83c8-1d4437341b0f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-26387912-2f85-4cf0-9874-2f90bb211dae Aug 26 14:37:24 devstack sudo[111467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:37:29 devstack sudo[111467]: pam_unix(sudo:session): session closed for user root Aug 26 14:37:29 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-f5c1baf8-f55d-4c54-891f-ac821b47f5b6 tempest-VolumeDependencyTests-1203196349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0b7e3597-1e2e-42f9-83c8-1d4437341b0f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-26387912-2f85-4cf0-9874-2f90bb211dae" returned: 0 in 4.831s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:37:29 devstack cinder-volume[94394]: DEBUG cinder.image.image_utils [None req-f5c1baf8-f55d-4c54-891f-ac821b47f5b6 tempest-VolumeDependencyTests-1203196349 None] Image conversion details: src /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0b7e3597-1e2e-42f9-83c8-1d4437341b0f, size 1024.00 MB, duration 4.83 sec, destination /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-26387912-2f85-4cf0-9874-2f90bb211dae {{(pid=94394) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 14:37:29 devstack cinder-volume[94394]: INFO cinder.image.image_utils [None req-f5c1baf8-f55d-4c54-891f-ac821b47f5b6 tempest-VolumeDependencyTests-1203196349 None] Converted 1024.00 MB image at 211.89 MB/s Aug 26 14:37:29 devstack cinder-volume[94394]: WARNING cinder.volume.drivers.remotefs [None req-f5c1baf8-f55d-4c54-891f-ac821b47f5b6 tempest-VolumeDependencyTests-1203196349 None] /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-26387912-2f85-4cf0-9874-2f90bb211dae is being set with open permissions: ugo+rw Aug 26 14:37:29 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-f5c1baf8-f55d-4c54-891f-ac821b47f5b6 tempest-VolumeDependencyTests-1203196349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-26387912-2f85-4cf0-9874-2f90bb211dae {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:37:29 devstack sudo[111480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-26387912-2f85-4cf0-9874-2f90bb211dae Aug 26 14:37:29 devstack sudo[111480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:37:29 devstack sudo[111480]: pam_unix(sudo:session): session closed for user root Aug 26 14:37:29 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-f5c1baf8-f55d-4c54-891f-ac821b47f5b6 tempest-VolumeDependencyTests-1203196349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-26387912-2f85-4cf0-9874-2f90bb211dae" returned: 0 in 0.247s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:37:29 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-f5c1baf8-f55d-4c54-891f-ac821b47f5b6 tempest-VolumeDependencyTests-1203196349 None] Lock "cinder-quobyte-26387912-2f85-4cf0-9874-2f90bb211dae" released by "_copy_volume_from_snapshot" :: held 5.950s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:37:29 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-f5c1baf8-f55d-4c54-891f-ac821b47f5b6 tempest-VolumeDependencyTests-1203196349 None] Lock "cinder-quobyte-d35ce706-b909-4493-8219-0a53f83b350a-26387912-2f85-4cf0-9874-2f90bb211dae" released by "_create_volume_from_snapshot" :: held 6.015s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:37:29 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-f5c1baf8-f55d-4c54-891f-ac821b47f5b6 tempest-VolumeDependencyTests-1203196349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.031s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:37:29 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-f5c1baf8-f55d-4c54-891f-ac821b47f5b6 tempest-VolumeDependencyTests-1203196349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4569bf35-6150-4a32-97ce-12d6ff11d5e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26387912-2f85-4cf0-9874-2f90bb211dae', 'volume_size': 1, 'snapshot_id': 'd35ce706-b909-4493-8219-0a53f83b350a'}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:37:29 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-f5c1baf8-f55d-4c54-891f-ac821b47f5b6 tempest-VolumeDependencyTests-1203196349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ba2962f-4f48-4584-9a19-e8d857aa7f29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:37:29 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-f5c1baf8-f55d-4c54-891f-ac821b47f5b6 tempest-VolumeDependencyTests-1203196349 None] Volume volume-26387912-2f85-4cf0-9874-2f90bb211dae (26387912-2f85-4cf0-9874-2f90bb211dae): created successfully Aug 26 14:37:29 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-f5c1baf8-f55d-4c54-891f-ac821b47f5b6 tempest-VolumeDependencyTests-1203196349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ba2962f-4f48-4584-9a19-e8d857aa7f29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:37:29 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-f5c1baf8-f55d-4c54-891f-ac821b47f5b6 tempest-VolumeDependencyTests-1203196349 None] Flow 'volume_create_manager' (efa1f949-43e8-4675-8c8e-14d8d596802e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:37:29 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-f5c1baf8-f55d-4c54-891f-ac821b47f5b6 tempest-VolumeDependencyTests-1203196349 None] Created volume successfully. Aug 26 14:37:29 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-3db9f317-d572-4a4c-9d12-116f097b064b tempest-VolumeDependencyTests-1203196349 None] Acquiring lock "cinder-d35ce706-b909-4493-8219-0a53f83b350a-delete_snapshot" by "delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:37:29 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-3db9f317-d572-4a4c-9d12-116f097b064b tempest-VolumeDependencyTests-1203196349 None] Lock "cinder-d35ce706-b909-4493-8219-0a53f83b350a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:37:29 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-3db9f317-d572-4a4c-9d12-116f097b064b tempest-VolumeDependencyTests-1203196349 None] Acquiring lock "cinder-quobyte-0b7e3597-1e2e-42f9-83c8-1d4437341b0f" by "delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:37:29 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-3db9f317-d572-4a4c-9d12-116f097b064b tempest-VolumeDependencyTests-1203196349 None] Lock "cinder-quobyte-0b7e3597-1e2e-42f9-83c8-1d4437341b0f" acquired by "delete_snapshot" :: waited 0.021s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:37:29 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-3db9f317-d572-4a4c-9d12-116f097b064b tempest-VolumeDependencyTests-1203196349 None] Acquiring lock "cinder-quobyte-d35ce706-b909-4493-8219-0a53f83b350a" by "_delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:37:29 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-3db9f317-d572-4a4c-9d12-116f097b064b tempest-VolumeDependencyTests-1203196349 None] Lock "cinder-quobyte-d35ce706-b909-4493-8219-0a53f83b350a" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:37:29 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-3db9f317-d572-4a4c-9d12-116f097b064b tempest-VolumeDependencyTests-1203196349 None] Deleting offline snapshot d35ce706-b909-4493-8219-0a53f83b350a of volume 0b7e3597-1e2e-42f9-83c8-1d4437341b0f {{(pid=94394) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 14:37:29 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-3db9f317-d572-4a4c-9d12-116f097b064b tempest-VolumeDependencyTests-1203196349 None] snapshot_file for this snap is: volume-0b7e3597-1e2e-42f9-83c8-1d4437341b0f.d35ce706-b909-4493-8219-0a53f83b350a {{(pid=94394) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 14:37:29 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b3aea65-51b8-4acd-ac09-7d5aab27cc34]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:37:29 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-3db9f317-d572-4a4c-9d12-116f097b064b tempest-VolumeDependencyTests-1203196349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0b7e3597-1e2e-42f9-83c8-1d4437341b0f.d35ce706-b909-4493-8219-0a53f83b350a {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:37:30 devstack sudo[111483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0b7e3597-1e2e-42f9-83c8-1d4437341b0f.d35ce706-b909-4493-8219-0a53f83b350a Aug 26 14:37:30 devstack sudo[111483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:37:30 devstack sudo[111483]: pam_unix(sudo:session): session closed for user root Aug 26 14:37:30 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-3db9f317-d572-4a4c-9d12-116f097b064b tempest-VolumeDependencyTests-1203196349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0b7e3597-1e2e-42f9-83c8-1d4437341b0f.d35ce706-b909-4493-8219-0a53f83b350a" returned: 0 in 0.357s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:37:30 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-3db9f317-d572-4a4c-9d12-116f097b064b tempest-VolumeDependencyTests-1203196349 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0b7e3597-1e2e-42f9-83c8-1d4437341b0f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94394) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 14:37:30 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e88d6d9-3f0e-474b-bcb2-52f870bb7798]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:37:30 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-3db9f317-d572-4a4c-9d12-116f097b064b tempest-VolumeDependencyTests-1203196349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0b7e3597-1e2e-42f9-83c8-1d4437341b0f {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:37:30 devstack sudo[111489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0b7e3597-1e2e-42f9-83c8-1d4437341b0f Aug 26 14:37:30 devstack sudo[111489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:37:30 devstack sudo[111489]: pam_unix(sudo:session): session closed for user root Aug 26 14:37:30 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-3db9f317-d572-4a4c-9d12-116f097b064b tempest-VolumeDependencyTests-1203196349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0b7e3597-1e2e-42f9-83c8-1d4437341b0f" returned: 0 in 0.587s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:37:30 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-3db9f317-d572-4a4c-9d12-116f097b064b tempest-VolumeDependencyTests-1203196349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0b7e3597-1e2e-42f9-83c8-1d4437341b0f.d35ce706-b909-4493-8219-0a53f83b350a {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:37:30 devstack sudo[111495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0b7e3597-1e2e-42f9-83c8-1d4437341b0f.d35ce706-b909-4493-8219-0a53f83b350a Aug 26 14:37:30 devstack sudo[111495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:37:31 devstack sudo[111495]: pam_unix(sudo:session): session closed for user root Aug 26 14:37:31 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-3db9f317-d572-4a4c-9d12-116f097b064b tempest-VolumeDependencyTests-1203196349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0b7e3597-1e2e-42f9-83c8-1d4437341b0f.d35ce706-b909-4493-8219-0a53f83b350a" returned: 0 in 0.409s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:37:31 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-3db9f317-d572-4a4c-9d12-116f097b064b tempest-VolumeDependencyTests-1203196349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0b7e3597-1e2e-42f9-83c8-1d4437341b0f.d35ce706-b909-4493-8219-0a53f83b350a {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:37:31 devstack sudo[111500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0b7e3597-1e2e-42f9-83c8-1d4437341b0f.d35ce706-b909-4493-8219-0a53f83b350a Aug 26 14:37:31 devstack sudo[111500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:37:31 devstack sudo[111500]: pam_unix(sudo:session): session closed for user root Aug 26 14:37:31 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-3db9f317-d572-4a4c-9d12-116f097b064b tempest-VolumeDependencyTests-1203196349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0b7e3597-1e2e-42f9-83c8-1d4437341b0f.d35ce706-b909-4493-8219-0a53f83b350a" returned: 0 in 0.299s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:37:31 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-3db9f317-d572-4a4c-9d12-116f097b064b tempest-VolumeDependencyTests-1203196349 None] Lock "cinder-quobyte-d35ce706-b909-4493-8219-0a53f83b350a" released by "_delete_snapshot" :: held 1.789s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:37:31 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-3db9f317-d572-4a4c-9d12-116f097b064b tempest-VolumeDependencyTests-1203196349 None] Lock "cinder-quobyte-0b7e3597-1e2e-42f9-83c8-1d4437341b0f" released by "delete_snapshot" :: held 1.823s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:37:31 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-3db9f317-d572-4a4c-9d12-116f097b064b tempest-VolumeDependencyTests-1203196349 None] Created reservations ['1037977c-c40b-44c4-bbfb-b394f1efe5dd', '833883be-4bf1-44ae-ae5f-b730c40aabf7', 'b714836f-9a1c-4979-97a0-b6f0448fba86', '69b4fc62-0a1f-486a-83ee-db7ebf230eed'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:37:31 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-3db9f317-d572-4a4c-9d12-116f097b064b tempest-VolumeDependencyTests-1203196349 None] Delete snapshot completed successfully. Aug 26 14:37:31 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-3db9f317-d572-4a4c-9d12-116f097b064b tempest-VolumeDependencyTests-1203196349 None] Lock "cinder-d35ce706-b909-4493-8219-0a53f83b350a-delete_snapshot" released by "delete_snapshot" :: held 2.049s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:37:32 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-1d3ddf7a-f65b-4c7d-9745-5b16bff5feee tempest-VolumeDependencyTests-1203196349 None] Acquiring lock "cinder-0b7e3597-1e2e-42f9-83c8-1d4437341b0f-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:37:32 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-1d3ddf7a-f65b-4c7d-9745-5b16bff5feee tempest-VolumeDependencyTests-1203196349 None] Lock "cinder-0b7e3597-1e2e-42f9-83c8-1d4437341b0f-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:37:32 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-1d3ddf7a-f65b-4c7d-9745-5b16bff5feee tempest-VolumeDependencyTests-1203196349 None] Acquiring lock "cinder-quobyte-0b7e3597-1e2e-42f9-83c8-1d4437341b0f" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:37:32 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-1d3ddf7a-f65b-4c7d-9745-5b16bff5feee tempest-VolumeDependencyTests-1203196349 None] Lock "cinder-quobyte-0b7e3597-1e2e-42f9-83c8-1d4437341b0f" acquired by "delete_volume" :: waited 0.022s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:37:32 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2d0d656-1b33-4335-aafb-58ab74ae2857]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:37:32 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-1d3ddf7a-f65b-4c7d-9745-5b16bff5feee tempest-VolumeDependencyTests-1203196349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0b7e3597-1e2e-42f9-83c8-1d4437341b0f {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:37:32 devstack sudo[111539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0b7e3597-1e2e-42f9-83c8-1d4437341b0f Aug 26 14:37:32 devstack sudo[111539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:37:32 devstack sudo[111539]: pam_unix(sudo:session): session closed for user root Aug 26 14:37:32 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-1d3ddf7a-f65b-4c7d-9745-5b16bff5feee tempest-VolumeDependencyTests-1203196349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0b7e3597-1e2e-42f9-83c8-1d4437341b0f" returned: 0 in 0.442s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:37:32 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-1d3ddf7a-f65b-4c7d-9745-5b16bff5feee tempest-VolumeDependencyTests-1203196349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0b7e3597-1e2e-42f9-83c8-1d4437341b0f {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:37:32 devstack sudo[111544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0b7e3597-1e2e-42f9-83c8-1d4437341b0f Aug 26 14:37:32 devstack sudo[111544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:37:32 devstack sudo[111544]: pam_unix(sudo:session): session closed for user root Aug 26 14:37:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-1d3ddf7a-f65b-4c7d-9745-5b16bff5feee tempest-VolumeDependencyTests-1203196349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0b7e3597-1e2e-42f9-83c8-1d4437341b0f" returned: 0 in 0.268s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:37:33 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-1d3ddf7a-f65b-4c7d-9745-5b16bff5feee tempest-VolumeDependencyTests-1203196349 None] Lock "cinder-quobyte-0b7e3597-1e2e-42f9-83c8-1d4437341b0f" released by "delete_volume" :: held 0.803s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:37:33 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-1d3ddf7a-f65b-4c7d-9745-5b16bff5feee tempest-VolumeDependencyTests-1203196349 None] Created reservations ['e14dc6d3-aab6-42d2-8027-1d1c199d0542', 'cd87060c-64f4-4755-b6e7-890543b17f07', 'c5772303-a146-4661-aeb5-d29513cc492f', '455d8dce-a5f0-4e98-97ef-17c01b3a1083'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:37:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-1d3ddf7a-f65b-4c7d-9745-5b16bff5feee tempest-VolumeDependencyTests-1203196349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:37:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-1d3ddf7a-f65b-4c7d-9745-5b16bff5feee tempest-VolumeDependencyTests-1203196349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:37:33 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-1d3ddf7a-f65b-4c7d-9745-5b16bff5feee tempest-VolumeDependencyTests-1203196349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:37:33 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-1d3ddf7a-f65b-4c7d-9745-5b16bff5feee tempest-VolumeDependencyTests-1203196349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:37:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-1d3ddf7a-f65b-4c7d-9745-5b16bff5feee tempest-VolumeDependencyTests-1203196349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:37:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-1d3ddf7a-f65b-4c7d-9745-5b16bff5feee tempest-VolumeDependencyTests-1203196349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:37:33 devstack sudo[111547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:37:33 devstack sudo[111547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:37:33 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-c2e372b7-e3a3-4f77-8513-e51d045e9744 tempest-VolumeDependencyTests-1203196349 None] Acquiring lock "cinder-26387912-2f85-4cf0-9874-2f90bb211dae-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:37:33 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-c2e372b7-e3a3-4f77-8513-e51d045e9744 tempest-VolumeDependencyTests-1203196349 None] Lock "cinder-26387912-2f85-4cf0-9874-2f90bb211dae-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:37:33 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-c2e372b7-e3a3-4f77-8513-e51d045e9744 tempest-VolumeDependencyTests-1203196349 None] Acquiring lock "cinder-quobyte-26387912-2f85-4cf0-9874-2f90bb211dae" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:37:33 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-c2e372b7-e3a3-4f77-8513-e51d045e9744 tempest-VolumeDependencyTests-1203196349 None] Lock "cinder-quobyte-26387912-2f85-4cf0-9874-2f90bb211dae" acquired by "delete_volume" :: waited 0.020s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:37:33 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[76ea4305-d5ff-445f-8cca-612b9bce09fb]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:37:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-c2e372b7-e3a3-4f77-8513-e51d045e9744 tempest-VolumeDependencyTests-1203196349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-26387912-2f85-4cf0-9874-2f90bb211dae {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:37:33 devstack sudo[111547]: pam_unix(sudo:session): session closed for user root Aug 26 14:37:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-1d3ddf7a-f65b-4c7d-9745-5b16bff5feee tempest-VolumeDependencyTests-1203196349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.279s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:37:33 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-1d3ddf7a-f65b-4c7d-9745-5b16bff5feee tempest-VolumeDependencyTests-1203196349 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:37:33 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-1d3ddf7a-f65b-4c7d-9745-5b16bff5feee tempest-VolumeDependencyTests-1203196349 None] Deleted volume successfully. Aug 26 14:37:33 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-1d3ddf7a-f65b-4c7d-9745-5b16bff5feee tempest-VolumeDependencyTests-1203196349 None] Lock "cinder-0b7e3597-1e2e-42f9-83c8-1d4437341b0f-delete_volume" released by "delete_volume" :: held 1.339s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:37:33 devstack sudo[111550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-26387912-2f85-4cf0-9874-2f90bb211dae Aug 26 14:37:33 devstack sudo[111550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:37:33 devstack cinder-volume[94394]: DEBUG oslo_service.periodic_task [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94394) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 14:37:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:37:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:37:33 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:37:33 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:37:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:37:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:37:33 devstack sudo[111552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:37:33 devstack sudo[111552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:37:33 devstack sudo[111550]: pam_unix(sudo:session): session closed for user root Aug 26 14:37:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-c2e372b7-e3a3-4f77-8513-e51d045e9744 tempest-VolumeDependencyTests-1203196349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-26387912-2f85-4cf0-9874-2f90bb211dae" returned: 0 in 0.398s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:37:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-c2e372b7-e3a3-4f77-8513-e51d045e9744 tempest-VolumeDependencyTests-1203196349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-26387912-2f85-4cf0-9874-2f90bb211dae {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:37:33 devstack sudo[111558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-26387912-2f85-4cf0-9874-2f90bb211dae Aug 26 14:37:33 devstack sudo[111558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:37:33 devstack sudo[111552]: pam_unix(sudo:session): session closed for user root Aug 26 14:37:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.274s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:37:33 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:37:33 devstack cinder-volume[94394]: DEBUG oslo_service.periodic_task [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Running periodic task VolumeManager._thread_info {{(pid=94394) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 14:37:33 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] thread count: 28 {{(pid=94394) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 14:37:33 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] thread info: [<_MainThread(MainThread, started 126600738033792)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94394) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 14:37:34 devstack sudo[111558]: pam_unix(sudo:session): session closed for user root Aug 26 14:37:34 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-c2e372b7-e3a3-4f77-8513-e51d045e9744 tempest-VolumeDependencyTests-1203196349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-26387912-2f85-4cf0-9874-2f90bb211dae" returned: 0 in 0.256s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:37:34 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-c2e372b7-e3a3-4f77-8513-e51d045e9744 tempest-VolumeDependencyTests-1203196349 None] Lock "cinder-quobyte-26387912-2f85-4cf0-9874-2f90bb211dae" released by "delete_volume" :: held 0.698s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:37:34 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-c2e372b7-e3a3-4f77-8513-e51d045e9744 tempest-VolumeDependencyTests-1203196349 None] Created reservations ['13434552-d036-492d-b94f-869c57dc969f', '7071317f-66b4-46c6-b893-d65cb18fa507', '871471c1-4ef5-4c72-b835-1b1cd910d258', '126f0389-b2bd-4397-a35c-e815bd4311c3'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:37:34 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-c2e372b7-e3a3-4f77-8513-e51d045e9744 tempest-VolumeDependencyTests-1203196349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:37:34 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-c2e372b7-e3a3-4f77-8513-e51d045e9744 tempest-VolumeDependencyTests-1203196349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:37:34 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-c2e372b7-e3a3-4f77-8513-e51d045e9744 tempest-VolumeDependencyTests-1203196349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:37:34 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-c2e372b7-e3a3-4f77-8513-e51d045e9744 tempest-VolumeDependencyTests-1203196349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:37:34 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-c2e372b7-e3a3-4f77-8513-e51d045e9744 tempest-VolumeDependencyTests-1203196349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:37:34 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-c2e372b7-e3a3-4f77-8513-e51d045e9744 tempest-VolumeDependencyTests-1203196349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:37:34 devstack sudo[111561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:37:34 devstack sudo[111561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:37:34 devstack sudo[111561]: pam_unix(sudo:session): session closed for user root Aug 26 14:37:34 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-c2e372b7-e3a3-4f77-8513-e51d045e9744 tempest-VolumeDependencyTests-1203196349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.276s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:37:34 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-c2e372b7-e3a3-4f77-8513-e51d045e9744 tempest-VolumeDependencyTests-1203196349 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:37:34 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-c2e372b7-e3a3-4f77-8513-e51d045e9744 tempest-VolumeDependencyTests-1203196349 None] Deleted volume successfully. Aug 26 14:37:34 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-c2e372b7-e3a3-4f77-8513-e51d045e9744 tempest-VolumeDependencyTests-1203196349 None] Lock "cinder-26387912-2f85-4cf0-9874-2f90bb211dae-delete_volume" released by "delete_volume" :: held 1.193s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:37:39 devstack cinder-volume[94394]: DEBUG dbcounter [-] [94394] Writing DB stats cinder:UPDATE=170,cinder:SELECT=128,cinder:INSERT=49,cinder:DELETE=20 {{(pid=94394) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 14:37:39 devstack cinder-volume[94394]: DEBUG dbcounter [-] [94394] Writing DB stats cinder:SELECT=131,cinder:UPDATE=174,cinder:INSERT=40,cinder:DELETE=10 {{(pid=94394) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 14:37:39 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-c04f0347-9749-40f4-bd96-21411a70ea49 tempest-VolumeImageDependencyTests-1696084519 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:37:39 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-c04f0347-9749-40f4-bd96-21411a70ea49 tempest-VolumeImageDependencyTests-1696084519 None] Flow 'volume_create_manager' (976d4a57-0735-444f-8eb4-80e15ba58cf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:37:39 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-c04f0347-9749-40f4-bd96-21411a70ea49 tempest-VolumeImageDependencyTests-1696084519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b03490c2-8056-4c4b-b80a-609c13126243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:37:39 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-c04f0347-9749-40f4-bd96-21411a70ea49 tempest-VolumeImageDependencyTests-1696084519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b03490c2-8056-4c4b-b80a-609c13126243) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:37:39Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef42f018-0400-4de2-b019-a0dcd275af5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc1109d076254a389a2b1237bc5cd1a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:37:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:37:39Z,use_quota=True,user_id='ed956adf551c45b0afd35c7ccad331e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:37:39 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-c04f0347-9749-40f4-bd96-21411a70ea49 tempest-VolumeImageDependencyTests-1696084519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86077833-cdcc-4eda-87d8-2d45fc31b353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:37:39 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-c04f0347-9749-40f4-bd96-21411a70ea49 tempest-VolumeImageDependencyTests-1696084519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86077833-cdcc-4eda-87d8-2d45fc31b353) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:37:39 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-c04f0347-9749-40f4-bd96-21411a70ea49 tempest-VolumeImageDependencyTests-1696084519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a131af3a-f286-4c3c-9913-1e7d586fab2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:37:39 devstack cinder-volume[94394]: DEBUG cinder.image.glance [None req-c04f0347-9749-40f4-bd96-21411a70ea49 tempest-VolumeImageDependencyTests-1696084519 None] Creating Keystone auth plugin from conf {{(pid=94394) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 26 14:37:39 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-c04f0347-9749-40f4-bd96-21411a70ea49 tempest-VolumeImageDependencyTests-1696084519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a131af3a-f286-4c3c-9913-1e7d586fab2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ef42f018-0400-4de2-b019-a0dcd275af5f', 'volume_name': 'volume-ef42f018-0400-4de2-b019-a0dcd275af5f', 'volume_size': 1, 'image_id': '1666dcfb-ad7b-41bf-b2c3-41390bf4df84', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1666dcfb-ad7b-41bf-b2c3-41390bf4df84', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '51dd94b88e226513fa41cc1ba7395525', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fc1109d076254a389a2b1237bc5cd1a1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7ec0df56e9d9d7dc8d323bde296e546bda4f02e407232e2e83586d5cbe3e6133138217afae5e42f2f9724c861c080e73c92d520b33f8bff9dab22437a5917166', 'id': '1666dcfb-ad7b-41bf-b2c3-41390bf4df84', 'created_at': datetime.datetime(2026, 8, 26, 12, 37, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 12, 37, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1666dcfb-ad7b-41bf-b2c3-41390bf4df84/file', 'properties': {}}, 'image_service': }' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:37:39 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-c04f0347-9749-40f4-bd96-21411a70ea49 tempest-VolumeImageDependencyTests-1696084519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5b56cdf-b0dc-4bbc-9710-bead267343d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:37:39 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-c04f0347-9749-40f4-bd96-21411a70ea49 tempest-VolumeImageDependencyTests-1696084519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5b56cdf-b0dc-4bbc-9710-bead267343d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:37:39 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-c04f0347-9749-40f4-bd96-21411a70ea49 tempest-VolumeImageDependencyTests-1696084519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e21c671-1d01-460a-a745-b7bc3a38121a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:37:39 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-c04f0347-9749-40f4-bd96-21411a70ea49 tempest-VolumeImageDependencyTests-1696084519 None] Volume ef42f018-0400-4de2-b019-a0dcd275af5f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ef42f018-0400-4de2-b019-a0dcd275af5f', 'volume_size': 1, 'image_id': '1666dcfb-ad7b-41bf-b2c3-41390bf4df84', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1666dcfb-ad7b-41bf-b2c3-41390bf4df84', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '51dd94b88e226513fa41cc1ba7395525', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fc1109d076254a389a2b1237bc5cd1a1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7ec0df56e9d9d7dc8d323bde296e546bda4f02e407232e2e83586d5cbe3e6133138217afae5e42f2f9724c861c080e73c92d520b33f8bff9dab22437a5917166', 'id': '1666dcfb-ad7b-41bf-b2c3-41390bf4df84', 'created_at': datetime.datetime(2026, 8, 26, 12, 37, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 12, 37, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1666dcfb-ad7b-41bf-b2c3-41390bf4df84/file', 'properties': {}}, 'image_service': } Aug 26 14:37:39 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-c04f0347-9749-40f4-bd96-21411a70ea49 tempest-VolumeImageDependencyTests-1696084519 None] Trying to clone ef42f018-0400-4de2-b019-a0dcd275af5f from image 1666dcfb-ad7b-41bf-b2c3-41390bf4df84 at location (None, [{'url': 'file:///opt/stack/data/glance/images/1666dcfb-ad7b-41bf-b2c3-41390bf4df84', 'metadata': {}}]). {{(pid=94394) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 26 14:37:39 devstack cinder-volume[94394]: DEBUG cinder.image.image_utils [None req-c04f0347-9749-40f4-bd96-21411a70ea49 tempest-VolumeImageDependencyTests-1696084519 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1666dcfb-ad7b-41bf-b2c3-41390bf4df84_6vtc07oddevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=94394) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 26 14:37:39 devstack cinder-volume[94394]: INFO cinder.image.image_utils [None req-c04f0347-9749-40f4-bd96-21411a70ea49 tempest-VolumeImageDependencyTests-1696084519 None] Image download 0.00 MB at 0.00 MB/s Aug 26 14:37:39 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[41227b91-da06-42d3-9912-f99af85763cc]: (4, 'raw') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:37:39 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-c04f0347-9749-40f4-bd96-21411a70ea49 tempest-VolumeImageDependencyTests-1696084519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1666dcfb-ad7b-41bf-b2c3-41390bf4df84_6vtc07oddevstack@QuobyteHD {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:37:39 devstack sudo[111564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1666dcfb-ad7b-41bf-b2c3-41390bf4df84_6vtc07oddevstack@QuobyteHD Aug 26 14:37:39 devstack sudo[111564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:37:40 devstack sudo[111564]: pam_unix(sudo:session): session closed for user root Aug 26 14:37:40 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-c04f0347-9749-40f4-bd96-21411a70ea49 tempest-VolumeImageDependencyTests-1696084519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1666dcfb-ad7b-41bf-b2c3-41390bf4df84_6vtc07oddevstack@QuobyteHD" returned: 0 in 0.329s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:37:40 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-c04f0347-9749-40f4-bd96-21411a70ea49 tempest-VolumeImageDependencyTests-1696084519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1666dcfb-ad7b-41bf-b2c3-41390bf4df84_6vtc07oddevstack@QuobyteHD {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:37:40 devstack sudo[111568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1666dcfb-ad7b-41bf-b2c3-41390bf4df84_6vtc07oddevstack@QuobyteHD Aug 26 14:37:40 devstack sudo[111568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:37:40 devstack sudo[111568]: pam_unix(sudo:session): session closed for user root Aug 26 14:37:40 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-c04f0347-9749-40f4-bd96-21411a70ea49 tempest-VolumeImageDependencyTests-1696084519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1666dcfb-ad7b-41bf-b2c3-41390bf4df84_6vtc07oddevstack@QuobyteHD" returned: 1 in 0.318s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:37:40 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-c04f0347-9749-40f4-bd96-21411a70ea49 tempest-VolumeImageDependencyTests-1696084519 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1666dcfb-ad7b-41bf-b2c3-41390bf4df84_6vtc07oddevstack@QuobyteHD' failed. Not Retrying. {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 14:37:40 devstack cinder-volume[94394]: DEBUG cinder.image.image_utils [None req-c04f0347-9749-40f4-bd96-21411a70ea49 tempest-VolumeImageDependencyTests-1696084519 None] Temporary image 1666dcfb-ad7b-41bf-b2c3-41390bf4df84 is fetched for user ed956adf551c45b0afd35c7ccad331e5. {{(pid=94394) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 26 14:37:40 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[40258b12-47a3-4776-b871-31514f493882]: (4, 'raw') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:37:40 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-c04f0347-9749-40f4-bd96-21411a70ea49 tempest-VolumeImageDependencyTests-1696084519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1666dcfb-ad7b-41bf-b2c3-41390bf4df84_6vtc07oddevstack@QuobyteHD {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:37:40 devstack sudo[111574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1666dcfb-ad7b-41bf-b2c3-41390bf4df84_6vtc07oddevstack@QuobyteHD Aug 26 14:37:40 devstack sudo[111574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:37:40 devstack sudo[111574]: pam_unix(sudo:session): session closed for user root Aug 26 14:37:40 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-c04f0347-9749-40f4-bd96-21411a70ea49 tempest-VolumeImageDependencyTests-1696084519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1666dcfb-ad7b-41bf-b2c3-41390bf4df84_6vtc07oddevstack@QuobyteHD" returned: 0 in 0.322s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:37:40 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-c04f0347-9749-40f4-bd96-21411a70ea49 tempest-VolumeImageDependencyTests-1696084519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1666dcfb-ad7b-41bf-b2c3-41390bf4df84_6vtc07oddevstack@QuobyteHD {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:37:40 devstack sudo[111578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1666dcfb-ad7b-41bf-b2c3-41390bf4df84_6vtc07oddevstack@QuobyteHD Aug 26 14:37:40 devstack sudo[111578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:37:41 devstack sudo[111578]: pam_unix(sudo:session): session closed for user root Aug 26 14:37:41 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-c04f0347-9749-40f4-bd96-21411a70ea49 tempest-VolumeImageDependencyTests-1696084519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1666dcfb-ad7b-41bf-b2c3-41390bf4df84_6vtc07oddevstack@QuobyteHD" returned: 1 in 0.326s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:37:41 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-c04f0347-9749-40f4-bd96-21411a70ea49 tempest-VolumeImageDependencyTests-1696084519 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1666dcfb-ad7b-41bf-b2c3-41390bf4df84_6vtc07oddevstack@QuobyteHD' failed. Not Retrying. {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 14:37:41 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-c04f0347-9749-40f4-bd96-21411a70ea49 tempest-VolumeImageDependencyTests-1696084519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:37:41 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-c04f0347-9749-40f4-bd96-21411a70ea49 tempest-VolumeImageDependencyTests-1696084519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:37:41 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-c04f0347-9749-40f4-bd96-21411a70ea49 tempest-VolumeImageDependencyTests-1696084519 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:37:39Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef42f018-0400-4de2-b019-a0dcd275af5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc1109d076254a389a2b1237bc5cd1a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:37:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:37:39Z,use_quota=True,user_id='ed956adf551c45b0afd35c7ccad331e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:37:41 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-c04f0347-9749-40f4-bd96-21411a70ea49 tempest-VolumeImageDependencyTests-1696084519 None] Creating volume ef42f018-0400-4de2-b019-a0dcd275af5f {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:37:41 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-c04f0347-9749-40f4-bd96-21411a70ea49 tempest-VolumeImageDependencyTests-1696084519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:37:41 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-c04f0347-9749-40f4-bd96-21411a70ea49 tempest-VolumeImageDependencyTests-1696084519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:37:41 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-c04f0347-9749-40f4-bd96-21411a70ea49 tempest-VolumeImageDependencyTests-1696084519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:37:41 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-c04f0347-9749-40f4-bd96-21411a70ea49 tempest-VolumeImageDependencyTests-1696084519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:37:41 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-c04f0347-9749-40f4-bd96-21411a70ea49 tempest-VolumeImageDependencyTests-1696084519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:37:41 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-c04f0347-9749-40f4-bd96-21411a70ea49 tempest-VolumeImageDependencyTests-1696084519 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:37:41 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-c04f0347-9749-40f4-bd96-21411a70ea49 tempest-VolumeImageDependencyTests-1696084519 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:37:41 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-c04f0347-9749-40f4-bd96-21411a70ea49 tempest-VolumeImageDependencyTests-1696084519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ef42f018-0400-4de2-b019-a0dcd275af5f 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:37:41 devstack sudo[111583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ef42f018-0400-4de2-b019-a0dcd275af5f 1073741824 Aug 26 14:37:41 devstack sudo[111583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:37:41 devstack sudo[111583]: pam_unix(sudo:session): session closed for user root Aug 26 14:37:41 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-c04f0347-9749-40f4-bd96-21411a70ea49 tempest-VolumeImageDependencyTests-1696084519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ef42f018-0400-4de2-b019-a0dcd275af5f 1073741824" returned: 0 in 0.391s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:37:41 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-c04f0347-9749-40f4-bd96-21411a70ea49 tempest-VolumeImageDependencyTests-1696084519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ef42f018-0400-4de2-b019-a0dcd275af5f {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:37:41 devstack sudo[111588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ef42f018-0400-4de2-b019-a0dcd275af5f Aug 26 14:37:41 devstack sudo[111588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:37:41 devstack sudo[111588]: pam_unix(sudo:session): session closed for user root Aug 26 14:37:41 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-c04f0347-9749-40f4-bd96-21411a70ea49 tempest-VolumeImageDependencyTests-1696084519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ef42f018-0400-4de2-b019-a0dcd275af5f" returned: 0 in 0.236s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:37:41 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-c04f0347-9749-40f4-bd96-21411a70ea49 tempest-VolumeImageDependencyTests-1696084519 None] <== create_volume: return (666ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:37:41 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-c04f0347-9749-40f4-bd96-21411a70ea49 tempest-VolumeImageDependencyTests-1696084519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.669s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:37:41 devstack cinder-volume[94394]: DEBUG cinder.volume.volume_utils [None req-c04f0347-9749-40f4-bd96-21411a70ea49 tempest-VolumeImageDependencyTests-1696084519 None] Attempting download of 1666dcfb-ad7b-41bf-b2c3-41390bf4df84 ((None, [{'url': 'file:///opt/stack/data/glance/images/1666dcfb-ad7b-41bf-b2c3-41390bf4df84', 'metadata': {}}])) to volume ef42f018-0400-4de2-b019-a0dcd275af5f. {{(pid=94394) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 26 14:37:41 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[73491816-f7ab-4013-8e53-cb63b924d948]: (4, 'raw') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:37:41 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-c04f0347-9749-40f4-bd96-21411a70ea49 tempest-VolumeImageDependencyTests-1696084519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1666dcfb-ad7b-41bf-b2c3-41390bf4df84_oirzeaze {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:37:41 devstack sudo[111591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1666dcfb-ad7b-41bf-b2c3-41390bf4df84_oirzeaze Aug 26 14:37:41 devstack sudo[111591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:37:42 devstack sudo[111591]: pam_unix(sudo:session): session closed for user root Aug 26 14:37:42 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-c04f0347-9749-40f4-bd96-21411a70ea49 tempest-VolumeImageDependencyTests-1696084519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1666dcfb-ad7b-41bf-b2c3-41390bf4df84_oirzeaze" returned: 0 in 0.325s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:37:42 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-c04f0347-9749-40f4-bd96-21411a70ea49 tempest-VolumeImageDependencyTests-1696084519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1666dcfb-ad7b-41bf-b2c3-41390bf4df84_oirzeaze {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:37:42 devstack sudo[111598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1666dcfb-ad7b-41bf-b2c3-41390bf4df84_oirzeaze Aug 26 14:37:42 devstack sudo[111598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:37:42 devstack sudo[111598]: pam_unix(sudo:session): session closed for user root Aug 26 14:37:42 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-c04f0347-9749-40f4-bd96-21411a70ea49 tempest-VolumeImageDependencyTests-1696084519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1666dcfb-ad7b-41bf-b2c3-41390bf4df84_oirzeaze" returned: 1 in 0.318s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:37:42 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-c04f0347-9749-40f4-bd96-21411a70ea49 tempest-VolumeImageDependencyTests-1696084519 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1666dcfb-ad7b-41bf-b2c3-41390bf4df84_oirzeaze' failed. Not Retrying. {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 14:37:42 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2997a7d-48fd-4949-8939-6615349fd3d8]: (4, 'raw') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:37:42 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-c04f0347-9749-40f4-bd96-21411a70ea49 tempest-VolumeImageDependencyTests-1696084519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1666dcfb-ad7b-41bf-b2c3-41390bf4df84_6vtc07oddevstack@QuobyteHD {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:37:42 devstack sudo[111605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1666dcfb-ad7b-41bf-b2c3-41390bf4df84_6vtc07oddevstack@QuobyteHD Aug 26 14:37:42 devstack sudo[111605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:37:42 devstack sudo[111605]: pam_unix(sudo:session): session closed for user root Aug 26 14:37:42 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-c04f0347-9749-40f4-bd96-21411a70ea49 tempest-VolumeImageDependencyTests-1696084519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1666dcfb-ad7b-41bf-b2c3-41390bf4df84_6vtc07oddevstack@QuobyteHD" returned: 0 in 0.320s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:37:42 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-c04f0347-9749-40f4-bd96-21411a70ea49 tempest-VolumeImageDependencyTests-1696084519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1666dcfb-ad7b-41bf-b2c3-41390bf4df84_6vtc07oddevstack@QuobyteHD {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:37:42 devstack sudo[111609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1666dcfb-ad7b-41bf-b2c3-41390bf4df84_6vtc07oddevstack@QuobyteHD Aug 26 14:37:42 devstack sudo[111609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:37:43 devstack sudo[111609]: pam_unix(sudo:session): session closed for user root Aug 26 14:37:43 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-c04f0347-9749-40f4-bd96-21411a70ea49 tempest-VolumeImageDependencyTests-1696084519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1666dcfb-ad7b-41bf-b2c3-41390bf4df84_6vtc07oddevstack@QuobyteHD" returned: 1 in 0.321s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:37:43 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-c04f0347-9749-40f4-bd96-21411a70ea49 tempest-VolumeImageDependencyTests-1696084519 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1666dcfb-ad7b-41bf-b2c3-41390bf4df84_6vtc07oddevstack@QuobyteHD' failed. Not Retrying. {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 14:37:43 devstack cinder-volume[94394]: DEBUG cinder.image.image_utils [None req-c04f0347-9749-40f4-bd96-21411a70ea49 tempest-VolumeImageDependencyTests-1696084519 None] 1666dcfb-ad7b-41bf-b2c3-41390bf4df84 was raw, converting to qcow2 {{(pid=94394) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 26 14:37:43 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-c04f0347-9749-40f4-bd96-21411a70ea49 tempest-VolumeImageDependencyTests-1696084519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1666dcfb-ad7b-41bf-b2c3-41390bf4df84_6vtc07oddevstack@QuobyteHD /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ef42f018-0400-4de2-b019-a0dcd275af5f {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:37:43 devstack sudo[111614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1666dcfb-ad7b-41bf-b2c3-41390bf4df84_6vtc07oddevstack@QuobyteHD /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ef42f018-0400-4de2-b019-a0dcd275af5f Aug 26 14:37:43 devstack sudo[111614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:37:43 devstack sudo[111614]: pam_unix(sudo:session): session closed for user root Aug 26 14:37:43 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-c04f0347-9749-40f4-bd96-21411a70ea49 tempest-VolumeImageDependencyTests-1696084519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1666dcfb-ad7b-41bf-b2c3-41390bf4df84_6vtc07oddevstack@QuobyteHD /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ef42f018-0400-4de2-b019-a0dcd275af5f" returned: 0 in 0.464s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:37:43 devstack cinder-volume[94394]: DEBUG cinder.image.image_utils [None req-c04f0347-9749-40f4-bd96-21411a70ea49 tempest-VolumeImageDependencyTests-1696084519 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1666dcfb-ad7b-41bf-b2c3-41390bf4df84_6vtc07oddevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ef42f018-0400-4de2-b019-a0dcd275af5f {{(pid=94394) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 14:37:43 devstack cinder-volume[94394]: INFO cinder.image.image_utils [None req-c04f0347-9749-40f4-bd96-21411a70ea49 tempest-VolumeImageDependencyTests-1696084519 None] Converted 0.00 MB image at 0.00 MB/s Aug 26 14:37:43 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-c04f0347-9749-40f4-bd96-21411a70ea49 tempest-VolumeImageDependencyTests-1696084519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ef42f018-0400-4de2-b019-a0dcd275af5f 1G {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:37:43 devstack sudo[111628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ef42f018-0400-4de2-b019-a0dcd275af5f 1G Aug 26 14:37:43 devstack sudo[111628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:37:43 devstack sudo[111628]: pam_unix(sudo:session): session closed for user root Aug 26 14:37:43 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-c04f0347-9749-40f4-bd96-21411a70ea49 tempest-VolumeImageDependencyTests-1696084519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ef42f018-0400-4de2-b019-a0dcd275af5f 1G" returned: 0 in 0.323s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:37:43 devstack cinder-volume[94394]: DEBUG cinder.volume.volume_utils [None req-c04f0347-9749-40f4-bd96-21411a70ea49 tempest-VolumeImageDependencyTests-1696084519 None] Downloaded image 1666dcfb-ad7b-41bf-b2c3-41390bf4df84 ((None, [{'url': 'file:///opt/stack/data/glance/images/1666dcfb-ad7b-41bf-b2c3-41390bf4df84', 'metadata': {}}])) to volume ef42f018-0400-4de2-b019-a0dcd275af5f successfully. {{(pid=94394) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 26 14:37:43 devstack cinder-volume[94394]: DEBUG cinder.image.image_utils [None req-c04f0347-9749-40f4-bd96-21411a70ea49 tempest-VolumeImageDependencyTests-1696084519 None] Temporary image 1666dcfb-ad7b-41bf-b2c3-41390bf4df84 for user ed956adf551c45b0afd35c7ccad331e5 is deleted. {{(pid=94394) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 26 14:37:43 devstack cinder-volume[94394]: DEBUG cinder.volume.volume_utils [None req-c04f0347-9749-40f4-bd96-21411a70ea49 tempest-VolumeImageDependencyTests-1696084519 None] Marking volume ef42f018-0400-4de2-b019-a0dcd275af5f as bootable. {{(pid=94394) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 26 14:37:43 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-c04f0347-9749-40f4-bd96-21411a70ea49 tempest-VolumeImageDependencyTests-1696084519 None] Copying metadata from image 1666dcfb-ad7b-41bf-b2c3-41390bf4df84 to ef42f018-0400-4de2-b019-a0dcd275af5f. {{(pid=94394) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 26 14:37:43 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-c04f0347-9749-40f4-bd96-21411a70ea49 tempest-VolumeImageDependencyTests-1696084519 None] Creating volume glance metadata for volume ef42f018-0400-4de2-b019-a0dcd275af5f backed by image 1666dcfb-ad7b-41bf-b2c3-41390bf4df84 with: {'image_id': '1666dcfb-ad7b-41bf-b2c3-41390bf4df84', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '51dd94b88e226513fa41cc1ba7395525', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=94394) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 26 14:37:44 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-c04f0347-9749-40f4-bd96-21411a70ea49 tempest-VolumeImageDependencyTests-1696084519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e21c671-1d01-460a-a745-b7bc3a38121a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef42f018-0400-4de2-b019-a0dcd275af5f', 'volume_size': 1, 'image_id': '1666dcfb-ad7b-41bf-b2c3-41390bf4df84', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1666dcfb-ad7b-41bf-b2c3-41390bf4df84', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '51dd94b88e226513fa41cc1ba7395525', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fc1109d076254a389a2b1237bc5cd1a1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7ec0df56e9d9d7dc8d323bde296e546bda4f02e407232e2e83586d5cbe3e6133138217afae5e42f2f9724c861c080e73c92d520b33f8bff9dab22437a5917166', 'id': '1666dcfb-ad7b-41bf-b2c3-41390bf4df84', 'created_at': datetime.datetime(2026, 8, 26, 12, 37, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 12, 37, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1666dcfb-ad7b-41bf-b2c3-41390bf4df84/file', 'properties': {}}, 'image_service': }' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:37:44 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-c04f0347-9749-40f4-bd96-21411a70ea49 tempest-VolumeImageDependencyTests-1696084519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78810485-4f0e-47a2-9c3d-455f9d876fce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:37:44 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-c04f0347-9749-40f4-bd96-21411a70ea49 tempest-VolumeImageDependencyTests-1696084519 None] Volume volume-ef42f018-0400-4de2-b019-a0dcd275af5f (ef42f018-0400-4de2-b019-a0dcd275af5f): created successfully Aug 26 14:37:44 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-c04f0347-9749-40f4-bd96-21411a70ea49 tempest-VolumeImageDependencyTests-1696084519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78810485-4f0e-47a2-9c3d-455f9d876fce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:37:44 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-c04f0347-9749-40f4-bd96-21411a70ea49 tempest-VolumeImageDependencyTests-1696084519 None] Flow 'volume_create_manager' (976d4a57-0735-444f-8eb4-80e15ba58cf5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:37:44 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-c04f0347-9749-40f4-bd96-21411a70ea49 tempest-VolumeImageDependencyTests-1696084519 None] Created volume successfully. Aug 26 14:37:44 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-0ebbfd10-ec43-4a6c-8495-eed424d07bc6 tempest-VolumeImageDependencyTests-1696084519 None] Acquiring lock "cinder-ef42f018-0400-4de2-b019-a0dcd275af5f-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:37:44 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-0ebbfd10-ec43-4a6c-8495-eed424d07bc6 tempest-VolumeImageDependencyTests-1696084519 None] Lock "cinder-ef42f018-0400-4de2-b019-a0dcd275af5f-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:37:44 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-0ebbfd10-ec43-4a6c-8495-eed424d07bc6 tempest-VolumeImageDependencyTests-1696084519 None] Acquiring lock "cinder-quobyte-ef42f018-0400-4de2-b019-a0dcd275af5f" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:37:44 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-0ebbfd10-ec43-4a6c-8495-eed424d07bc6 tempest-VolumeImageDependencyTests-1696084519 None] Lock "cinder-quobyte-ef42f018-0400-4de2-b019-a0dcd275af5f" acquired by "delete_volume" :: waited 0.020s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:37:45 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[49ba4507-a86b-4b26-ae02-966be94a79cb]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:37:45 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-0ebbfd10-ec43-4a6c-8495-eed424d07bc6 tempest-VolumeImageDependencyTests-1696084519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ef42f018-0400-4de2-b019-a0dcd275af5f {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:37:45 devstack sudo[111634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ef42f018-0400-4de2-b019-a0dcd275af5f Aug 26 14:37:45 devstack sudo[111634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:37:45 devstack sudo[111634]: pam_unix(sudo:session): session closed for user root Aug 26 14:37:45 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-0ebbfd10-ec43-4a6c-8495-eed424d07bc6 tempest-VolumeImageDependencyTests-1696084519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ef42f018-0400-4de2-b019-a0dcd275af5f" returned: 0 in 0.348s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:37:45 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-0ebbfd10-ec43-4a6c-8495-eed424d07bc6 tempest-VolumeImageDependencyTests-1696084519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ef42f018-0400-4de2-b019-a0dcd275af5f {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:37:45 devstack sudo[111639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ef42f018-0400-4de2-b019-a0dcd275af5f Aug 26 14:37:45 devstack sudo[111639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:37:45 devstack sudo[111639]: pam_unix(sudo:session): session closed for user root Aug 26 14:37:45 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-0ebbfd10-ec43-4a6c-8495-eed424d07bc6 tempest-VolumeImageDependencyTests-1696084519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ef42f018-0400-4de2-b019-a0dcd275af5f" returned: 0 in 0.238s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:37:45 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-0ebbfd10-ec43-4a6c-8495-eed424d07bc6 tempest-VolumeImageDependencyTests-1696084519 None] Lock "cinder-quobyte-ef42f018-0400-4de2-b019-a0dcd275af5f" released by "delete_volume" :: held 0.641s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:37:45 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-0ebbfd10-ec43-4a6c-8495-eed424d07bc6 tempest-VolumeImageDependencyTests-1696084519 None] Created reservations ['b54cf5aa-56f4-4b43-807a-36133639f774', 'feb6a54b-7924-4174-8ea3-35c5341de566', 'f67c8cd0-716b-4c1c-bc71-0fd949f9f13b', 'd8c452c7-1252-42d1-acda-d687459e7f9b'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:37:45 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-0ebbfd10-ec43-4a6c-8495-eed424d07bc6 tempest-VolumeImageDependencyTests-1696084519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:37:45 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-0ebbfd10-ec43-4a6c-8495-eed424d07bc6 tempest-VolumeImageDependencyTests-1696084519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:37:45 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-0ebbfd10-ec43-4a6c-8495-eed424d07bc6 tempest-VolumeImageDependencyTests-1696084519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:37:45 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-0ebbfd10-ec43-4a6c-8495-eed424d07bc6 tempest-VolumeImageDependencyTests-1696084519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:37:45 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-0ebbfd10-ec43-4a6c-8495-eed424d07bc6 tempest-VolumeImageDependencyTests-1696084519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:37:45 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-0ebbfd10-ec43-4a6c-8495-eed424d07bc6 tempest-VolumeImageDependencyTests-1696084519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:37:45 devstack sudo[111642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:37:45 devstack sudo[111642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:37:45 devstack sudo[111642]: pam_unix(sudo:session): session closed for user root Aug 26 14:37:45 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-0ebbfd10-ec43-4a6c-8495-eed424d07bc6 tempest-VolumeImageDependencyTests-1696084519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.242s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:37:45 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-0ebbfd10-ec43-4a6c-8495-eed424d07bc6 tempest-VolumeImageDependencyTests-1696084519 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:37:45 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-0ebbfd10-ec43-4a6c-8495-eed424d07bc6 tempest-VolumeImageDependencyTests-1696084519 None] Deleted volume successfully. Aug 26 14:37:46 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-0ebbfd10-ec43-4a6c-8495-eed424d07bc6 tempest-VolumeImageDependencyTests-1696084519 None] Lock "cinder-ef42f018-0400-4de2-b019-a0dcd275af5f-delete_volume" released by "delete_volume" :: held 1.102s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:37:49 devstack cinder-volume[94394]: INFO cinder.volume.manager [req-e93dedd9-4ad4-4b1f-bd18-f7f84d5f3155 req-de12eeca-2712-48ff-96b5-c7f048d81e47 tempest-TestMinimumBasicScenario-1164867133 None] Terminate volume connection completed successfully. Aug 26 14:37:49 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [req-e93dedd9-4ad4-4b1f-bd18-f7f84d5f3155 req-de12eeca-2712-48ff-96b5-c7f048d81e47 tempest-TestMinimumBasicScenario-1164867133 None] Deleting attachment 865b58fc-3b31-4658-ab58-bbacd7b30fdd. {{(pid=94394) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 14:37:50 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-0fa5e92a-3d61-49ad-b513-6754eb888e40 tempest-TestMinimumBasicScenario-1164867133 None] Acquiring lock "cinder-148d0d07-61ca-4b8e-aae6-adb03371fe4d-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:37:50 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-0fa5e92a-3d61-49ad-b513-6754eb888e40 tempest-TestMinimumBasicScenario-1164867133 None] Lock "cinder-148d0d07-61ca-4b8e-aae6-adb03371fe4d-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:37:50 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-0fa5e92a-3d61-49ad-b513-6754eb888e40 tempest-TestMinimumBasicScenario-1164867133 None] Acquiring lock "cinder-quobyte-148d0d07-61ca-4b8e-aae6-adb03371fe4d" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:37:50 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-0fa5e92a-3d61-49ad-b513-6754eb888e40 tempest-TestMinimumBasicScenario-1164867133 None] Lock "cinder-quobyte-148d0d07-61ca-4b8e-aae6-adb03371fe4d" acquired by "delete_volume" :: waited 0.017s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:37:50 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe6cdfcc-cc3a-41ba-b9d2-3cd191f1922a]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:37:50 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-0fa5e92a-3d61-49ad-b513-6754eb888e40 tempest-TestMinimumBasicScenario-1164867133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-148d0d07-61ca-4b8e-aae6-adb03371fe4d {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:37:50 devstack sudo[111659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-148d0d07-61ca-4b8e-aae6-adb03371fe4d Aug 26 14:37:50 devstack sudo[111659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:37:51 devstack sudo[111659]: pam_unix(sudo:session): session closed for user root Aug 26 14:37:51 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-0fa5e92a-3d61-49ad-b513-6754eb888e40 tempest-TestMinimumBasicScenario-1164867133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-148d0d07-61ca-4b8e-aae6-adb03371fe4d" returned: 0 in 0.357s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:37:51 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-0fa5e92a-3d61-49ad-b513-6754eb888e40 tempest-TestMinimumBasicScenario-1164867133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-148d0d07-61ca-4b8e-aae6-adb03371fe4d {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:37:51 devstack sudo[111664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-148d0d07-61ca-4b8e-aae6-adb03371fe4d Aug 26 14:37:51 devstack sudo[111664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:37:51 devstack sudo[111664]: pam_unix(sudo:session): session closed for user root Aug 26 14:37:51 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-0fa5e92a-3d61-49ad-b513-6754eb888e40 tempest-TestMinimumBasicScenario-1164867133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-148d0d07-61ca-4b8e-aae6-adb03371fe4d" returned: 0 in 0.236s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:37:51 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-0fa5e92a-3d61-49ad-b513-6754eb888e40 tempest-TestMinimumBasicScenario-1164867133 None] Lock "cinder-quobyte-148d0d07-61ca-4b8e-aae6-adb03371fe4d" released by "delete_volume" :: held 0.629s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:37:51 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-0fa5e92a-3d61-49ad-b513-6754eb888e40 tempest-TestMinimumBasicScenario-1164867133 None] Created reservations ['0986508c-e47f-49d5-88c5-07ea1b2552d3', 'a675c4a0-a370-4f52-bb15-811479ba6bb6', 'cbc9adf1-9364-459a-a571-8ef6cfedbe4f', '9141c1ff-c9a8-425e-a31b-9dae6cd88051'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:37:51 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-0fa5e92a-3d61-49ad-b513-6754eb888e40 tempest-TestMinimumBasicScenario-1164867133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:37:51 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-0fa5e92a-3d61-49ad-b513-6754eb888e40 tempest-TestMinimumBasicScenario-1164867133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:37:51 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-0fa5e92a-3d61-49ad-b513-6754eb888e40 tempest-TestMinimumBasicScenario-1164867133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:37:51 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-0fa5e92a-3d61-49ad-b513-6754eb888e40 tempest-TestMinimumBasicScenario-1164867133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:37:51 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-0fa5e92a-3d61-49ad-b513-6754eb888e40 tempest-TestMinimumBasicScenario-1164867133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:37:51 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-0fa5e92a-3d61-49ad-b513-6754eb888e40 tempest-TestMinimumBasicScenario-1164867133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:37:51 devstack sudo[111667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:37:51 devstack sudo[111667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:37:51 devstack sudo[111667]: pam_unix(sudo:session): session closed for user root Aug 26 14:37:51 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-0fa5e92a-3d61-49ad-b513-6754eb888e40 tempest-TestMinimumBasicScenario-1164867133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.242s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:37:51 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-0fa5e92a-3d61-49ad-b513-6754eb888e40 tempest-TestMinimumBasicScenario-1164867133 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:37:51 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-0fa5e92a-3d61-49ad-b513-6754eb888e40 tempest-TestMinimumBasicScenario-1164867133 None] Deleted volume successfully. Aug 26 14:37:51 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-0fa5e92a-3d61-49ad-b513-6754eb888e40 tempest-TestMinimumBasicScenario-1164867133 None] Lock "cinder-148d0d07-61ca-4b8e-aae6-adb03371fe4d-delete_volume" released by "delete_volume" :: held 1.057s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:38:01 devstack cinder-volume[94394]: DEBUG dbcounter [-] [94394] Writing DB stats cinder:SELECT=16,cinder:UPDATE=20,cinder:INSERT=11,cinder:DELETE=1 {{(pid=94394) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 14:38:01 devstack cinder-volume[94394]: DEBUG dbcounter [-] [94394] Writing DB stats cinder:SELECT=20,cinder:INSERT=7,cinder:UPDATE=20,cinder:DELETE=2 {{(pid=94394) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 14:38:24 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-41d9e775-8c47-4b28-8ef0-f0903baee47a tempest-TestStampPattern-1781671338 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:38:24 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-41d9e775-8c47-4b28-8ef0-f0903baee47a tempest-TestStampPattern-1781671338 None] Flow 'volume_create_manager' (8f4ae637-d594-4a36-8149-b8253803570a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:38:24 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-41d9e775-8c47-4b28-8ef0-f0903baee47a tempest-TestStampPattern-1781671338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (028ba468-df59-4700-ad4b-9c251813c60d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:38:24 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-41d9e775-8c47-4b28-8ef0-f0903baee47a tempest-TestStampPattern-1781671338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (028ba468-df59-4700-ad4b-9c251813c60d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:38:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1176309810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b55b5f69-5ceb-4dfc-8c50-d74f222fa21b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='679f25c409f64b87bd23c1840862ff05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:38:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:38:24Z,use_quota=True,user_id='c6f8465ab81042f28026b104fe4c6daf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:38:24 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-41d9e775-8c47-4b28-8ef0-f0903baee47a tempest-TestStampPattern-1781671338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8458940-b04b-4f2b-ac1b-41c11d42b5f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:38:24 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-41d9e775-8c47-4b28-8ef0-f0903baee47a tempest-TestStampPattern-1781671338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8458940-b04b-4f2b-ac1b-41c11d42b5f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:38:24 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-41d9e775-8c47-4b28-8ef0-f0903baee47a tempest-TestStampPattern-1781671338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6de48d91-5215-4230-9b77-ae63805fcdd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:38:24 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-41d9e775-8c47-4b28-8ef0-f0903baee47a tempest-TestStampPattern-1781671338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6de48d91-5215-4230-9b77-ae63805fcdd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b55b5f69-5ceb-4dfc-8c50-d74f222fa21b', 'volume_name': 'volume-b55b5f69-5ceb-4dfc-8c50-d74f222fa21b', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:38:24 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-41d9e775-8c47-4b28-8ef0-f0903baee47a tempest-TestStampPattern-1781671338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d86a16cf-d9a5-433b-866f-a61b1f06ca8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:38:24 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-41d9e775-8c47-4b28-8ef0-f0903baee47a tempest-TestStampPattern-1781671338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d86a16cf-d9a5-433b-866f-a61b1f06ca8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:38:24 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-41d9e775-8c47-4b28-8ef0-f0903baee47a tempest-TestStampPattern-1781671338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (692f2bb1-5ba7-466a-a3bf-b2c1cfb3ebab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:38:24 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-41d9e775-8c47-4b28-8ef0-f0903baee47a tempest-TestStampPattern-1781671338 None] Volume b55b5f69-5ceb-4dfc-8c50-d74f222fa21b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b55b5f69-5ceb-4dfc-8c50-d74f222fa21b', 'volume_size': 1} Aug 26 14:38:24 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-41d9e775-8c47-4b28-8ef0-f0903baee47a tempest-TestStampPattern-1781671338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:38:24 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-41d9e775-8c47-4b28-8ef0-f0903baee47a tempest-TestStampPattern-1781671338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:38:24 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-41d9e775-8c47-4b28-8ef0-f0903baee47a tempest-TestStampPattern-1781671338 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:38:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1176309810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b55b5f69-5ceb-4dfc-8c50-d74f222fa21b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='679f25c409f64b87bd23c1840862ff05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:38:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:38:24Z,use_quota=True,user_id='c6f8465ab81042f28026b104fe4c6daf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:38:24 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-41d9e775-8c47-4b28-8ef0-f0903baee47a tempest-TestStampPattern-1781671338 None] Creating volume b55b5f69-5ceb-4dfc-8c50-d74f222fa21b {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:38:24 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-41d9e775-8c47-4b28-8ef0-f0903baee47a tempest-TestStampPattern-1781671338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:38:24 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-41d9e775-8c47-4b28-8ef0-f0903baee47a tempest-TestStampPattern-1781671338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:38:24 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-41d9e775-8c47-4b28-8ef0-f0903baee47a tempest-TestStampPattern-1781671338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:38:24 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-41d9e775-8c47-4b28-8ef0-f0903baee47a tempest-TestStampPattern-1781671338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:38:24 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-41d9e775-8c47-4b28-8ef0-f0903baee47a tempest-TestStampPattern-1781671338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:38:24 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-41d9e775-8c47-4b28-8ef0-f0903baee47a tempest-TestStampPattern-1781671338 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:38:24 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-41d9e775-8c47-4b28-8ef0-f0903baee47a tempest-TestStampPattern-1781671338 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:38:24 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-41d9e775-8c47-4b28-8ef0-f0903baee47a tempest-TestStampPattern-1781671338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b55b5f69-5ceb-4dfc-8c50-d74f222fa21b 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:38:24 devstack sudo[111707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b55b5f69-5ceb-4dfc-8c50-d74f222fa21b 1073741824 Aug 26 14:38:24 devstack sudo[111707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:38:24 devstack sudo[111707]: pam_unix(sudo:session): session closed for user root Aug 26 14:38:24 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-41d9e775-8c47-4b28-8ef0-f0903baee47a tempest-TestStampPattern-1781671338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b55b5f69-5ceb-4dfc-8c50-d74f222fa21b 1073741824" returned: 0 in 0.432s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:38:24 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-41d9e775-8c47-4b28-8ef0-f0903baee47a tempest-TestStampPattern-1781671338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b55b5f69-5ceb-4dfc-8c50-d74f222fa21b {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:38:24 devstack sudo[111713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b55b5f69-5ceb-4dfc-8c50-d74f222fa21b Aug 26 14:38:24 devstack sudo[111713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:38:25 devstack sudo[111713]: pam_unix(sudo:session): session closed for user root Aug 26 14:38:25 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-41d9e775-8c47-4b28-8ef0-f0903baee47a tempest-TestStampPattern-1781671338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b55b5f69-5ceb-4dfc-8c50-d74f222fa21b" returned: 0 in 0.273s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:38:25 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-41d9e775-8c47-4b28-8ef0-f0903baee47a tempest-TestStampPattern-1781671338 None] <== create_volume: return (748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:38:25 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-41d9e775-8c47-4b28-8ef0-f0903baee47a tempest-TestStampPattern-1781671338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.751s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:38:25 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-41d9e775-8c47-4b28-8ef0-f0903baee47a tempest-TestStampPattern-1781671338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (692f2bb1-5ba7-466a-a3bf-b2c1cfb3ebab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b55b5f69-5ceb-4dfc-8c50-d74f222fa21b', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:38:25 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-41d9e775-8c47-4b28-8ef0-f0903baee47a tempest-TestStampPattern-1781671338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18bf9bb6-1493-43f6-b949-7bc59392f180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:38:25 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-41d9e775-8c47-4b28-8ef0-f0903baee47a tempest-TestStampPattern-1781671338 None] Volume volume-b55b5f69-5ceb-4dfc-8c50-d74f222fa21b (b55b5f69-5ceb-4dfc-8c50-d74f222fa21b): created successfully Aug 26 14:38:25 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-41d9e775-8c47-4b28-8ef0-f0903baee47a tempest-TestStampPattern-1781671338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18bf9bb6-1493-43f6-b949-7bc59392f180) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:38:25 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-41d9e775-8c47-4b28-8ef0-f0903baee47a tempest-TestStampPattern-1781671338 None] Flow 'volume_create_manager' (8f4ae637-d594-4a36-8149-b8253803570a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:38:25 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-41d9e775-8c47-4b28-8ef0-f0903baee47a tempest-TestStampPattern-1781671338 None] Created volume successfully. Aug 26 14:38:33 devstack cinder-volume[94394]: DEBUG oslo_service.periodic_task [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94394) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 14:38:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:38:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:38:33 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:38:33 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:38:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:38:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:38:33 devstack sudo[111857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:38:33 devstack sudo[111857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:38:33 devstack sudo[111857]: pam_unix(sudo:session): session closed for user root Aug 26 14:38:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.265s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:38:33 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:38:33 devstack cinder-volume[94394]: DEBUG oslo_service.periodic_task [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Running periodic task VolumeManager._thread_info {{(pid=94394) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 14:38:33 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] thread count: 28 {{(pid=94394) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 14:38:33 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] thread info: [<_MainThread(MainThread, started 126600738033792)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94394) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 14:38:35 devstack cinder-volume[94394]: DEBUG dbcounter [-] [94394] Writing DB stats cinder:UPDATE=3,cinder:SELECT=2 {{(pid=94394) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 14:38:35 devstack cinder-volume[94394]: DEBUG dbcounter [-] [94394] Writing DB stats cinder:SELECT=2,cinder:UPDATE=3,cinder:INSERT=1,cinder:DELETE=1 {{(pid=94394) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 14:38:55 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [req-d8241764-56a0-48e3-a49d-eb755f6fd429 req-1f4f2afe-180b-43b4-baf0-fb7842825140 tempest-TestStampPattern-1781671338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:38:55 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [req-d8241764-56a0-48e3-a49d-eb755f6fd429 req-1f4f2afe-180b-43b4-baf0-fb7842825140 tempest-TestStampPattern-1781671338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:38:55 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [req-d8241764-56a0-48e3-a49d-eb755f6fd429 req-1f4f2afe-180b-43b4-baf0-fb7842825140 tempest-TestStampPattern-1781671338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:38:55 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [req-d8241764-56a0-48e3-a49d-eb755f6fd429 req-1f4f2afe-180b-43b4-baf0-fb7842825140 tempest-TestStampPattern-1781671338 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b', 'name': 'volume-b55b5f69-5ceb-4dfc-8c50-d74f222fa21b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '70bbb1fd-ad1f-4215-aa64-05b1712c2c08', 'enforce_multipath': True} {{(pid=94394) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 14:38:55 devstack cinder-volume[94394]: INFO cinder.volume.manager [req-d8241764-56a0-48e3-a49d-eb755f6fd429 req-1f4f2afe-180b-43b4-baf0-fb7842825140 tempest-TestStampPattern-1781671338 None] attachment_update completed successfully. Aug 26 14:38:59 devstack cinder-volume[94394]: INFO cinder.volume.manager [req-cb943cd7-4661-4466-a5ff-3330cf088f39 req-52942740-9b53-4167-8306-340bee0c8830 tempest-TestStampPattern-1781671338 None] Terminate volume connection completed successfully. Aug 26 14:38:59 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [req-cb943cd7-4661-4466-a5ff-3330cf088f39 req-52942740-9b53-4167-8306-340bee0c8830 tempest-TestStampPattern-1781671338 None] Deleting attachment 70bbb1fd-ad1f-4215-aa64-05b1712c2c08. {{(pid=94394) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 14:39:00 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e1df048e-a357-4eb3-b01b-597198871655 tempest-TestStampPattern-1781671338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:39:00 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e1df048e-a357-4eb3-b01b-597198871655 tempest-TestStampPattern-1781671338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:39:00 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-e1df048e-a357-4eb3-b01b-597198871655 tempest-TestStampPattern-1781671338 None] Creating offline snapshot 8c77696c-4a61-4366-8934-ba995f84e447 of volume b55b5f69-5ceb-4dfc-8c50-d74f222fa21b {{(pid=94394) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 14:39:00 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a8275e1-cd73-4e9b-b3ed-23e4397d130e]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:39:00 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e1df048e-a357-4eb3-b01b-597198871655 tempest-TestStampPattern-1781671338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b55b5f69-5ceb-4dfc-8c50-d74f222fa21b {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:39:00 devstack sudo[112348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b55b5f69-5ceb-4dfc-8c50-d74f222fa21b Aug 26 14:39:00 devstack sudo[112348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:39:01 devstack sudo[112348]: pam_unix(sudo:session): session closed for user root Aug 26 14:39:01 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e1df048e-a357-4eb3-b01b-597198871655 tempest-TestStampPattern-1781671338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b55b5f69-5ceb-4dfc-8c50-d74f222fa21b" returned: 0 in 0.358s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:39:01 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e1df048e-a357-4eb3-b01b-597198871655 tempest-TestStampPattern-1781671338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b55b5f69-5ceb-4dfc-8c50-d74f222fa21b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b55b5f69-5ceb-4dfc-8c50-d74f222fa21b.8c77696c-4a61-4366-8934-ba995f84e447 1G {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:39:01 devstack sudo[112353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b55b5f69-5ceb-4dfc-8c50-d74f222fa21b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b55b5f69-5ceb-4dfc-8c50-d74f222fa21b.8c77696c-4a61-4366-8934-ba995f84e447 1G Aug 26 14:39:01 devstack sudo[112353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:39:01 devstack sudo[112353]: pam_unix(sudo:session): session closed for user root Aug 26 14:39:01 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e1df048e-a357-4eb3-b01b-597198871655 tempest-TestStampPattern-1781671338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b55b5f69-5ceb-4dfc-8c50-d74f222fa21b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b55b5f69-5ceb-4dfc-8c50-d74f222fa21b.8c77696c-4a61-4366-8934-ba995f84e447 1G" returned: 0 in 0.374s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:39:01 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e1df048e-a357-4eb3-b01b-597198871655 tempest-TestStampPattern-1781671338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b55b5f69-5ceb-4dfc-8c50-d74f222fa21b -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b55b5f69-5ceb-4dfc-8c50-d74f222fa21b.8c77696c-4a61-4366-8934-ba995f84e447 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:39:01 devstack sudo[112359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b55b5f69-5ceb-4dfc-8c50-d74f222fa21b -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b55b5f69-5ceb-4dfc-8c50-d74f222fa21b.8c77696c-4a61-4366-8934-ba995f84e447 Aug 26 14:39:01 devstack sudo[112359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:39:01 devstack sudo[112359]: pam_unix(sudo:session): session closed for user root Aug 26 14:39:01 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e1df048e-a357-4eb3-b01b-597198871655 tempest-TestStampPattern-1781671338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b55b5f69-5ceb-4dfc-8c50-d74f222fa21b -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b55b5f69-5ceb-4dfc-8c50-d74f222fa21b.8c77696c-4a61-4366-8934-ba995f84e447" returned: 0 in 0.302s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:39:01 devstack cinder-volume[94394]: WARNING cinder.volume.drivers.remotefs [None req-e1df048e-a357-4eb3-b01b-597198871655 tempest-TestStampPattern-1781671338 None] /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b55b5f69-5ceb-4dfc-8c50-d74f222fa21b.8c77696c-4a61-4366-8934-ba995f84e447 is being set with open permissions: ugo+rw Aug 26 14:39:01 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e1df048e-a357-4eb3-b01b-597198871655 tempest-TestStampPattern-1781671338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b55b5f69-5ceb-4dfc-8c50-d74f222fa21b.8c77696c-4a61-4366-8934-ba995f84e447 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:39:01 devstack sudo[112365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b55b5f69-5ceb-4dfc-8c50-d74f222fa21b.8c77696c-4a61-4366-8934-ba995f84e447 Aug 26 14:39:01 devstack sudo[112365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:39:02 devstack sudo[112365]: pam_unix(sudo:session): session closed for user root Aug 26 14:39:02 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e1df048e-a357-4eb3-b01b-597198871655 tempest-TestStampPattern-1781671338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b55b5f69-5ceb-4dfc-8c50-d74f222fa21b.8c77696c-4a61-4366-8934-ba995f84e447" returned: 0 in 0.245s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:39:02 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e1df048e-a357-4eb3-b01b-597198871655 tempest-TestStampPattern-1781671338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b55b5f69-5ceb-4dfc-8c50-d74f222fa21b.info {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:39:02 devstack sudo[112368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b55b5f69-5ceb-4dfc-8c50-d74f222fa21b.info Aug 26 14:39:02 devstack sudo[112368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:39:02 devstack sudo[112368]: pam_unix(sudo:session): session closed for user root Aug 26 14:39:02 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e1df048e-a357-4eb3-b01b-597198871655 tempest-TestStampPattern-1781671338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b55b5f69-5ceb-4dfc-8c50-d74f222fa21b.info" returned: 0 in 0.236s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:39:02 devstack cinder-volume[94394]: WARNING cinder.volume.drivers.remotefs [None req-e1df048e-a357-4eb3-b01b-597198871655 tempest-TestStampPattern-1781671338 None] /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b55b5f69-5ceb-4dfc-8c50-d74f222fa21b.info is being set with open permissions: ugo+rw Aug 26 14:39:02 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e1df048e-a357-4eb3-b01b-597198871655 tempest-TestStampPattern-1781671338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b55b5f69-5ceb-4dfc-8c50-d74f222fa21b.info {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:39:02 devstack sudo[112371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b55b5f69-5ceb-4dfc-8c50-d74f222fa21b.info Aug 26 14:39:02 devstack sudo[112371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:39:02 devstack sudo[112371]: pam_unix(sudo:session): session closed for user root Aug 26 14:39:02 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e1df048e-a357-4eb3-b01b-597198871655 tempest-TestStampPattern-1781671338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b55b5f69-5ceb-4dfc-8c50-d74f222fa21b.info" returned: 0 in 0.236s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:39:02 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e1df048e-a357-4eb3-b01b-597198871655 tempest-TestStampPattern-1781671338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.826s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:39:02 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-e1df048e-a357-4eb3-b01b-597198871655 tempest-TestStampPattern-1781671338 None] Create snapshot completed successfully Aug 26 14:39:09 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-47887f42-092b-45fe-8bd1-ff62fc8dc514 tempest-TestStampPattern-1781671338 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:39:09 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-47887f42-092b-45fe-8bd1-ff62fc8dc514 tempest-TestStampPattern-1781671338 None] Flow 'volume_create_manager' (4aaff67f-0d60-4d1e-815f-de5a5df1f909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:39:09 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-47887f42-092b-45fe-8bd1-ff62fc8dc514 tempest-TestStampPattern-1781671338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7faa860-0872-4f53-b406-17458a79b910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:39:09 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-47887f42-092b-45fe-8bd1-ff62fc8dc514 tempest-TestStampPattern-1781671338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7faa860-0872-4f53-b406-17458a79b910) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:39:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-255706200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86da6140-0158-4b0a-b119-58955ede98ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='679f25c409f64b87bd23c1840862ff05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:39:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8c77696c-4a61-4366-8934-ba995f84e447,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:39:09Z,use_quota=True,user_id='c6f8465ab81042f28026b104fe4c6daf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:39:09 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-47887f42-092b-45fe-8bd1-ff62fc8dc514 tempest-TestStampPattern-1781671338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eeba2fce-c0ba-41a0-afca-1d3d8e11c373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:39:09 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-47887f42-092b-45fe-8bd1-ff62fc8dc514 tempest-TestStampPattern-1781671338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eeba2fce-c0ba-41a0-afca-1d3d8e11c373) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:39:09 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-47887f42-092b-45fe-8bd1-ff62fc8dc514 tempest-TestStampPattern-1781671338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49caa5a4-3e8b-4d0f-a5ff-0856e51b1bc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:39:09 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-47887f42-092b-45fe-8bd1-ff62fc8dc514 tempest-TestStampPattern-1781671338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49caa5a4-3e8b-4d0f-a5ff-0856e51b1bc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '86da6140-0158-4b0a-b119-58955ede98ee', 'volume_name': 'volume-86da6140-0158-4b0a-b119-58955ede98ee', 'volume_size': 1, 'snapshot_id': '8c77696c-4a61-4366-8934-ba995f84e447'}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:39:09 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-47887f42-092b-45fe-8bd1-ff62fc8dc514 tempest-TestStampPattern-1781671338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (787956e2-8272-48d9-a0b2-d245f9ff13ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:39:09 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-47887f42-092b-45fe-8bd1-ff62fc8dc514 tempest-TestStampPattern-1781671338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (787956e2-8272-48d9-a0b2-d245f9ff13ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:39:09 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-47887f42-092b-45fe-8bd1-ff62fc8dc514 tempest-TestStampPattern-1781671338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3f0a7f5-37b8-487b-b3a0-b18745969f7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:39:09 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-47887f42-092b-45fe-8bd1-ff62fc8dc514 tempest-TestStampPattern-1781671338 None] Volume 86da6140-0158-4b0a-b119-58955ede98ee: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-86da6140-0158-4b0a-b119-58955ede98ee', 'volume_size': 1, 'snapshot_id': '8c77696c-4a61-4366-8934-ba995f84e447'} Aug 26 14:39:09 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-47887f42-092b-45fe-8bd1-ff62fc8dc514 tempest-TestStampPattern-1781671338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:39:09 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-47887f42-092b-45fe-8bd1-ff62fc8dc514 tempest-TestStampPattern-1781671338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:39:09 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-47887f42-092b-45fe-8bd1-ff62fc8dc514 tempest-TestStampPattern-1781671338 None] Acquiring lock "cinder-quobyte-8c77696c-4a61-4366-8934-ba995f84e447-86da6140-0158-4b0a-b119-58955ede98ee" by "_create_volume_from_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:39:09 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-47887f42-092b-45fe-8bd1-ff62fc8dc514 tempest-TestStampPattern-1781671338 None] Lock "cinder-quobyte-8c77696c-4a61-4366-8934-ba995f84e447-86da6140-0158-4b0a-b119-58955ede98ee" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:39:09 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-47887f42-092b-45fe-8bd1-ff62fc8dc514 tempest-TestStampPattern-1781671338 None] Creating volume 86da6140-0158-4b0a-b119-58955ede98ee from snapshot 8c77696c-4a61-4366-8934-ba995f84e447 {{(pid=94394) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Aug 26 14:39:09 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-47887f42-092b-45fe-8bd1-ff62fc8dc514 tempest-TestStampPattern-1781671338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:39:09 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-47887f42-092b-45fe-8bd1-ff62fc8dc514 tempest-TestStampPattern-1781671338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:39:09 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-47887f42-092b-45fe-8bd1-ff62fc8dc514 tempest-TestStampPattern-1781671338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:39:09 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-47887f42-092b-45fe-8bd1-ff62fc8dc514 tempest-TestStampPattern-1781671338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:39:09 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-47887f42-092b-45fe-8bd1-ff62fc8dc514 tempest-TestStampPattern-1781671338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:39:09 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-47887f42-092b-45fe-8bd1-ff62fc8dc514 tempest-TestStampPattern-1781671338 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:39:09 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-47887f42-092b-45fe-8bd1-ff62fc8dc514 tempest-TestStampPattern-1781671338 None] Acquiring lock "cinder-quobyte-86da6140-0158-4b0a-b119-58955ede98ee" by "_copy_volume_from_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:39:09 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-47887f42-092b-45fe-8bd1-ff62fc8dc514 tempest-TestStampPattern-1781671338 None] Lock "cinder-quobyte-86da6140-0158-4b0a-b119-58955ede98ee" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:39:09 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-47887f42-092b-45fe-8bd1-ff62fc8dc514 tempest-TestStampPattern-1781671338 None] snapshot: 8c77696c-4a61-4366-8934-ba995f84e447, volume: 86da6140-0158-4b0a-b119-58955ede98ee, {{(pid=94394) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 26 14:39:09 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-47887f42-092b-45fe-8bd1-ff62fc8dc514 tempest-TestStampPattern-1781671338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:39:09 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-47887f42-092b-45fe-8bd1-ff62fc8dc514 tempest-TestStampPattern-1781671338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:39:09 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-47887f42-092b-45fe-8bd1-ff62fc8dc514 tempest-TestStampPattern-1781671338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:39:09 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-47887f42-092b-45fe-8bd1-ff62fc8dc514 tempest-TestStampPattern-1781671338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:39:09 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-47887f42-092b-45fe-8bd1-ff62fc8dc514 tempest-TestStampPattern-1781671338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:39:09 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[d666fd75-33b3-4c2c-a829-14c17c3b8129]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:39:09 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-47887f42-092b-45fe-8bd1-ff62fc8dc514 tempest-TestStampPattern-1781671338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b55b5f69-5ceb-4dfc-8c50-d74f222fa21b.8c77696c-4a61-4366-8934-ba995f84e447 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:39:09 devstack sudo[112404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b55b5f69-5ceb-4dfc-8c50-d74f222fa21b.8c77696c-4a61-4366-8934-ba995f84e447 Aug 26 14:39:09 devstack sudo[112404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:39:10 devstack sudo[112404]: pam_unix(sudo:session): session closed for user root Aug 26 14:39:10 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-47887f42-092b-45fe-8bd1-ff62fc8dc514 tempest-TestStampPattern-1781671338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b55b5f69-5ceb-4dfc-8c50-d74f222fa21b.8c77696c-4a61-4366-8934-ba995f84e447" returned: 0 in 0.371s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:39:10 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-47887f42-092b-45fe-8bd1-ff62fc8dc514 tempest-TestStampPattern-1781671338 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b55b5f69-5ceb-4dfc-8c50-d74f222fa21b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94394) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 14:39:10 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[3979d48a-797b-4b6a-adce-7ac6f2424faf]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:39:10 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-47887f42-092b-45fe-8bd1-ff62fc8dc514 tempest-TestStampPattern-1781671338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b55b5f69-5ceb-4dfc-8c50-d74f222fa21b {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:39:10 devstack sudo[112410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b55b5f69-5ceb-4dfc-8c50-d74f222fa21b Aug 26 14:39:10 devstack sudo[112410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:39:10 devstack sudo[112410]: pam_unix(sudo:session): session closed for user root Aug 26 14:39:10 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-47887f42-092b-45fe-8bd1-ff62fc8dc514 tempest-TestStampPattern-1781671338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b55b5f69-5ceb-4dfc-8c50-d74f222fa21b" returned: 0 in 0.383s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:39:10 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-47887f42-092b-45fe-8bd1-ff62fc8dc514 tempest-TestStampPattern-1781671338 None] will copy from snapshot at /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b55b5f69-5ceb-4dfc-8c50-d74f222fa21b {{(pid=94394) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 26 14:39:10 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-47887f42-092b-45fe-8bd1-ff62fc8dc514 tempest-TestStampPattern-1781671338 None] Creating direct copy from snapshot {{(pid=94394) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 26 14:39:10 devstack cinder-volume[94394]: DEBUG cinder.utils [None req-47887f42-092b-45fe-8bd1-ff62fc8dc514 tempest-TestStampPattern-1781671338 None] Path /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-86da6140-0158-4b0a-b119-58955ede98ee not found in is_blk_device check {{(pid=94394) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 26 14:39:10 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-47887f42-092b-45fe-8bd1-ff62fc8dc514 tempest-TestStampPattern-1781671338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b55b5f69-5ceb-4dfc-8c50-d74f222fa21b /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-86da6140-0158-4b0a-b119-58955ede98ee {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:39:10 devstack sudo[112419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b55b5f69-5ceb-4dfc-8c50-d74f222fa21b /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-86da6140-0158-4b0a-b119-58955ede98ee Aug 26 14:39:10 devstack sudo[112419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:39:16 devstack sudo[112419]: pam_unix(sudo:session): session closed for user root Aug 26 14:39:16 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-47887f42-092b-45fe-8bd1-ff62fc8dc514 tempest-TestStampPattern-1781671338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b55b5f69-5ceb-4dfc-8c50-d74f222fa21b /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-86da6140-0158-4b0a-b119-58955ede98ee" returned: 0 in 5.620s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:39:16 devstack cinder-volume[94394]: DEBUG cinder.image.image_utils [None req-47887f42-092b-45fe-8bd1-ff62fc8dc514 tempest-TestStampPattern-1781671338 None] Image conversion details: src /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b55b5f69-5ceb-4dfc-8c50-d74f222fa21b, size 1024.00 MB, duration 5.62 sec, destination /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-86da6140-0158-4b0a-b119-58955ede98ee {{(pid=94394) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 14:39:16 devstack cinder-volume[94394]: INFO cinder.image.image_utils [None req-47887f42-092b-45fe-8bd1-ff62fc8dc514 tempest-TestStampPattern-1781671338 None] Converted 1024.00 MB image at 182.13 MB/s Aug 26 14:39:16 devstack cinder-volume[94394]: WARNING cinder.volume.drivers.remotefs [None req-47887f42-092b-45fe-8bd1-ff62fc8dc514 tempest-TestStampPattern-1781671338 None] /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-86da6140-0158-4b0a-b119-58955ede98ee is being set with open permissions: ugo+rw Aug 26 14:39:16 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-47887f42-092b-45fe-8bd1-ff62fc8dc514 tempest-TestStampPattern-1781671338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-86da6140-0158-4b0a-b119-58955ede98ee {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:39:16 devstack sudo[112433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-86da6140-0158-4b0a-b119-58955ede98ee Aug 26 14:39:16 devstack sudo[112433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:39:16 devstack sudo[112433]: pam_unix(sudo:session): session closed for user root Aug 26 14:39:16 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-47887f42-092b-45fe-8bd1-ff62fc8dc514 tempest-TestStampPattern-1781671338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-86da6140-0158-4b0a-b119-58955ede98ee" returned: 0 in 0.285s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:39:16 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-47887f42-092b-45fe-8bd1-ff62fc8dc514 tempest-TestStampPattern-1781671338 None] Lock "cinder-quobyte-86da6140-0158-4b0a-b119-58955ede98ee" released by "_copy_volume_from_snapshot" :: held 6.748s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:39:16 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-47887f42-092b-45fe-8bd1-ff62fc8dc514 tempest-TestStampPattern-1781671338 None] Lock "cinder-quobyte-8c77696c-4a61-4366-8934-ba995f84e447-86da6140-0158-4b0a-b119-58955ede98ee" released by "_create_volume_from_snapshot" :: held 6.821s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:39:16 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-47887f42-092b-45fe-8bd1-ff62fc8dc514 tempest-TestStampPattern-1781671338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.840s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:39:16 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-47887f42-092b-45fe-8bd1-ff62fc8dc514 tempest-TestStampPattern-1781671338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3f0a7f5-37b8-487b-b3a0-b18745969f7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86da6140-0158-4b0a-b119-58955ede98ee', 'volume_size': 1, 'snapshot_id': '8c77696c-4a61-4366-8934-ba995f84e447'}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:39:16 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-47887f42-092b-45fe-8bd1-ff62fc8dc514 tempest-TestStampPattern-1781671338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c624b4a-f04a-4c7b-8e82-ff1175762730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:39:16 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-47887f42-092b-45fe-8bd1-ff62fc8dc514 tempest-TestStampPattern-1781671338 None] Volume volume-86da6140-0158-4b0a-b119-58955ede98ee (86da6140-0158-4b0a-b119-58955ede98ee): created successfully Aug 26 14:39:16 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-47887f42-092b-45fe-8bd1-ff62fc8dc514 tempest-TestStampPattern-1781671338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c624b4a-f04a-4c7b-8e82-ff1175762730) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:39:16 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-47887f42-092b-45fe-8bd1-ff62fc8dc514 tempest-TestStampPattern-1781671338 None] Flow 'volume_create_manager' (4aaff67f-0d60-4d1e-815f-de5a5df1f909) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:39:16 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-47887f42-092b-45fe-8bd1-ff62fc8dc514 tempest-TestStampPattern-1781671338 None] Created volume successfully. Aug 26 14:39:26 devstack cinder-volume[94394]: DEBUG dbcounter [-] [94394] Writing DB stats cinder:SELECT=13,cinder:UPDATE=6,cinder:DELETE=1,cinder:INSERT=1 {{(pid=94394) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 14:39:26 devstack cinder-volume[94394]: DEBUG dbcounter [-] [94394] Writing DB stats cinder:SELECT=16,cinder:UPDATE=6,cinder:INSERT=1,cinder:DELETE=1 {{(pid=94394) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 14:39:33 devstack cinder-volume[94394]: DEBUG oslo_service.periodic_task [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94394) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 14:39:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:39:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:39:33 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:39:33 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:39:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:39:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:39:33 devstack sudo[112583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:39:33 devstack sudo[112583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:39:33 devstack sudo[112583]: pam_unix(sudo:session): session closed for user root Aug 26 14:39:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.239s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:39:33 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:39:33 devstack cinder-volume[94394]: DEBUG oslo_service.periodic_task [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Running periodic task VolumeManager._thread_info {{(pid=94394) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 14:39:33 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] thread count: 28 {{(pid=94394) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 14:39:33 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] thread info: [<_MainThread(MainThread, started 126600738033792)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94394) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 14:39:46 devstack cinder-volume[94394]: DEBUG dbcounter [-] [94394] Writing DB stats cinder:SELECT=1 {{(pid=94394) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 14:39:46 devstack cinder-volume[94394]: DEBUG dbcounter [-] [94394] Writing DB stats cinder:UPDATE=1 {{(pid=94394) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 14:39:59 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [req-c4c57fb5-da7b-42c4-871d-6f920b0f7b42 req-a676efda-ff2f-44eb-9d50-78723696747c tempest-TestStampPattern-1781671338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:39:59 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [req-c4c57fb5-da7b-42c4-871d-6f920b0f7b42 req-a676efda-ff2f-44eb-9d50-78723696747c tempest-TestStampPattern-1781671338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:39:59 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [req-c4c57fb5-da7b-42c4-871d-6f920b0f7b42 req-a676efda-ff2f-44eb-9d50-78723696747c tempest-TestStampPattern-1781671338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.010s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:39:59 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [req-c4c57fb5-da7b-42c4-871d-6f920b0f7b42 req-a676efda-ff2f-44eb-9d50-78723696747c tempest-TestStampPattern-1781671338 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b', 'name': 'volume-86da6140-0158-4b0a-b119-58955ede98ee', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4899d75e-8560-4728-9650-c948d9a9abb5', 'enforce_multipath': True} {{(pid=94394) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 14:39:59 devstack cinder-volume[94394]: INFO cinder.volume.manager [req-c4c57fb5-da7b-42c4-871d-6f920b0f7b42 req-a676efda-ff2f-44eb-9d50-78723696747c tempest-TestStampPattern-1781671338 None] attachment_update completed successfully. Aug 26 14:40:02 devstack cinder-volume[94394]: INFO cinder.volume.manager [req-e317455f-c69d-48a3-9783-a202ed5be74e req-220d2b92-c5ff-4b23-b0d5-0c7ad9cb8ae8 tempest-TestStampPattern-1781671338 None] Terminate volume connection completed successfully. Aug 26 14:40:02 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [req-e317455f-c69d-48a3-9783-a202ed5be74e req-220d2b92-c5ff-4b23-b0d5-0c7ad9cb8ae8 tempest-TestStampPattern-1781671338 None] Deleting attachment 4899d75e-8560-4728-9650-c948d9a9abb5. {{(pid=94394) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 14:40:06 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-674d3134-3973-450a-a87b-ac3d417b1e8e tempest-TestStampPattern-1781671338 None] Acquiring lock "cinder-86da6140-0158-4b0a-b119-58955ede98ee-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:40:06 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-674d3134-3973-450a-a87b-ac3d417b1e8e tempest-TestStampPattern-1781671338 None] Lock "cinder-86da6140-0158-4b0a-b119-58955ede98ee-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:40:06 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-674d3134-3973-450a-a87b-ac3d417b1e8e tempest-TestStampPattern-1781671338 None] Acquiring lock "cinder-quobyte-86da6140-0158-4b0a-b119-58955ede98ee" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:40:06 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-674d3134-3973-450a-a87b-ac3d417b1e8e tempest-TestStampPattern-1781671338 None] Lock "cinder-quobyte-86da6140-0158-4b0a-b119-58955ede98ee" acquired by "delete_volume" :: waited 0.014s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:40:06 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[530bf7da-601b-4058-bdb1-94371fc432a4]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:40:06 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-674d3134-3973-450a-a87b-ac3d417b1e8e tempest-TestStampPattern-1781671338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-86da6140-0158-4b0a-b119-58955ede98ee {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:40:06 devstack sudo[113090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-86da6140-0158-4b0a-b119-58955ede98ee Aug 26 14:40:06 devstack sudo[113090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:40:07 devstack sudo[113090]: pam_unix(sudo:session): session closed for user root Aug 26 14:40:07 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-674d3134-3973-450a-a87b-ac3d417b1e8e tempest-TestStampPattern-1781671338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-86da6140-0158-4b0a-b119-58955ede98ee" returned: 0 in 0.349s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:40:07 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-674d3134-3973-450a-a87b-ac3d417b1e8e tempest-TestStampPattern-1781671338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-86da6140-0158-4b0a-b119-58955ede98ee {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:40:07 devstack sudo[113095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-86da6140-0158-4b0a-b119-58955ede98ee Aug 26 14:40:07 devstack sudo[113095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:40:07 devstack sudo[113095]: pam_unix(sudo:session): session closed for user root Aug 26 14:40:07 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-674d3134-3973-450a-a87b-ac3d417b1e8e tempest-TestStampPattern-1781671338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-86da6140-0158-4b0a-b119-58955ede98ee" returned: 0 in 0.247s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:40:07 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-674d3134-3973-450a-a87b-ac3d417b1e8e tempest-TestStampPattern-1781671338 None] Lock "cinder-quobyte-86da6140-0158-4b0a-b119-58955ede98ee" released by "delete_volume" :: held 0.634s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:40:07 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-674d3134-3973-450a-a87b-ac3d417b1e8e tempest-TestStampPattern-1781671338 None] Created reservations ['4f50cca0-9cf4-4279-a51d-8d904722f722', '572f76f2-d9ff-40fc-b4e9-3c833bb62b9f', 'ced04c9b-edd0-4a65-aead-be75b0dd1376', 'dbbcd84d-5e59-45ac-a67f-0f308c0caf36'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:40:07 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-674d3134-3973-450a-a87b-ac3d417b1e8e tempest-TestStampPattern-1781671338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:40:07 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-674d3134-3973-450a-a87b-ac3d417b1e8e tempest-TestStampPattern-1781671338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:40:07 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-674d3134-3973-450a-a87b-ac3d417b1e8e tempest-TestStampPattern-1781671338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:40:07 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-674d3134-3973-450a-a87b-ac3d417b1e8e tempest-TestStampPattern-1781671338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:40:07 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-674d3134-3973-450a-a87b-ac3d417b1e8e tempest-TestStampPattern-1781671338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:40:07 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-674d3134-3973-450a-a87b-ac3d417b1e8e tempest-TestStampPattern-1781671338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:40:07 devstack sudo[113098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:40:07 devstack sudo[113098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:40:07 devstack sudo[113098]: pam_unix(sudo:session): session closed for user root Aug 26 14:40:07 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-674d3134-3973-450a-a87b-ac3d417b1e8e tempest-TestStampPattern-1781671338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.238s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:40:07 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-674d3134-3973-450a-a87b-ac3d417b1e8e tempest-TestStampPattern-1781671338 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:40:07 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-674d3134-3973-450a-a87b-ac3d417b1e8e tempest-TestStampPattern-1781671338 None] Deleted volume successfully. Aug 26 14:40:07 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-674d3134-3973-450a-a87b-ac3d417b1e8e tempest-TestStampPattern-1781671338 None] Lock "cinder-86da6140-0158-4b0a-b119-58955ede98ee-delete_volume" released by "delete_volume" :: held 1.052s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:40:08 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-9c7eeed8-dcc7-4f9f-8058-b485538f35dc tempest-TestStampPattern-1781671338 None] Acquiring lock "cinder-8c77696c-4a61-4366-8934-ba995f84e447-delete_snapshot" by "delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:40:08 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-9c7eeed8-dcc7-4f9f-8058-b485538f35dc tempest-TestStampPattern-1781671338 None] Lock "cinder-8c77696c-4a61-4366-8934-ba995f84e447-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:40:08 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-9c7eeed8-dcc7-4f9f-8058-b485538f35dc tempest-TestStampPattern-1781671338 None] Acquiring lock "cinder-quobyte-b55b5f69-5ceb-4dfc-8c50-d74f222fa21b" by "delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:40:08 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-9c7eeed8-dcc7-4f9f-8058-b485538f35dc tempest-TestStampPattern-1781671338 None] Lock "cinder-quobyte-b55b5f69-5ceb-4dfc-8c50-d74f222fa21b" acquired by "delete_snapshot" :: waited 0.018s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:40:08 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-9c7eeed8-dcc7-4f9f-8058-b485538f35dc tempest-TestStampPattern-1781671338 None] Acquiring lock "cinder-quobyte-8c77696c-4a61-4366-8934-ba995f84e447" by "_delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:40:08 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-9c7eeed8-dcc7-4f9f-8058-b485538f35dc tempest-TestStampPattern-1781671338 None] Lock "cinder-quobyte-8c77696c-4a61-4366-8934-ba995f84e447" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:40:08 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-9c7eeed8-dcc7-4f9f-8058-b485538f35dc tempest-TestStampPattern-1781671338 None] Deleting offline snapshot 8c77696c-4a61-4366-8934-ba995f84e447 of volume b55b5f69-5ceb-4dfc-8c50-d74f222fa21b {{(pid=94394) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 14:40:08 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-9c7eeed8-dcc7-4f9f-8058-b485538f35dc tempest-TestStampPattern-1781671338 None] snapshot_file for this snap is: volume-b55b5f69-5ceb-4dfc-8c50-d74f222fa21b.8c77696c-4a61-4366-8934-ba995f84e447 {{(pid=94394) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 14:40:08 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[445b96d7-a1aa-426f-84b7-988c3ccd128b]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:40:08 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-9c7eeed8-dcc7-4f9f-8058-b485538f35dc tempest-TestStampPattern-1781671338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b55b5f69-5ceb-4dfc-8c50-d74f222fa21b.8c77696c-4a61-4366-8934-ba995f84e447 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:40:08 devstack sudo[113101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b55b5f69-5ceb-4dfc-8c50-d74f222fa21b.8c77696c-4a61-4366-8934-ba995f84e447 Aug 26 14:40:08 devstack sudo[113101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:40:08 devstack sudo[113101]: pam_unix(sudo:session): session closed for user root Aug 26 14:40:08 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-9c7eeed8-dcc7-4f9f-8058-b485538f35dc tempest-TestStampPattern-1781671338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b55b5f69-5ceb-4dfc-8c50-d74f222fa21b.8c77696c-4a61-4366-8934-ba995f84e447" returned: 0 in 0.359s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:40:08 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-9c7eeed8-dcc7-4f9f-8058-b485538f35dc tempest-TestStampPattern-1781671338 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b55b5f69-5ceb-4dfc-8c50-d74f222fa21b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94394) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 14:40:08 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cfc6756-ebcd-4883-b32d-42b6588ef534]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:40:08 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-9c7eeed8-dcc7-4f9f-8058-b485538f35dc tempest-TestStampPattern-1781671338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b55b5f69-5ceb-4dfc-8c50-d74f222fa21b {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:40:08 devstack sudo[113106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b55b5f69-5ceb-4dfc-8c50-d74f222fa21b Aug 26 14:40:08 devstack sudo[113106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:40:08 devstack sudo[113106]: pam_unix(sudo:session): session closed for user root Aug 26 14:40:09 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-9c7eeed8-dcc7-4f9f-8058-b485538f35dc tempest-TestStampPattern-1781671338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b55b5f69-5ceb-4dfc-8c50-d74f222fa21b" returned: 0 in 0.520s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:40:09 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-9c7eeed8-dcc7-4f9f-8058-b485538f35dc tempest-TestStampPattern-1781671338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b55b5f69-5ceb-4dfc-8c50-d74f222fa21b.8c77696c-4a61-4366-8934-ba995f84e447 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:40:09 devstack sudo[113111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b55b5f69-5ceb-4dfc-8c50-d74f222fa21b.8c77696c-4a61-4366-8934-ba995f84e447 Aug 26 14:40:09 devstack sudo[113111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:40:09 devstack sudo[113111]: pam_unix(sudo:session): session closed for user root Aug 26 14:40:09 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-9c7eeed8-dcc7-4f9f-8058-b485538f35dc tempest-TestStampPattern-1781671338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b55b5f69-5ceb-4dfc-8c50-d74f222fa21b.8c77696c-4a61-4366-8934-ba995f84e447" returned: 0 in 0.322s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:40:09 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-9c7eeed8-dcc7-4f9f-8058-b485538f35dc tempest-TestStampPattern-1781671338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b55b5f69-5ceb-4dfc-8c50-d74f222fa21b.8c77696c-4a61-4366-8934-ba995f84e447 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:40:09 devstack sudo[113116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b55b5f69-5ceb-4dfc-8c50-d74f222fa21b.8c77696c-4a61-4366-8934-ba995f84e447 Aug 26 14:40:09 devstack sudo[113116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:40:09 devstack sudo[113116]: pam_unix(sudo:session): session closed for user root Aug 26 14:40:09 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-9c7eeed8-dcc7-4f9f-8058-b485538f35dc tempest-TestStampPattern-1781671338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b55b5f69-5ceb-4dfc-8c50-d74f222fa21b.8c77696c-4a61-4366-8934-ba995f84e447" returned: 0 in 0.242s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:40:09 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-9c7eeed8-dcc7-4f9f-8058-b485538f35dc tempest-TestStampPattern-1781671338 None] Lock "cinder-quobyte-8c77696c-4a61-4366-8934-ba995f84e447" released by "_delete_snapshot" :: held 1.545s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:40:09 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-9c7eeed8-dcc7-4f9f-8058-b485538f35dc tempest-TestStampPattern-1781671338 None] Lock "cinder-quobyte-b55b5f69-5ceb-4dfc-8c50-d74f222fa21b" released by "delete_snapshot" :: held 1.565s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:40:09 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-9c7eeed8-dcc7-4f9f-8058-b485538f35dc tempest-TestStampPattern-1781671338 None] Created reservations ['7e1fcf1c-2ee8-406d-b6db-d4edae920cb5', '7498084e-07a3-4fbc-b2eb-dc0af4f0891c', 'afa835cb-1e27-4f25-888b-adcc04acbd26', 'dca0ac25-306c-4ac1-8752-c972780be02b'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:40:09 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-9c7eeed8-dcc7-4f9f-8058-b485538f35dc tempest-TestStampPattern-1781671338 None] Delete snapshot completed successfully. Aug 26 14:40:09 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-9c7eeed8-dcc7-4f9f-8058-b485538f35dc tempest-TestStampPattern-1781671338 None] Lock "cinder-8c77696c-4a61-4366-8934-ba995f84e447-delete_snapshot" released by "delete_snapshot" :: held 1.690s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:40:13 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-bef2a58d-86f6-42af-ae28-b1c2776f8961 tempest-TestStampPattern-1781671338 None] Acquiring lock "cinder-b55b5f69-5ceb-4dfc-8c50-d74f222fa21b-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:40:13 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-bef2a58d-86f6-42af-ae28-b1c2776f8961 tempest-TestStampPattern-1781671338 None] Lock "cinder-b55b5f69-5ceb-4dfc-8c50-d74f222fa21b-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:40:13 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-bef2a58d-86f6-42af-ae28-b1c2776f8961 tempest-TestStampPattern-1781671338 None] Acquiring lock "cinder-quobyte-b55b5f69-5ceb-4dfc-8c50-d74f222fa21b" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:40:13 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-bef2a58d-86f6-42af-ae28-b1c2776f8961 tempest-TestStampPattern-1781671338 None] Lock "cinder-quobyte-b55b5f69-5ceb-4dfc-8c50-d74f222fa21b" acquired by "delete_volume" :: waited 0.015s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:40:13 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[87669d6b-31ed-4deb-81ec-a664d4c6fbd5]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:40:13 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-bef2a58d-86f6-42af-ae28-b1c2776f8961 tempest-TestStampPattern-1781671338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b55b5f69-5ceb-4dfc-8c50-d74f222fa21b {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:40:13 devstack sudo[113149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b55b5f69-5ceb-4dfc-8c50-d74f222fa21b Aug 26 14:40:13 devstack sudo[113149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:40:14 devstack sudo[113149]: pam_unix(sudo:session): session closed for user root Aug 26 14:40:14 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-bef2a58d-86f6-42af-ae28-b1c2776f8961 tempest-TestStampPattern-1781671338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b55b5f69-5ceb-4dfc-8c50-d74f222fa21b" returned: 0 in 0.356s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:40:14 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-bef2a58d-86f6-42af-ae28-b1c2776f8961 tempest-TestStampPattern-1781671338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b55b5f69-5ceb-4dfc-8c50-d74f222fa21b {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:40:14 devstack sudo[113154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b55b5f69-5ceb-4dfc-8c50-d74f222fa21b Aug 26 14:40:14 devstack sudo[113154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:40:14 devstack sudo[113154]: pam_unix(sudo:session): session closed for user root Aug 26 14:40:14 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-bef2a58d-86f6-42af-ae28-b1c2776f8961 tempest-TestStampPattern-1781671338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b55b5f69-5ceb-4dfc-8c50-d74f222fa21b" returned: 0 in 0.242s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:40:14 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-bef2a58d-86f6-42af-ae28-b1c2776f8961 tempest-TestStampPattern-1781671338 None] Lock "cinder-quobyte-b55b5f69-5ceb-4dfc-8c50-d74f222fa21b" released by "delete_volume" :: held 0.652s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:40:14 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-bef2a58d-86f6-42af-ae28-b1c2776f8961 tempest-TestStampPattern-1781671338 None] Created reservations ['18e66e78-7c67-4578-9665-8e7d2e6539dd', 'f193f81c-680d-451e-94ba-6819a0c26649', '08fdfe59-54d7-4fa1-a021-1ee2929dd10e', '63b7f46f-d85b-456e-b8ba-161820d4fc20'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:40:14 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-bef2a58d-86f6-42af-ae28-b1c2776f8961 tempest-TestStampPattern-1781671338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:40:14 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-bef2a58d-86f6-42af-ae28-b1c2776f8961 tempest-TestStampPattern-1781671338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:40:14 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-bef2a58d-86f6-42af-ae28-b1c2776f8961 tempest-TestStampPattern-1781671338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:40:14 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-bef2a58d-86f6-42af-ae28-b1c2776f8961 tempest-TestStampPattern-1781671338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:40:14 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-bef2a58d-86f6-42af-ae28-b1c2776f8961 tempest-TestStampPattern-1781671338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:40:14 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-bef2a58d-86f6-42af-ae28-b1c2776f8961 tempest-TestStampPattern-1781671338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:40:14 devstack sudo[113157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:40:14 devstack sudo[113157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:40:14 devstack sudo[113157]: pam_unix(sudo:session): session closed for user root Aug 26 14:40:14 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-bef2a58d-86f6-42af-ae28-b1c2776f8961 tempest-TestStampPattern-1781671338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.240s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:40:14 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-bef2a58d-86f6-42af-ae28-b1c2776f8961 tempest-TestStampPattern-1781671338 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:40:14 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-bef2a58d-86f6-42af-ae28-b1c2776f8961 tempest-TestStampPattern-1781671338 None] Deleted volume successfully. Aug 26 14:40:14 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-bef2a58d-86f6-42af-ae28-b1c2776f8961 tempest-TestStampPattern-1781671338 None] Lock "cinder-b55b5f69-5ceb-4dfc-8c50-d74f222fa21b-delete_volume" released by "delete_volume" :: held 1.079s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:40:24 devstack cinder-volume[94394]: DEBUG dbcounter [-] [94394] Writing DB stats cinder:SELECT=24,cinder:UPDATE=22,cinder:INSERT=6 {{(pid=94394) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 14:40:24 devstack cinder-volume[94394]: DEBUG dbcounter [-] [94394] Writing DB stats cinder:SELECT=22,cinder:UPDATE=24,cinder:INSERT=6,cinder:DELETE=2 {{(pid=94394) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 14:40:25 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-19517b13-f3a7-469f-a978-4fe3784b5567 tempest-CreateVolumesFromImageTest-804938514 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:40:25 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-19517b13-f3a7-469f-a978-4fe3784b5567 tempest-CreateVolumesFromImageTest-804938514 None] Flow 'volume_create_manager' (d5bb823b-5c60-4df8-b5c4-7167aa7a9c5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:40:25 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-19517b13-f3a7-469f-a978-4fe3784b5567 tempest-CreateVolumesFromImageTest-804938514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a6e13d2-c7c1-478f-b5a3-7ecefc0fcf7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:40:25 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-19517b13-f3a7-469f-a978-4fe3784b5567 tempest-CreateVolumesFromImageTest-804938514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a6e13d2-c7c1-478f-b5a3-7ecefc0fcf7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:40:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1554904450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a905e47-f12c-441e-9f60-e2083b0e12fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0659460e87af4ceeb20f3709341865fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:40:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:40:25Z,use_quota=True,user_id='b525b0361ae549d18cc681d3c012edfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:40:25 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-19517b13-f3a7-469f-a978-4fe3784b5567 tempest-CreateVolumesFromImageTest-804938514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6e54aa3-22ce-47ae-b7af-2117d6f68045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:40:25 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-19517b13-f3a7-469f-a978-4fe3784b5567 tempest-CreateVolumesFromImageTest-804938514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6e54aa3-22ce-47ae-b7af-2117d6f68045) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:40:25 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-19517b13-f3a7-469f-a978-4fe3784b5567 tempest-CreateVolumesFromImageTest-804938514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64a9b74d-0c71-4dce-9973-ca80627652c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:40:25 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-19517b13-f3a7-469f-a978-4fe3784b5567 tempest-CreateVolumesFromImageTest-804938514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64a9b74d-0c71-4dce-9973-ca80627652c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a905e47-f12c-441e-9f60-e2083b0e12fe', 'volume_name': 'volume-6a905e47-f12c-441e-9f60-e2083b0e12fe', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:40:25 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-19517b13-f3a7-469f-a978-4fe3784b5567 tempest-CreateVolumesFromImageTest-804938514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e52847ea-787f-486b-926c-def822bd8c51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:40:25 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-19517b13-f3a7-469f-a978-4fe3784b5567 tempest-CreateVolumesFromImageTest-804938514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e52847ea-787f-486b-926c-def822bd8c51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:40:25 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-19517b13-f3a7-469f-a978-4fe3784b5567 tempest-CreateVolumesFromImageTest-804938514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a0fd86c-4d34-4881-8ff9-056eebd2cd2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:40:25 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-19517b13-f3a7-469f-a978-4fe3784b5567 tempest-CreateVolumesFromImageTest-804938514 None] Volume 6a905e47-f12c-441e-9f60-e2083b0e12fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a905e47-f12c-441e-9f60-e2083b0e12fe', 'volume_size': 1} Aug 26 14:40:25 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-19517b13-f3a7-469f-a978-4fe3784b5567 tempest-CreateVolumesFromImageTest-804938514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:40:25 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-19517b13-f3a7-469f-a978-4fe3784b5567 tempest-CreateVolumesFromImageTest-804938514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:40:25 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-19517b13-f3a7-469f-a978-4fe3784b5567 tempest-CreateVolumesFromImageTest-804938514 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:40:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1554904450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a905e47-f12c-441e-9f60-e2083b0e12fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0659460e87af4ceeb20f3709341865fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:40:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:40:25Z,use_quota=True,user_id='b525b0361ae549d18cc681d3c012edfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:40:25 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-19517b13-f3a7-469f-a978-4fe3784b5567 tempest-CreateVolumesFromImageTest-804938514 None] Creating volume 6a905e47-f12c-441e-9f60-e2083b0e12fe {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:40:25 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-19517b13-f3a7-469f-a978-4fe3784b5567 tempest-CreateVolumesFromImageTest-804938514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:40:25 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-19517b13-f3a7-469f-a978-4fe3784b5567 tempest-CreateVolumesFromImageTest-804938514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:40:25 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-19517b13-f3a7-469f-a978-4fe3784b5567 tempest-CreateVolumesFromImageTest-804938514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:40:25 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-19517b13-f3a7-469f-a978-4fe3784b5567 tempest-CreateVolumesFromImageTest-804938514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:40:25 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-19517b13-f3a7-469f-a978-4fe3784b5567 tempest-CreateVolumesFromImageTest-804938514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:40:25 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-19517b13-f3a7-469f-a978-4fe3784b5567 tempest-CreateVolumesFromImageTest-804938514 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:40:25 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-19517b13-f3a7-469f-a978-4fe3784b5567 tempest-CreateVolumesFromImageTest-804938514 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:40:25 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-19517b13-f3a7-469f-a978-4fe3784b5567 tempest-CreateVolumesFromImageTest-804938514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6a905e47-f12c-441e-9f60-e2083b0e12fe 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:40:25 devstack sudo[113170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6a905e47-f12c-441e-9f60-e2083b0e12fe 1073741824 Aug 26 14:40:25 devstack sudo[113170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:40:25 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-35bfd565-be7b-4455-ab80-bfc293c9d54c tempest-CreateVolumesFromImageTest-804938514 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:40:25 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-35bfd565-be7b-4455-ab80-bfc293c9d54c tempest-CreateVolumesFromImageTest-804938514 None] Flow 'volume_create_manager' (7e1ce14d-829f-4b21-a673-95085a543673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:40:25 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-35bfd565-be7b-4455-ab80-bfc293c9d54c tempest-CreateVolumesFromImageTest-804938514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e869f289-e85c-4a77-89b6-f67b986efff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:40:25 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-35bfd565-be7b-4455-ab80-bfc293c9d54c tempest-CreateVolumesFromImageTest-804938514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e869f289-e85c-4a77-89b6-f67b986efff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:40:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-359241752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a94b02a6-64a9-4195-937f-84372b702e3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0659460e87af4ceeb20f3709341865fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:40:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:40:26Z,use_quota=True,user_id='b525b0361ae549d18cc681d3c012edfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:40:25 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-35bfd565-be7b-4455-ab80-bfc293c9d54c tempest-CreateVolumesFromImageTest-804938514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18709182-ea2e-4c15-af4a-cec5df973a32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:40:25 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-35bfd565-be7b-4455-ab80-bfc293c9d54c tempest-CreateVolumesFromImageTest-804938514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18709182-ea2e-4c15-af4a-cec5df973a32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:40:25 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-35bfd565-be7b-4455-ab80-bfc293c9d54c tempest-CreateVolumesFromImageTest-804938514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7e216af-f877-45e8-979b-5a2821fe0c7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:40:25 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-35bfd565-be7b-4455-ab80-bfc293c9d54c tempest-CreateVolumesFromImageTest-804938514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7e216af-f877-45e8-979b-5a2821fe0c7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a94b02a6-64a9-4195-937f-84372b702e3a', 'volume_name': 'volume-a94b02a6-64a9-4195-937f-84372b702e3a', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:40:25 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-35bfd565-be7b-4455-ab80-bfc293c9d54c tempest-CreateVolumesFromImageTest-804938514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc1bf5fc-b13b-4c4f-b1b4-e2fbe6ed9a7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:40:25 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-35bfd565-be7b-4455-ab80-bfc293c9d54c tempest-CreateVolumesFromImageTest-804938514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc1bf5fc-b13b-4c4f-b1b4-e2fbe6ed9a7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:40:25 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-35bfd565-be7b-4455-ab80-bfc293c9d54c tempest-CreateVolumesFromImageTest-804938514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25d70862-0998-421d-bd5b-3a95c02e957a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:40:25 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-35bfd565-be7b-4455-ab80-bfc293c9d54c tempest-CreateVolumesFromImageTest-804938514 None] Volume a94b02a6-64a9-4195-937f-84372b702e3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a94b02a6-64a9-4195-937f-84372b702e3a', 'volume_size': 1} Aug 26 14:40:25 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-35bfd565-be7b-4455-ab80-bfc293c9d54c tempest-CreateVolumesFromImageTest-804938514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:40:26 devstack sudo[113170]: pam_unix(sudo:session): session closed for user root Aug 26 14:40:26 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-19517b13-f3a7-469f-a978-4fe3784b5567 tempest-CreateVolumesFromImageTest-804938514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6a905e47-f12c-441e-9f60-e2083b0e12fe 1073741824" returned: 0 in 0.472s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:40:26 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-19517b13-f3a7-469f-a978-4fe3784b5567 tempest-CreateVolumesFromImageTest-804938514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6a905e47-f12c-441e-9f60-e2083b0e12fe {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:40:26 devstack sudo[113176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6a905e47-f12c-441e-9f60-e2083b0e12fe Aug 26 14:40:26 devstack sudo[113176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:40:26 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-af81e024-2c84-40b5-9578-037277e1bc12 tempest-CreateVolumesFromImageTest-804938514 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:40:26 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-af81e024-2c84-40b5-9578-037277e1bc12 tempest-CreateVolumesFromImageTest-804938514 None] Flow 'volume_create_manager' (31815ec4-779e-40a8-9b05-50d91065df7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:40:26 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-af81e024-2c84-40b5-9578-037277e1bc12 tempest-CreateVolumesFromImageTest-804938514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc3b892c-fcb5-4902-99c0-03346f302519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:40:26 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-af81e024-2c84-40b5-9578-037277e1bc12 tempest-CreateVolumesFromImageTest-804938514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc3b892c-fcb5-4902-99c0-03346f302519) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:40:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1020899888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1924558-d9da-4154-8ddf-d5fa6798fe75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0659460e87af4ceeb20f3709341865fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:40:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:40:26Z,use_quota=True,user_id='b525b0361ae549d18cc681d3c012edfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:40:26 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-af81e024-2c84-40b5-9578-037277e1bc12 tempest-CreateVolumesFromImageTest-804938514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fa5dd45-c61d-4f24-8666-619dfc00c6b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:40:26 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-af81e024-2c84-40b5-9578-037277e1bc12 tempest-CreateVolumesFromImageTest-804938514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fa5dd45-c61d-4f24-8666-619dfc00c6b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:40:26 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-af81e024-2c84-40b5-9578-037277e1bc12 tempest-CreateVolumesFromImageTest-804938514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fb42a50-d721-48d4-aa20-77fc8c32b5b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:40:26 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-af81e024-2c84-40b5-9578-037277e1bc12 tempest-CreateVolumesFromImageTest-804938514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fb42a50-d721-48d4-aa20-77fc8c32b5b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1924558-d9da-4154-8ddf-d5fa6798fe75', 'volume_name': 'volume-e1924558-d9da-4154-8ddf-d5fa6798fe75', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:40:26 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-af81e024-2c84-40b5-9578-037277e1bc12 tempest-CreateVolumesFromImageTest-804938514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (293e455e-196d-42d4-973e-e916af4d2839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:40:26 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-af81e024-2c84-40b5-9578-037277e1bc12 tempest-CreateVolumesFromImageTest-804938514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (293e455e-196d-42d4-973e-e916af4d2839) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:40:26 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-af81e024-2c84-40b5-9578-037277e1bc12 tempest-CreateVolumesFromImageTest-804938514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c8493e1-8763-4382-8275-c2ff79a4d4ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:40:26 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-af81e024-2c84-40b5-9578-037277e1bc12 tempest-CreateVolumesFromImageTest-804938514 None] Volume e1924558-d9da-4154-8ddf-d5fa6798fe75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1924558-d9da-4154-8ddf-d5fa6798fe75', 'volume_size': 1} Aug 26 14:40:26 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-af81e024-2c84-40b5-9578-037277e1bc12 tempest-CreateVolumesFromImageTest-804938514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:40:26 devstack sudo[113176]: pam_unix(sudo:session): session closed for user root Aug 26 14:40:26 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-19517b13-f3a7-469f-a978-4fe3784b5567 tempest-CreateVolumesFromImageTest-804938514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6a905e47-f12c-441e-9f60-e2083b0e12fe" returned: 0 in 0.273s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:40:26 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-19517b13-f3a7-469f-a978-4fe3784b5567 tempest-CreateVolumesFromImageTest-804938514 None] <== create_volume: return (792ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:40:26 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-19517b13-f3a7-469f-a978-4fe3784b5567 tempest-CreateVolumesFromImageTest-804938514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.795s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:40:26 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-35bfd565-be7b-4455-ab80-bfc293c9d54c tempest-CreateVolumesFromImageTest-804938514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.424s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:40:26 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-35bfd565-be7b-4455-ab80-bfc293c9d54c tempest-CreateVolumesFromImageTest-804938514 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:40:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-359241752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a94b02a6-64a9-4195-937f-84372b702e3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0659460e87af4ceeb20f3709341865fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:40:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:40:26Z,use_quota=True,user_id='b525b0361ae549d18cc681d3c012edfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:40:26 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-35bfd565-be7b-4455-ab80-bfc293c9d54c tempest-CreateVolumesFromImageTest-804938514 None] Creating volume a94b02a6-64a9-4195-937f-84372b702e3a {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:40:26 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-35bfd565-be7b-4455-ab80-bfc293c9d54c tempest-CreateVolumesFromImageTest-804938514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:40:26 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-35bfd565-be7b-4455-ab80-bfc293c9d54c tempest-CreateVolumesFromImageTest-804938514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:40:26 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-35bfd565-be7b-4455-ab80-bfc293c9d54c tempest-CreateVolumesFromImageTest-804938514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:40:26 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-35bfd565-be7b-4455-ab80-bfc293c9d54c tempest-CreateVolumesFromImageTest-804938514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:40:26 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-35bfd565-be7b-4455-ab80-bfc293c9d54c tempest-CreateVolumesFromImageTest-804938514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:40:26 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-35bfd565-be7b-4455-ab80-bfc293c9d54c tempest-CreateVolumesFromImageTest-804938514 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:40:26 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-35bfd565-be7b-4455-ab80-bfc293c9d54c tempest-CreateVolumesFromImageTest-804938514 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:40:26 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-35bfd565-be7b-4455-ab80-bfc293c9d54c tempest-CreateVolumesFromImageTest-804938514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-a94b02a6-64a9-4195-937f-84372b702e3a 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:40:26 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-19517b13-f3a7-469f-a978-4fe3784b5567 tempest-CreateVolumesFromImageTest-804938514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a0fd86c-4d34-4881-8ff9-056eebd2cd2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a905e47-f12c-441e-9f60-e2083b0e12fe', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:40:26 devstack sudo[113179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-a94b02a6-64a9-4195-937f-84372b702e3a 1073741824 Aug 26 14:40:26 devstack sudo[113179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:40:26 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-19517b13-f3a7-469f-a978-4fe3784b5567 tempest-CreateVolumesFromImageTest-804938514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70482ded-0034-44ed-bf48-0a6189874fb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:40:26 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-19517b13-f3a7-469f-a978-4fe3784b5567 tempest-CreateVolumesFromImageTest-804938514 None] Volume volume-6a905e47-f12c-441e-9f60-e2083b0e12fe (6a905e47-f12c-441e-9f60-e2083b0e12fe): created successfully Aug 26 14:40:26 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-19517b13-f3a7-469f-a978-4fe3784b5567 tempest-CreateVolumesFromImageTest-804938514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70482ded-0034-44ed-bf48-0a6189874fb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:40:26 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-19517b13-f3a7-469f-a978-4fe3784b5567 tempest-CreateVolumesFromImageTest-804938514 None] Flow 'volume_create_manager' (d5bb823b-5c60-4df8-b5c4-7167aa7a9c5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:40:26 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-19517b13-f3a7-469f-a978-4fe3784b5567 tempest-CreateVolumesFromImageTest-804938514 None] Created volume successfully. Aug 26 14:40:26 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-699775e3-2ad0-41e1-bc9b-55aaa273d0ef tempest-CreateVolumesFromImageTest-804938514 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:40:26 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-699775e3-2ad0-41e1-bc9b-55aaa273d0ef tempest-CreateVolumesFromImageTest-804938514 None] Flow 'volume_create_manager' (4f1f4d86-0230-4c29-815c-00fcb3d04713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:40:26 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-699775e3-2ad0-41e1-bc9b-55aaa273d0ef tempest-CreateVolumesFromImageTest-804938514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e6f1767-4141-4e19-a7cb-d8a2ed50ed0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:40:26 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-699775e3-2ad0-41e1-bc9b-55aaa273d0ef tempest-CreateVolumesFromImageTest-804938514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e6f1767-4141-4e19-a7cb-d8a2ed50ed0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:40:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-632703516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94adbae9-fd69-40af-bd1b-0c87d0f6eb17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0659460e87af4ceeb20f3709341865fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:40:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:40:26Z,use_quota=True,user_id='b525b0361ae549d18cc681d3c012edfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:40:26 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-699775e3-2ad0-41e1-bc9b-55aaa273d0ef tempest-CreateVolumesFromImageTest-804938514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb05eed8-22cc-4ff7-b9ed-4c2ef6d7adf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:40:26 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-699775e3-2ad0-41e1-bc9b-55aaa273d0ef tempest-CreateVolumesFromImageTest-804938514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb05eed8-22cc-4ff7-b9ed-4c2ef6d7adf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:40:26 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-699775e3-2ad0-41e1-bc9b-55aaa273d0ef tempest-CreateVolumesFromImageTest-804938514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5d9afbe-f9f7-4f87-b842-8c77daab34f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:40:26 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-699775e3-2ad0-41e1-bc9b-55aaa273d0ef tempest-CreateVolumesFromImageTest-804938514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5d9afbe-f9f7-4f87-b842-8c77daab34f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94adbae9-fd69-40af-bd1b-0c87d0f6eb17', 'volume_name': 'volume-94adbae9-fd69-40af-bd1b-0c87d0f6eb17', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:40:26 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-699775e3-2ad0-41e1-bc9b-55aaa273d0ef tempest-CreateVolumesFromImageTest-804938514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (218207c7-83da-4599-bfbe-d2e0402d9184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:40:26 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-699775e3-2ad0-41e1-bc9b-55aaa273d0ef tempest-CreateVolumesFromImageTest-804938514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (218207c7-83da-4599-bfbe-d2e0402d9184) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:40:26 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-699775e3-2ad0-41e1-bc9b-55aaa273d0ef tempest-CreateVolumesFromImageTest-804938514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6d3c1fe-19d9-407f-aecb-e0c2a530eab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:40:26 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-699775e3-2ad0-41e1-bc9b-55aaa273d0ef tempest-CreateVolumesFromImageTest-804938514 None] Volume 94adbae9-fd69-40af-bd1b-0c87d0f6eb17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94adbae9-fd69-40af-bd1b-0c87d0f6eb17', 'volume_size': 1} Aug 26 14:40:26 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-699775e3-2ad0-41e1-bc9b-55aaa273d0ef tempest-CreateVolumesFromImageTest-804938514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:40:26 devstack sudo[113179]: pam_unix(sudo:session): session closed for user root Aug 26 14:40:26 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-35bfd565-be7b-4455-ab80-bfc293c9d54c tempest-CreateVolumesFromImageTest-804938514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-a94b02a6-64a9-4195-937f-84372b702e3a 1073741824" returned: 0 in 0.490s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:40:26 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-08335c98-7458-49cf-81e6-a4bc33c40e69 tempest-CreateVolumesFromImageTest-804938514 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:40:26 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-08335c98-7458-49cf-81e6-a4bc33c40e69 tempest-CreateVolumesFromImageTest-804938514 None] Flow 'volume_create_manager' (4db35502-eed8-4649-a854-ee97129f2cff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:40:26 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-08335c98-7458-49cf-81e6-a4bc33c40e69 tempest-CreateVolumesFromImageTest-804938514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80c23503-1605-408c-a4ca-92b1240fe9ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:40:26 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-35bfd565-be7b-4455-ab80-bfc293c9d54c tempest-CreateVolumesFromImageTest-804938514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-a94b02a6-64a9-4195-937f-84372b702e3a {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:40:26 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-08335c98-7458-49cf-81e6-a4bc33c40e69 tempest-CreateVolumesFromImageTest-804938514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80c23503-1605-408c-a4ca-92b1240fe9ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:40:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2139023393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e710f4c-7f82-440f-9dd1-610dc4affe24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0659460e87af4ceeb20f3709341865fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:40:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:40:27Z,use_quota=True,user_id='b525b0361ae549d18cc681d3c012edfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:40:26 devstack sudo[113185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-a94b02a6-64a9-4195-937f-84372b702e3a Aug 26 14:40:26 devstack sudo[113185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:40:26 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-08335c98-7458-49cf-81e6-a4bc33c40e69 tempest-CreateVolumesFromImageTest-804938514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5fe1126-4334-41cc-abb0-398664a9ba64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:40:26 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-08335c98-7458-49cf-81e6-a4bc33c40e69 tempest-CreateVolumesFromImageTest-804938514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5fe1126-4334-41cc-abb0-398664a9ba64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:40:26 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-08335c98-7458-49cf-81e6-a4bc33c40e69 tempest-CreateVolumesFromImageTest-804938514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff137d05-1d37-47fe-8fac-f6514ed799e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:40:26 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-08335c98-7458-49cf-81e6-a4bc33c40e69 tempest-CreateVolumesFromImageTest-804938514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff137d05-1d37-47fe-8fac-f6514ed799e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e710f4c-7f82-440f-9dd1-610dc4affe24', 'volume_name': 'volume-1e710f4c-7f82-440f-9dd1-610dc4affe24', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:40:26 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-08335c98-7458-49cf-81e6-a4bc33c40e69 tempest-CreateVolumesFromImageTest-804938514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8f5c57e-d377-4c37-b81d-b3890237b14b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:40:26 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-08335c98-7458-49cf-81e6-a4bc33c40e69 tempest-CreateVolumesFromImageTest-804938514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8f5c57e-d377-4c37-b81d-b3890237b14b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:40:26 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-08335c98-7458-49cf-81e6-a4bc33c40e69 tempest-CreateVolumesFromImageTest-804938514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a70096b-8e2e-4a94-bc28-5fa83f3e6571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:40:26 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-08335c98-7458-49cf-81e6-a4bc33c40e69 tempest-CreateVolumesFromImageTest-804938514 None] Volume 1e710f4c-7f82-440f-9dd1-610dc4affe24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e710f4c-7f82-440f-9dd1-610dc4affe24', 'volume_size': 1} Aug 26 14:40:26 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-08335c98-7458-49cf-81e6-a4bc33c40e69 tempest-CreateVolumesFromImageTest-804938514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:40:27 devstack sudo[113185]: pam_unix(sudo:session): session closed for user root Aug 26 14:40:27 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-35bfd565-be7b-4455-ab80-bfc293c9d54c tempest-CreateVolumesFromImageTest-804938514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-a94b02a6-64a9-4195-937f-84372b702e3a" returned: 0 in 0.244s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:40:27 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-35bfd565-be7b-4455-ab80-bfc293c9d54c tempest-CreateVolumesFromImageTest-804938514 None] <== create_volume: return (811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:40:27 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-35bfd565-be7b-4455-ab80-bfc293c9d54c tempest-CreateVolumesFromImageTest-804938514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.814s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:40:27 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-af81e024-2c84-40b5-9578-037277e1bc12 tempest-CreateVolumesFromImageTest-804938514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.900s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:40:27 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-af81e024-2c84-40b5-9578-037277e1bc12 tempest-CreateVolumesFromImageTest-804938514 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:40:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1020899888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1924558-d9da-4154-8ddf-d5fa6798fe75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0659460e87af4ceeb20f3709341865fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:40:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:40:26Z,use_quota=True,user_id='b525b0361ae549d18cc681d3c012edfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:40:27 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-af81e024-2c84-40b5-9578-037277e1bc12 tempest-CreateVolumesFromImageTest-804938514 None] Creating volume e1924558-d9da-4154-8ddf-d5fa6798fe75 {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:40:27 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-af81e024-2c84-40b5-9578-037277e1bc12 tempest-CreateVolumesFromImageTest-804938514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:40:27 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-af81e024-2c84-40b5-9578-037277e1bc12 tempest-CreateVolumesFromImageTest-804938514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:40:27 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-af81e024-2c84-40b5-9578-037277e1bc12 tempest-CreateVolumesFromImageTest-804938514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:40:27 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-af81e024-2c84-40b5-9578-037277e1bc12 tempest-CreateVolumesFromImageTest-804938514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:40:27 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-af81e024-2c84-40b5-9578-037277e1bc12 tempest-CreateVolumesFromImageTest-804938514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:40:27 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-af81e024-2c84-40b5-9578-037277e1bc12 tempest-CreateVolumesFromImageTest-804938514 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:40:27 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-af81e024-2c84-40b5-9578-037277e1bc12 tempest-CreateVolumesFromImageTest-804938514 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:40:27 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-af81e024-2c84-40b5-9578-037277e1bc12 tempest-CreateVolumesFromImageTest-804938514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-e1924558-d9da-4154-8ddf-d5fa6798fe75 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:40:27 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-35bfd565-be7b-4455-ab80-bfc293c9d54c tempest-CreateVolumesFromImageTest-804938514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25d70862-0998-421d-bd5b-3a95c02e957a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a94b02a6-64a9-4195-937f-84372b702e3a', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:40:27 devstack sudo[113188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-e1924558-d9da-4154-8ddf-d5fa6798fe75 1073741824 Aug 26 14:40:27 devstack sudo[113188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:40:27 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-35bfd565-be7b-4455-ab80-bfc293c9d54c tempest-CreateVolumesFromImageTest-804938514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6feda74c-26aa-47d0-96f0-f65534bf5272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:40:27 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-35bfd565-be7b-4455-ab80-bfc293c9d54c tempest-CreateVolumesFromImageTest-804938514 None] Volume volume-a94b02a6-64a9-4195-937f-84372b702e3a (a94b02a6-64a9-4195-937f-84372b702e3a): created successfully Aug 26 14:40:27 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-35bfd565-be7b-4455-ab80-bfc293c9d54c tempest-CreateVolumesFromImageTest-804938514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6feda74c-26aa-47d0-96f0-f65534bf5272) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:40:27 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-35bfd565-be7b-4455-ab80-bfc293c9d54c tempest-CreateVolumesFromImageTest-804938514 None] Flow 'volume_create_manager' (7e1ce14d-829f-4b21-a673-95085a543673) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:40:27 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-35bfd565-be7b-4455-ab80-bfc293c9d54c tempest-CreateVolumesFromImageTest-804938514 None] Created volume successfully. Aug 26 14:40:27 devstack sudo[113188]: pam_unix(sudo:session): session closed for user root Aug 26 14:40:27 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-af81e024-2c84-40b5-9578-037277e1bc12 tempest-CreateVolumesFromImageTest-804938514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-e1924558-d9da-4154-8ddf-d5fa6798fe75 1073741824" returned: 0 in 0.408s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:40:27 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-af81e024-2c84-40b5-9578-037277e1bc12 tempest-CreateVolumesFromImageTest-804938514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-e1924558-d9da-4154-8ddf-d5fa6798fe75 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:40:27 devstack sudo[113194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-e1924558-d9da-4154-8ddf-d5fa6798fe75 Aug 26 14:40:27 devstack sudo[113194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:40:27 devstack sudo[113194]: pam_unix(sudo:session): session closed for user root Aug 26 14:40:27 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-af81e024-2c84-40b5-9578-037277e1bc12 tempest-CreateVolumesFromImageTest-804938514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-e1924558-d9da-4154-8ddf-d5fa6798fe75" returned: 0 in 0.236s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:40:27 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-af81e024-2c84-40b5-9578-037277e1bc12 tempest-CreateVolumesFromImageTest-804938514 None] <== create_volume: return (678ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:40:27 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-af81e024-2c84-40b5-9578-037277e1bc12 tempest-CreateVolumesFromImageTest-804938514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.681s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:40:27 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-699775e3-2ad0-41e1-bc9b-55aaa273d0ef tempest-CreateVolumesFromImageTest-804938514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.258s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:40:27 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-699775e3-2ad0-41e1-bc9b-55aaa273d0ef tempest-CreateVolumesFromImageTest-804938514 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:40:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-632703516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94adbae9-fd69-40af-bd1b-0c87d0f6eb17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0659460e87af4ceeb20f3709341865fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:40:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:40:26Z,use_quota=True,user_id='b525b0361ae549d18cc681d3c012edfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:40:27 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-699775e3-2ad0-41e1-bc9b-55aaa273d0ef tempest-CreateVolumesFromImageTest-804938514 None] Creating volume 94adbae9-fd69-40af-bd1b-0c87d0f6eb17 {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:40:27 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-699775e3-2ad0-41e1-bc9b-55aaa273d0ef tempest-CreateVolumesFromImageTest-804938514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:40:27 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-699775e3-2ad0-41e1-bc9b-55aaa273d0ef tempest-CreateVolumesFromImageTest-804938514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:40:27 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-699775e3-2ad0-41e1-bc9b-55aaa273d0ef tempest-CreateVolumesFromImageTest-804938514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:40:27 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-699775e3-2ad0-41e1-bc9b-55aaa273d0ef tempest-CreateVolumesFromImageTest-804938514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:40:27 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-699775e3-2ad0-41e1-bc9b-55aaa273d0ef tempest-CreateVolumesFromImageTest-804938514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:40:27 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-699775e3-2ad0-41e1-bc9b-55aaa273d0ef tempest-CreateVolumesFromImageTest-804938514 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:40:27 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-699775e3-2ad0-41e1-bc9b-55aaa273d0ef tempest-CreateVolumesFromImageTest-804938514 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:40:27 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-699775e3-2ad0-41e1-bc9b-55aaa273d0ef tempest-CreateVolumesFromImageTest-804938514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-94adbae9-fd69-40af-bd1b-0c87d0f6eb17 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:40:27 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-af81e024-2c84-40b5-9578-037277e1bc12 tempest-CreateVolumesFromImageTest-804938514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c8493e1-8763-4382-8275-c2ff79a4d4ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1924558-d9da-4154-8ddf-d5fa6798fe75', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:40:27 devstack sudo[113197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-94adbae9-fd69-40af-bd1b-0c87d0f6eb17 1073741824 Aug 26 14:40:27 devstack sudo[113197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:40:27 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-af81e024-2c84-40b5-9578-037277e1bc12 tempest-CreateVolumesFromImageTest-804938514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34152fe0-0809-4ea6-bfc5-d493bdb16ec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:40:27 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-af81e024-2c84-40b5-9578-037277e1bc12 tempest-CreateVolumesFromImageTest-804938514 None] Volume volume-e1924558-d9da-4154-8ddf-d5fa6798fe75 (e1924558-d9da-4154-8ddf-d5fa6798fe75): created successfully Aug 26 14:40:27 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-af81e024-2c84-40b5-9578-037277e1bc12 tempest-CreateVolumesFromImageTest-804938514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34152fe0-0809-4ea6-bfc5-d493bdb16ec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:40:27 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-af81e024-2c84-40b5-9578-037277e1bc12 tempest-CreateVolumesFromImageTest-804938514 None] Flow 'volume_create_manager' (31815ec4-779e-40a8-9b05-50d91065df7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:40:27 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-af81e024-2c84-40b5-9578-037277e1bc12 tempest-CreateVolumesFromImageTest-804938514 None] Created volume successfully. Aug 26 14:40:28 devstack sudo[113197]: pam_unix(sudo:session): session closed for user root Aug 26 14:40:28 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-699775e3-2ad0-41e1-bc9b-55aaa273d0ef tempest-CreateVolumesFromImageTest-804938514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-94adbae9-fd69-40af-bd1b-0c87d0f6eb17 1073741824" returned: 0 in 0.403s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:40:28 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-699775e3-2ad0-41e1-bc9b-55aaa273d0ef tempest-CreateVolumesFromImageTest-804938514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-94adbae9-fd69-40af-bd1b-0c87d0f6eb17 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:40:28 devstack sudo[113203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-94adbae9-fd69-40af-bd1b-0c87d0f6eb17 Aug 26 14:40:28 devstack sudo[113203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:40:28 devstack sudo[113203]: pam_unix(sudo:session): session closed for user root Aug 26 14:40:28 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-699775e3-2ad0-41e1-bc9b-55aaa273d0ef tempest-CreateVolumesFromImageTest-804938514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-94adbae9-fd69-40af-bd1b-0c87d0f6eb17" returned: 0 in 0.238s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:40:28 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-699775e3-2ad0-41e1-bc9b-55aaa273d0ef tempest-CreateVolumesFromImageTest-804938514 None] <== create_volume: return (676ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:40:28 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-699775e3-2ad0-41e1-bc9b-55aaa273d0ef tempest-CreateVolumesFromImageTest-804938514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.680s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:40:28 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-08335c98-7458-49cf-81e6-a4bc33c40e69 tempest-CreateVolumesFromImageTest-804938514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.554s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:40:28 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-08335c98-7458-49cf-81e6-a4bc33c40e69 tempest-CreateVolumesFromImageTest-804938514 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:40:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2139023393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e710f4c-7f82-440f-9dd1-610dc4affe24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0659460e87af4ceeb20f3709341865fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:40:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:40:27Z,use_quota=True,user_id='b525b0361ae549d18cc681d3c012edfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:40:28 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-08335c98-7458-49cf-81e6-a4bc33c40e69 tempest-CreateVolumesFromImageTest-804938514 None] Creating volume 1e710f4c-7f82-440f-9dd1-610dc4affe24 {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:40:28 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-08335c98-7458-49cf-81e6-a4bc33c40e69 tempest-CreateVolumesFromImageTest-804938514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:40:28 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-08335c98-7458-49cf-81e6-a4bc33c40e69 tempest-CreateVolumesFromImageTest-804938514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:40:28 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-08335c98-7458-49cf-81e6-a4bc33c40e69 tempest-CreateVolumesFromImageTest-804938514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:40:28 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-08335c98-7458-49cf-81e6-a4bc33c40e69 tempest-CreateVolumesFromImageTest-804938514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:40:28 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-08335c98-7458-49cf-81e6-a4bc33c40e69 tempest-CreateVolumesFromImageTest-804938514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:40:28 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-08335c98-7458-49cf-81e6-a4bc33c40e69 tempest-CreateVolumesFromImageTest-804938514 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:40:28 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-08335c98-7458-49cf-81e6-a4bc33c40e69 tempest-CreateVolumesFromImageTest-804938514 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:40:28 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-08335c98-7458-49cf-81e6-a4bc33c40e69 tempest-CreateVolumesFromImageTest-804938514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-1e710f4c-7f82-440f-9dd1-610dc4affe24 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:40:28 devstack sudo[113206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-1e710f4c-7f82-440f-9dd1-610dc4affe24 1073741824 Aug 26 14:40:28 devstack sudo[113206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:40:28 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-699775e3-2ad0-41e1-bc9b-55aaa273d0ef tempest-CreateVolumesFromImageTest-804938514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6d3c1fe-19d9-407f-aecb-e0c2a530eab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94adbae9-fd69-40af-bd1b-0c87d0f6eb17', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:40:28 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-699775e3-2ad0-41e1-bc9b-55aaa273d0ef tempest-CreateVolumesFromImageTest-804938514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da6ceb82-9976-4f7b-9c2e-2b6513af1254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:40:28 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-699775e3-2ad0-41e1-bc9b-55aaa273d0ef tempest-CreateVolumesFromImageTest-804938514 None] Volume volume-94adbae9-fd69-40af-bd1b-0c87d0f6eb17 (94adbae9-fd69-40af-bd1b-0c87d0f6eb17): created successfully Aug 26 14:40:28 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-699775e3-2ad0-41e1-bc9b-55aaa273d0ef tempest-CreateVolumesFromImageTest-804938514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da6ceb82-9976-4f7b-9c2e-2b6513af1254) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:40:28 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-699775e3-2ad0-41e1-bc9b-55aaa273d0ef tempest-CreateVolumesFromImageTest-804938514 None] Flow 'volume_create_manager' (4f1f4d86-0230-4c29-815c-00fcb3d04713) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:40:28 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-699775e3-2ad0-41e1-bc9b-55aaa273d0ef tempest-CreateVolumesFromImageTest-804938514 None] Created volume successfully. Aug 26 14:40:28 devstack sudo[113206]: pam_unix(sudo:session): session closed for user root Aug 26 14:40:28 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-08335c98-7458-49cf-81e6-a4bc33c40e69 tempest-CreateVolumesFromImageTest-804938514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-1e710f4c-7f82-440f-9dd1-610dc4affe24 1073741824" returned: 0 in 0.423s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:40:29 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-08335c98-7458-49cf-81e6-a4bc33c40e69 tempest-CreateVolumesFromImageTest-804938514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-1e710f4c-7f82-440f-9dd1-610dc4affe24 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:40:29 devstack sudo[113211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-1e710f4c-7f82-440f-9dd1-610dc4affe24 Aug 26 14:40:29 devstack sudo[113211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:40:29 devstack sudo[113211]: pam_unix(sudo:session): session closed for user root Aug 26 14:40:29 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-08335c98-7458-49cf-81e6-a4bc33c40e69 tempest-CreateVolumesFromImageTest-804938514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-1e710f4c-7f82-440f-9dd1-610dc4affe24" returned: 0 in 0.250s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:40:29 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-08335c98-7458-49cf-81e6-a4bc33c40e69 tempest-CreateVolumesFromImageTest-804938514 None] <== create_volume: return (720ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:40:29 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-08335c98-7458-49cf-81e6-a4bc33c40e69 tempest-CreateVolumesFromImageTest-804938514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.723s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:40:29 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-08335c98-7458-49cf-81e6-a4bc33c40e69 tempest-CreateVolumesFromImageTest-804938514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a70096b-8e2e-4a94-bc28-5fa83f3e6571) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e710f4c-7f82-440f-9dd1-610dc4affe24', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:40:29 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-08335c98-7458-49cf-81e6-a4bc33c40e69 tempest-CreateVolumesFromImageTest-804938514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fb7d767-fe38-4b7f-acbf-c184e9cf1760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:40:29 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-08335c98-7458-49cf-81e6-a4bc33c40e69 tempest-CreateVolumesFromImageTest-804938514 None] Volume volume-1e710f4c-7f82-440f-9dd1-610dc4affe24 (1e710f4c-7f82-440f-9dd1-610dc4affe24): created successfully Aug 26 14:40:29 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-08335c98-7458-49cf-81e6-a4bc33c40e69 tempest-CreateVolumesFromImageTest-804938514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fb7d767-fe38-4b7f-acbf-c184e9cf1760) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:40:29 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-08335c98-7458-49cf-81e6-a4bc33c40e69 tempest-CreateVolumesFromImageTest-804938514 None] Flow 'volume_create_manager' (4db35502-eed8-4649-a854-ee97129f2cff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:40:29 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-08335c98-7458-49cf-81e6-a4bc33c40e69 tempest-CreateVolumesFromImageTest-804938514 None] Created volume successfully. Aug 26 14:40:30 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-66720a01-417e-4394-bfee-681237fb9edf tempest-CreateVolumesFromImageTest-804938514 None] Acquiring lock "cinder-1e710f4c-7f82-440f-9dd1-610dc4affe24-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:40:30 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-66720a01-417e-4394-bfee-681237fb9edf tempest-CreateVolumesFromImageTest-804938514 None] Lock "cinder-1e710f4c-7f82-440f-9dd1-610dc4affe24-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:40:30 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-66720a01-417e-4394-bfee-681237fb9edf tempest-CreateVolumesFromImageTest-804938514 None] Acquiring lock "cinder-quobyte-1e710f4c-7f82-440f-9dd1-610dc4affe24" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:40:30 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-66720a01-417e-4394-bfee-681237fb9edf tempest-CreateVolumesFromImageTest-804938514 None] Lock "cinder-quobyte-1e710f4c-7f82-440f-9dd1-610dc4affe24" acquired by "delete_volume" :: waited 0.013s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:40:30 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1b7faeb-0c86-4cd4-a503-dee217e34ccb]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:40:30 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-66720a01-417e-4394-bfee-681237fb9edf tempest-CreateVolumesFromImageTest-804938514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-1e710f4c-7f82-440f-9dd1-610dc4affe24 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:40:30 devstack sudo[113214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-1e710f4c-7f82-440f-9dd1-610dc4affe24 Aug 26 14:40:30 devstack sudo[113214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:40:30 devstack sudo[113214]: pam_unix(sudo:session): session closed for user root Aug 26 14:40:30 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-66720a01-417e-4394-bfee-681237fb9edf tempest-CreateVolumesFromImageTest-804938514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-1e710f4c-7f82-440f-9dd1-610dc4affe24" returned: 0 in 0.341s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:40:30 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-66720a01-417e-4394-bfee-681237fb9edf tempest-CreateVolumesFromImageTest-804938514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-1e710f4c-7f82-440f-9dd1-610dc4affe24 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:40:30 devstack sudo[113220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-1e710f4c-7f82-440f-9dd1-610dc4affe24 Aug 26 14:40:30 devstack sudo[113220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:40:30 devstack sudo[113220]: pam_unix(sudo:session): session closed for user root Aug 26 14:40:30 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-66720a01-417e-4394-bfee-681237fb9edf tempest-CreateVolumesFromImageTest-804938514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-1e710f4c-7f82-440f-9dd1-610dc4affe24" returned: 0 in 0.243s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:40:30 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-66720a01-417e-4394-bfee-681237fb9edf tempest-CreateVolumesFromImageTest-804938514 None] Lock "cinder-quobyte-1e710f4c-7f82-440f-9dd1-610dc4affe24" released by "delete_volume" :: held 0.624s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:40:30 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-66720a01-417e-4394-bfee-681237fb9edf tempest-CreateVolumesFromImageTest-804938514 None] Created reservations ['86745aad-97a4-4234-af18-c21186b61def', '65149623-29c1-4465-a0b1-3c99ce534f69', '67ac9ec4-84b3-4774-9766-b99ec1ada8d0', 'c3b714a5-35b4-4c7f-985e-d839be39a2e9'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:40:31 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-66720a01-417e-4394-bfee-681237fb9edf tempest-CreateVolumesFromImageTest-804938514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:40:31 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-66720a01-417e-4394-bfee-681237fb9edf tempest-CreateVolumesFromImageTest-804938514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:40:31 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-66720a01-417e-4394-bfee-681237fb9edf tempest-CreateVolumesFromImageTest-804938514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:40:31 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-66720a01-417e-4394-bfee-681237fb9edf tempest-CreateVolumesFromImageTest-804938514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:40:31 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-66720a01-417e-4394-bfee-681237fb9edf tempest-CreateVolumesFromImageTest-804938514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:40:31 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-66720a01-417e-4394-bfee-681237fb9edf tempest-CreateVolumesFromImageTest-804938514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:40:31 devstack sudo[113223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:40:31 devstack sudo[113223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:40:31 devstack sudo[113223]: pam_unix(sudo:session): session closed for user root Aug 26 14:40:31 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-66720a01-417e-4394-bfee-681237fb9edf tempest-CreateVolumesFromImageTest-804938514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.240s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:40:31 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-66720a01-417e-4394-bfee-681237fb9edf tempest-CreateVolumesFromImageTest-804938514 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:40:31 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-66720a01-417e-4394-bfee-681237fb9edf tempest-CreateVolumesFromImageTest-804938514 None] Deleted volume successfully. Aug 26 14:40:31 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-66720a01-417e-4394-bfee-681237fb9edf tempest-CreateVolumesFromImageTest-804938514 None] Lock "cinder-1e710f4c-7f82-440f-9dd1-610dc4affe24-delete_volume" released by "delete_volume" :: held 1.063s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:40:31 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-7841b160-92ec-428f-94ac-d1de3b8e7243 tempest-CreateVolumesFromImageTest-804938514 None] Acquiring lock "cinder-94adbae9-fd69-40af-bd1b-0c87d0f6eb17-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:40:31 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-7841b160-92ec-428f-94ac-d1de3b8e7243 tempest-CreateVolumesFromImageTest-804938514 None] Lock "cinder-94adbae9-fd69-40af-bd1b-0c87d0f6eb17-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:40:31 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-7841b160-92ec-428f-94ac-d1de3b8e7243 tempest-CreateVolumesFromImageTest-804938514 None] Acquiring lock "cinder-quobyte-94adbae9-fd69-40af-bd1b-0c87d0f6eb17" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:40:31 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-7841b160-92ec-428f-94ac-d1de3b8e7243 tempest-CreateVolumesFromImageTest-804938514 None] Lock "cinder-quobyte-94adbae9-fd69-40af-bd1b-0c87d0f6eb17" acquired by "delete_volume" :: waited 0.014s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:40:31 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[64d614ef-5a3d-4410-a00a-94007b0937f7]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:40:31 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-7841b160-92ec-428f-94ac-d1de3b8e7243 tempest-CreateVolumesFromImageTest-804938514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-94adbae9-fd69-40af-bd1b-0c87d0f6eb17 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:40:31 devstack sudo[113226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-94adbae9-fd69-40af-bd1b-0c87d0f6eb17 Aug 26 14:40:31 devstack sudo[113226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:40:31 devstack sudo[113226]: pam_unix(sudo:session): session closed for user root Aug 26 14:40:31 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-7841b160-92ec-428f-94ac-d1de3b8e7243 tempest-CreateVolumesFromImageTest-804938514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-94adbae9-fd69-40af-bd1b-0c87d0f6eb17" returned: 0 in 0.345s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:40:31 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-7841b160-92ec-428f-94ac-d1de3b8e7243 tempest-CreateVolumesFromImageTest-804938514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-94adbae9-fd69-40af-bd1b-0c87d0f6eb17 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:40:31 devstack sudo[113231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-94adbae9-fd69-40af-bd1b-0c87d0f6eb17 Aug 26 14:40:31 devstack sudo[113231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:40:32 devstack sudo[113231]: pam_unix(sudo:session): session closed for user root Aug 26 14:40:32 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-7841b160-92ec-428f-94ac-d1de3b8e7243 tempest-CreateVolumesFromImageTest-804938514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-94adbae9-fd69-40af-bd1b-0c87d0f6eb17" returned: 0 in 0.249s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:40:32 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-7841b160-92ec-428f-94ac-d1de3b8e7243 tempest-CreateVolumesFromImageTest-804938514 None] Lock "cinder-quobyte-94adbae9-fd69-40af-bd1b-0c87d0f6eb17" released by "delete_volume" :: held 0.629s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:40:32 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-7841b160-92ec-428f-94ac-d1de3b8e7243 tempest-CreateVolumesFromImageTest-804938514 None] Created reservations ['70a78f39-d64a-4018-8b3a-1a82c8c8923b', '8334e483-b09b-4edd-96e7-6cc064a9688d', '300720e5-016c-414c-a27a-62373c4355a3', 'd5d76d9f-2cd1-4c12-a2ee-aa4c11d97234'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:40:32 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-7841b160-92ec-428f-94ac-d1de3b8e7243 tempest-CreateVolumesFromImageTest-804938514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:40:32 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-7841b160-92ec-428f-94ac-d1de3b8e7243 tempest-CreateVolumesFromImageTest-804938514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:40:32 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-7841b160-92ec-428f-94ac-d1de3b8e7243 tempest-CreateVolumesFromImageTest-804938514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:40:32 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-7841b160-92ec-428f-94ac-d1de3b8e7243 tempest-CreateVolumesFromImageTest-804938514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:40:32 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-7841b160-92ec-428f-94ac-d1de3b8e7243 tempest-CreateVolumesFromImageTest-804938514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:40:32 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-7841b160-92ec-428f-94ac-d1de3b8e7243 tempest-CreateVolumesFromImageTest-804938514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:40:32 devstack sudo[113234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:40:32 devstack sudo[113234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:40:32 devstack sudo[113234]: pam_unix(sudo:session): session closed for user root Aug 26 14:40:32 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-7841b160-92ec-428f-94ac-d1de3b8e7243 tempest-CreateVolumesFromImageTest-804938514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.237s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:40:32 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-7841b160-92ec-428f-94ac-d1de3b8e7243 tempest-CreateVolumesFromImageTest-804938514 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:40:32 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-7841b160-92ec-428f-94ac-d1de3b8e7243 tempest-CreateVolumesFromImageTest-804938514 None] Deleted volume successfully. Aug 26 14:40:32 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-7841b160-92ec-428f-94ac-d1de3b8e7243 tempest-CreateVolumesFromImageTest-804938514 None] Lock "cinder-94adbae9-fd69-40af-bd1b-0c87d0f6eb17-delete_volume" released by "delete_volume" :: held 1.042s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:40:32 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-ff17b88b-45c9-4f83-84ba-d81227d08bdb tempest-CreateVolumesFromImageTest-804938514 None] Acquiring lock "cinder-e1924558-d9da-4154-8ddf-d5fa6798fe75-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:40:32 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-ff17b88b-45c9-4f83-84ba-d81227d08bdb tempest-CreateVolumesFromImageTest-804938514 None] Lock "cinder-e1924558-d9da-4154-8ddf-d5fa6798fe75-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:40:32 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-ff17b88b-45c9-4f83-84ba-d81227d08bdb tempest-CreateVolumesFromImageTest-804938514 None] Acquiring lock "cinder-quobyte-e1924558-d9da-4154-8ddf-d5fa6798fe75" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:40:32 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-ff17b88b-45c9-4f83-84ba-d81227d08bdb tempest-CreateVolumesFromImageTest-804938514 None] Lock "cinder-quobyte-e1924558-d9da-4154-8ddf-d5fa6798fe75" acquired by "delete_volume" :: waited 0.017s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:40:32 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d1926f9-a07f-4079-b075-58b4649ae5e6]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:40:32 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-ff17b88b-45c9-4f83-84ba-d81227d08bdb tempest-CreateVolumesFromImageTest-804938514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-e1924558-d9da-4154-8ddf-d5fa6798fe75 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:40:32 devstack sudo[113237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-e1924558-d9da-4154-8ddf-d5fa6798fe75 Aug 26 14:40:32 devstack sudo[113237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:40:32 devstack sudo[113237]: pam_unix(sudo:session): session closed for user root Aug 26 14:40:32 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-ff17b88b-45c9-4f83-84ba-d81227d08bdb tempest-CreateVolumesFromImageTest-804938514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-e1924558-d9da-4154-8ddf-d5fa6798fe75" returned: 0 in 0.341s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:40:32 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-ff17b88b-45c9-4f83-84ba-d81227d08bdb tempest-CreateVolumesFromImageTest-804938514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-e1924558-d9da-4154-8ddf-d5fa6798fe75 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:40:33 devstack sudo[113242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-e1924558-d9da-4154-8ddf-d5fa6798fe75 Aug 26 14:40:33 devstack sudo[113242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:40:33 devstack sudo[113242]: pam_unix(sudo:session): session closed for user root Aug 26 14:40:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-ff17b88b-45c9-4f83-84ba-d81227d08bdb tempest-CreateVolumesFromImageTest-804938514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-e1924558-d9da-4154-8ddf-d5fa6798fe75" returned: 0 in 0.240s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:40:33 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-ff17b88b-45c9-4f83-84ba-d81227d08bdb tempest-CreateVolumesFromImageTest-804938514 None] Lock "cinder-quobyte-e1924558-d9da-4154-8ddf-d5fa6798fe75" released by "delete_volume" :: held 0.618s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:40:33 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-ff17b88b-45c9-4f83-84ba-d81227d08bdb tempest-CreateVolumesFromImageTest-804938514 None] Created reservations ['58ff966b-b059-4e0f-961a-c5db4f94ad6a', '0594f04e-62a9-493c-96a3-bf2ee9c701da', '63a1283e-2240-427d-aa2c-2f14d36343dd', '898959bb-4ca6-4b9a-a021-a9f1f073ab1b'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:40:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-ff17b88b-45c9-4f83-84ba-d81227d08bdb tempest-CreateVolumesFromImageTest-804938514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:40:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-ff17b88b-45c9-4f83-84ba-d81227d08bdb tempest-CreateVolumesFromImageTest-804938514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:40:33 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-ff17b88b-45c9-4f83-84ba-d81227d08bdb tempest-CreateVolumesFromImageTest-804938514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:40:33 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-ff17b88b-45c9-4f83-84ba-d81227d08bdb tempest-CreateVolumesFromImageTest-804938514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:40:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-ff17b88b-45c9-4f83-84ba-d81227d08bdb tempest-CreateVolumesFromImageTest-804938514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:40:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-ff17b88b-45c9-4f83-84ba-d81227d08bdb tempest-CreateVolumesFromImageTest-804938514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:40:33 devstack sudo[113279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:40:33 devstack sudo[113279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:40:33 devstack cinder-volume[94394]: DEBUG oslo_service.periodic_task [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94394) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 14:40:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:40:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:40:33 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:40:33 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:40:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:40:33 devstack sudo[113279]: pam_unix(sudo:session): session closed for user root Aug 26 14:40:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:40:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-ff17b88b-45c9-4f83-84ba-d81227d08bdb tempest-CreateVolumesFromImageTest-804938514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.260s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:40:33 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-ff17b88b-45c9-4f83-84ba-d81227d08bdb tempest-CreateVolumesFromImageTest-804938514 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:40:33 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-ff17b88b-45c9-4f83-84ba-d81227d08bdb tempest-CreateVolumesFromImageTest-804938514 None] Deleted volume successfully. Aug 26 14:40:33 devstack sudo[113284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:40:33 devstack sudo[113284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:40:33 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-ff17b88b-45c9-4f83-84ba-d81227d08bdb tempest-CreateVolumesFromImageTest-804938514 None] Lock "cinder-e1924558-d9da-4154-8ddf-d5fa6798fe75-delete_volume" released by "delete_volume" :: held 1.079s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:40:33 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-1012b9a9-a1e7-45b4-8cb5-44b307752138 tempest-CreateVolumesFromImageTest-804938514 None] Acquiring lock "cinder-a94b02a6-64a9-4195-937f-84372b702e3a-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:40:33 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-1012b9a9-a1e7-45b4-8cb5-44b307752138 tempest-CreateVolumesFromImageTest-804938514 None] Lock "cinder-a94b02a6-64a9-4195-937f-84372b702e3a-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:40:33 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-1012b9a9-a1e7-45b4-8cb5-44b307752138 tempest-CreateVolumesFromImageTest-804938514 None] Acquiring lock "cinder-quobyte-a94b02a6-64a9-4195-937f-84372b702e3a" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:40:33 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-1012b9a9-a1e7-45b4-8cb5-44b307752138 tempest-CreateVolumesFromImageTest-804938514 None] Lock "cinder-quobyte-a94b02a6-64a9-4195-937f-84372b702e3a" acquired by "delete_volume" :: waited 0.015s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:40:33 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[5349c53a-9d71-485d-ab42-460b657344c8]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:40:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-1012b9a9-a1e7-45b4-8cb5-44b307752138 tempest-CreateVolumesFromImageTest-804938514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-a94b02a6-64a9-4195-937f-84372b702e3a {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:40:33 devstack sudo[113284]: pam_unix(sudo:session): session closed for user root Aug 26 14:40:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.258s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:40:33 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:40:33 devstack cinder-volume[94394]: DEBUG oslo_service.periodic_task [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Running periodic task VolumeManager._thread_info {{(pid=94394) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 14:40:33 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] thread count: 28 {{(pid=94394) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 14:40:33 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] thread info: [<_MainThread(MainThread, started 126600738033792)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94394) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 14:40:33 devstack sudo[113287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-a94b02a6-64a9-4195-937f-84372b702e3a Aug 26 14:40:33 devstack sudo[113287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:40:34 devstack sudo[113287]: pam_unix(sudo:session): session closed for user root Aug 26 14:40:34 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-1012b9a9-a1e7-45b4-8cb5-44b307752138 tempest-CreateVolumesFromImageTest-804938514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-a94b02a6-64a9-4195-937f-84372b702e3a" returned: 0 in 0.359s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:40:34 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-1012b9a9-a1e7-45b4-8cb5-44b307752138 tempest-CreateVolumesFromImageTest-804938514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-a94b02a6-64a9-4195-937f-84372b702e3a {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:40:34 devstack sudo[113292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-a94b02a6-64a9-4195-937f-84372b702e3a Aug 26 14:40:34 devstack sudo[113292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:40:34 devstack sudo[113292]: pam_unix(sudo:session): session closed for user root Aug 26 14:40:34 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-1012b9a9-a1e7-45b4-8cb5-44b307752138 tempest-CreateVolumesFromImageTest-804938514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-a94b02a6-64a9-4195-937f-84372b702e3a" returned: 0 in 0.240s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:40:34 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-1012b9a9-a1e7-45b4-8cb5-44b307752138 tempest-CreateVolumesFromImageTest-804938514 None] Lock "cinder-quobyte-a94b02a6-64a9-4195-937f-84372b702e3a" released by "delete_volume" :: held 0.646s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:40:34 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-1012b9a9-a1e7-45b4-8cb5-44b307752138 tempest-CreateVolumesFromImageTest-804938514 None] Created reservations ['87ea8bc0-9e74-4dbe-aef8-3626a8cdb79a', 'd69dada2-ff8e-491b-be33-8824b6fe15a4', '805e907f-bec7-4947-aef4-02f7a489b655', '0a43d7c8-9bdf-4b51-a086-a2be1e0a0526'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:40:34 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-1012b9a9-a1e7-45b4-8cb5-44b307752138 tempest-CreateVolumesFromImageTest-804938514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:40:34 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-1012b9a9-a1e7-45b4-8cb5-44b307752138 tempest-CreateVolumesFromImageTest-804938514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:40:34 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-1012b9a9-a1e7-45b4-8cb5-44b307752138 tempest-CreateVolumesFromImageTest-804938514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:40:34 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-1012b9a9-a1e7-45b4-8cb5-44b307752138 tempest-CreateVolumesFromImageTest-804938514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:40:34 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-1012b9a9-a1e7-45b4-8cb5-44b307752138 tempest-CreateVolumesFromImageTest-804938514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:40:34 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-1012b9a9-a1e7-45b4-8cb5-44b307752138 tempest-CreateVolumesFromImageTest-804938514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:40:34 devstack sudo[113295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:40:34 devstack sudo[113295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:40:34 devstack sudo[113295]: pam_unix(sudo:session): session closed for user root Aug 26 14:40:34 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-1012b9a9-a1e7-45b4-8cb5-44b307752138 tempest-CreateVolumesFromImageTest-804938514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.247s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:40:34 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-1012b9a9-a1e7-45b4-8cb5-44b307752138 tempest-CreateVolumesFromImageTest-804938514 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:40:34 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-1012b9a9-a1e7-45b4-8cb5-44b307752138 tempest-CreateVolumesFromImageTest-804938514 None] Deleted volume successfully. Aug 26 14:40:34 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-1012b9a9-a1e7-45b4-8cb5-44b307752138 tempest-CreateVolumesFromImageTest-804938514 None] Lock "cinder-a94b02a6-64a9-4195-937f-84372b702e3a-delete_volume" released by "delete_volume" :: held 1.077s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:40:34 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-d875246d-cae9-4021-8ed4-e60f49dcdea6 tempest-CreateVolumesFromImageTest-804938514 None] Acquiring lock "cinder-6a905e47-f12c-441e-9f60-e2083b0e12fe-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:40:34 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-d875246d-cae9-4021-8ed4-e60f49dcdea6 tempest-CreateVolumesFromImageTest-804938514 None] Lock "cinder-6a905e47-f12c-441e-9f60-e2083b0e12fe-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:40:34 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-d875246d-cae9-4021-8ed4-e60f49dcdea6 tempest-CreateVolumesFromImageTest-804938514 None] Acquiring lock "cinder-quobyte-6a905e47-f12c-441e-9f60-e2083b0e12fe" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:40:34 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-d875246d-cae9-4021-8ed4-e60f49dcdea6 tempest-CreateVolumesFromImageTest-804938514 None] Lock "cinder-quobyte-6a905e47-f12c-441e-9f60-e2083b0e12fe" acquired by "delete_volume" :: waited 0.015s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:40:34 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[f090e57d-9b36-4348-95e5-9c65c73c858f]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:40:34 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-d875246d-cae9-4021-8ed4-e60f49dcdea6 tempest-CreateVolumesFromImageTest-804938514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6a905e47-f12c-441e-9f60-e2083b0e12fe {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:40:35 devstack sudo[113298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6a905e47-f12c-441e-9f60-e2083b0e12fe Aug 26 14:40:35 devstack sudo[113298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:40:35 devstack sudo[113298]: pam_unix(sudo:session): session closed for user root Aug 26 14:40:35 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-d875246d-cae9-4021-8ed4-e60f49dcdea6 tempest-CreateVolumesFromImageTest-804938514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6a905e47-f12c-441e-9f60-e2083b0e12fe" returned: 0 in 0.350s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:40:35 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-d875246d-cae9-4021-8ed4-e60f49dcdea6 tempest-CreateVolumesFromImageTest-804938514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6a905e47-f12c-441e-9f60-e2083b0e12fe {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:40:35 devstack sudo[113303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6a905e47-f12c-441e-9f60-e2083b0e12fe Aug 26 14:40:35 devstack sudo[113303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:40:35 devstack sudo[113303]: pam_unix(sudo:session): session closed for user root Aug 26 14:40:35 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-d875246d-cae9-4021-8ed4-e60f49dcdea6 tempest-CreateVolumesFromImageTest-804938514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6a905e47-f12c-441e-9f60-e2083b0e12fe" returned: 0 in 0.239s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:40:35 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-d875246d-cae9-4021-8ed4-e60f49dcdea6 tempest-CreateVolumesFromImageTest-804938514 None] Lock "cinder-quobyte-6a905e47-f12c-441e-9f60-e2083b0e12fe" released by "delete_volume" :: held 0.628s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:40:35 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-d875246d-cae9-4021-8ed4-e60f49dcdea6 tempest-CreateVolumesFromImageTest-804938514 None] Created reservations ['cfdb08b9-7b21-4705-aaa7-2291645cf54d', '9cba1987-5cfc-4a6b-a5df-79468d9c6449', 'b3eafc28-663e-4066-917f-e3fb60c519ba', '1a537fc7-0946-492f-a71d-c0273e891302'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:40:35 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-d875246d-cae9-4021-8ed4-e60f49dcdea6 tempest-CreateVolumesFromImageTest-804938514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:40:35 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-d875246d-cae9-4021-8ed4-e60f49dcdea6 tempest-CreateVolumesFromImageTest-804938514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:40:35 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-d875246d-cae9-4021-8ed4-e60f49dcdea6 tempest-CreateVolumesFromImageTest-804938514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:40:35 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-d875246d-cae9-4021-8ed4-e60f49dcdea6 tempest-CreateVolumesFromImageTest-804938514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:40:35 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-d875246d-cae9-4021-8ed4-e60f49dcdea6 tempest-CreateVolumesFromImageTest-804938514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:40:35 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-d875246d-cae9-4021-8ed4-e60f49dcdea6 tempest-CreateVolumesFromImageTest-804938514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:40:35 devstack sudo[113306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:40:35 devstack sudo[113306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:40:35 devstack sudo[113306]: pam_unix(sudo:session): session closed for user root Aug 26 14:40:35 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-d875246d-cae9-4021-8ed4-e60f49dcdea6 tempest-CreateVolumesFromImageTest-804938514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.242s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:40:35 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-d875246d-cae9-4021-8ed4-e60f49dcdea6 tempest-CreateVolumesFromImageTest-804938514 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:40:35 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-d875246d-cae9-4021-8ed4-e60f49dcdea6 tempest-CreateVolumesFromImageTest-804938514 None] Deleted volume successfully. Aug 26 14:40:35 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-d875246d-cae9-4021-8ed4-e60f49dcdea6 tempest-CreateVolumesFromImageTest-804938514 None] Lock "cinder-6a905e47-f12c-441e-9f60-e2083b0e12fe-delete_volume" released by "delete_volume" :: held 1.066s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:40:38 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-387e8de6-2d5c-4916-887f-508e9c5ee570 tempest-CreateVolumesFromSnapshotTest-448065929 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:40:38 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-387e8de6-2d5c-4916-887f-508e9c5ee570 tempest-CreateVolumesFromSnapshotTest-448065929 None] Flow 'volume_create_manager' (f56d9f5d-c29f-48f9-8c6c-44e02fc96a70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:40:38 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-387e8de6-2d5c-4916-887f-508e9c5ee570 tempest-CreateVolumesFromSnapshotTest-448065929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4df64687-1569-464b-98cb-ac03c3fd8bfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:40:38 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-387e8de6-2d5c-4916-887f-508e9c5ee570 tempest-CreateVolumesFromSnapshotTest-448065929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4df64687-1569-464b-98cb-ac03c3fd8bfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:40:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-798251949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecc42e9b-4e4c-4f6a-a16a-75849c869a2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57fb2632a3a141179b2f40e9ee4f09aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:40:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:40:39Z,use_quota=True,user_id='8997de84788a442ab76d411bce0c656d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:40:38 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-387e8de6-2d5c-4916-887f-508e9c5ee570 tempest-CreateVolumesFromSnapshotTest-448065929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7508387-24b2-442a-a3ee-c474073cde13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:40:38 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-387e8de6-2d5c-4916-887f-508e9c5ee570 tempest-CreateVolumesFromSnapshotTest-448065929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7508387-24b2-442a-a3ee-c474073cde13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:40:38 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-387e8de6-2d5c-4916-887f-508e9c5ee570 tempest-CreateVolumesFromSnapshotTest-448065929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (903389ac-5834-4f57-a6bf-3164c56d63a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:40:38 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-387e8de6-2d5c-4916-887f-508e9c5ee570 tempest-CreateVolumesFromSnapshotTest-448065929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (903389ac-5834-4f57-a6bf-3164c56d63a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ecc42e9b-4e4c-4f6a-a16a-75849c869a2c', 'volume_name': 'volume-ecc42e9b-4e4c-4f6a-a16a-75849c869a2c', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:40:38 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-387e8de6-2d5c-4916-887f-508e9c5ee570 tempest-CreateVolumesFromSnapshotTest-448065929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e35e1d54-9866-4182-aaa0-ea26613b81f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:40:38 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-387e8de6-2d5c-4916-887f-508e9c5ee570 tempest-CreateVolumesFromSnapshotTest-448065929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e35e1d54-9866-4182-aaa0-ea26613b81f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:40:38 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-387e8de6-2d5c-4916-887f-508e9c5ee570 tempest-CreateVolumesFromSnapshotTest-448065929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91161ce3-3ddd-4854-abbd-fea8c1b5425c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:40:38 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-387e8de6-2d5c-4916-887f-508e9c5ee570 tempest-CreateVolumesFromSnapshotTest-448065929 None] Volume ecc42e9b-4e4c-4f6a-a16a-75849c869a2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ecc42e9b-4e4c-4f6a-a16a-75849c869a2c', 'volume_size': 1} Aug 26 14:40:38 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-387e8de6-2d5c-4916-887f-508e9c5ee570 tempest-CreateVolumesFromSnapshotTest-448065929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:40:38 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-387e8de6-2d5c-4916-887f-508e9c5ee570 tempest-CreateVolumesFromSnapshotTest-448065929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:40:38 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-387e8de6-2d5c-4916-887f-508e9c5ee570 tempest-CreateVolumesFromSnapshotTest-448065929 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:40:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-798251949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecc42e9b-4e4c-4f6a-a16a-75849c869a2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57fb2632a3a141179b2f40e9ee4f09aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:40:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:40:39Z,use_quota=True,user_id='8997de84788a442ab76d411bce0c656d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:40:38 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-387e8de6-2d5c-4916-887f-508e9c5ee570 tempest-CreateVolumesFromSnapshotTest-448065929 None] Creating volume ecc42e9b-4e4c-4f6a-a16a-75849c869a2c {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:40:38 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-387e8de6-2d5c-4916-887f-508e9c5ee570 tempest-CreateVolumesFromSnapshotTest-448065929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:40:38 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-387e8de6-2d5c-4916-887f-508e9c5ee570 tempest-CreateVolumesFromSnapshotTest-448065929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:40:38 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-387e8de6-2d5c-4916-887f-508e9c5ee570 tempest-CreateVolumesFromSnapshotTest-448065929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:40:38 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-387e8de6-2d5c-4916-887f-508e9c5ee570 tempest-CreateVolumesFromSnapshotTest-448065929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:40:38 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-387e8de6-2d5c-4916-887f-508e9c5ee570 tempest-CreateVolumesFromSnapshotTest-448065929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:40:38 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-387e8de6-2d5c-4916-887f-508e9c5ee570 tempest-CreateVolumesFromSnapshotTest-448065929 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:40:38 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-387e8de6-2d5c-4916-887f-508e9c5ee570 tempest-CreateVolumesFromSnapshotTest-448065929 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:40:38 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-387e8de6-2d5c-4916-887f-508e9c5ee570 tempest-CreateVolumesFromSnapshotTest-448065929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ecc42e9b-4e4c-4f6a-a16a-75849c869a2c 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:40:38 devstack sudo[113309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ecc42e9b-4e4c-4f6a-a16a-75849c869a2c 1073741824 Aug 26 14:40:38 devstack sudo[113309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:40:39 devstack sudo[113309]: pam_unix(sudo:session): session closed for user root Aug 26 14:40:39 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-387e8de6-2d5c-4916-887f-508e9c5ee570 tempest-CreateVolumesFromSnapshotTest-448065929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ecc42e9b-4e4c-4f6a-a16a-75849c869a2c 1073741824" returned: 0 in 0.425s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:40:39 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-387e8de6-2d5c-4916-887f-508e9c5ee570 tempest-CreateVolumesFromSnapshotTest-448065929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ecc42e9b-4e4c-4f6a-a16a-75849c869a2c {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:40:39 devstack sudo[113315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ecc42e9b-4e4c-4f6a-a16a-75849c869a2c Aug 26 14:40:39 devstack sudo[113315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:40:39 devstack sudo[113315]: pam_unix(sudo:session): session closed for user root Aug 26 14:40:39 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-387e8de6-2d5c-4916-887f-508e9c5ee570 tempest-CreateVolumesFromSnapshotTest-448065929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ecc42e9b-4e4c-4f6a-a16a-75849c869a2c" returned: 0 in 0.238s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:40:39 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-387e8de6-2d5c-4916-887f-508e9c5ee570 tempest-CreateVolumesFromSnapshotTest-448065929 None] <== create_volume: return (702ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:40:39 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-387e8de6-2d5c-4916-887f-508e9c5ee570 tempest-CreateVolumesFromSnapshotTest-448065929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.704s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:40:39 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-387e8de6-2d5c-4916-887f-508e9c5ee570 tempest-CreateVolumesFromSnapshotTest-448065929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91161ce3-3ddd-4854-abbd-fea8c1b5425c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ecc42e9b-4e4c-4f6a-a16a-75849c869a2c', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:40:39 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-387e8de6-2d5c-4916-887f-508e9c5ee570 tempest-CreateVolumesFromSnapshotTest-448065929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54c4d4e6-ffb9-4557-b411-bdf327dce660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:40:39 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-387e8de6-2d5c-4916-887f-508e9c5ee570 tempest-CreateVolumesFromSnapshotTest-448065929 None] Volume volume-ecc42e9b-4e4c-4f6a-a16a-75849c869a2c (ecc42e9b-4e4c-4f6a-a16a-75849c869a2c): created successfully Aug 26 14:40:39 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-387e8de6-2d5c-4916-887f-508e9c5ee570 tempest-CreateVolumesFromSnapshotTest-448065929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54c4d4e6-ffb9-4557-b411-bdf327dce660) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:40:39 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-387e8de6-2d5c-4916-887f-508e9c5ee570 tempest-CreateVolumesFromSnapshotTest-448065929 None] Flow 'volume_create_manager' (f56d9f5d-c29f-48f9-8c6c-44e02fc96a70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:40:39 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-387e8de6-2d5c-4916-887f-508e9c5ee570 tempest-CreateVolumesFromSnapshotTest-448065929 None] Created volume successfully. Aug 26 14:40:39 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-b00f2952-d7b2-4d93-b73d-59011a5bc368 tempest-CreateVolumesFromSnapshotTest-448065929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:40:39 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-b00f2952-d7b2-4d93-b73d-59011a5bc368 tempest-CreateVolumesFromSnapshotTest-448065929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:40:39 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-b00f2952-d7b2-4d93-b73d-59011a5bc368 tempest-CreateVolumesFromSnapshotTest-448065929 None] Creating offline snapshot f3f4c512-d9b4-42c9-b1cf-5b16ea887d63 of volume ecc42e9b-4e4c-4f6a-a16a-75849c869a2c {{(pid=94394) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 14:40:39 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[219fdce2-8972-446f-a8b1-68a0eb408b94]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:40:39 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-b00f2952-d7b2-4d93-b73d-59011a5bc368 tempest-CreateVolumesFromSnapshotTest-448065929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ecc42e9b-4e4c-4f6a-a16a-75849c869a2c {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:40:40 devstack sudo[113318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ecc42e9b-4e4c-4f6a-a16a-75849c869a2c Aug 26 14:40:40 devstack sudo[113318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:40:40 devstack sudo[113318]: pam_unix(sudo:session): session closed for user root Aug 26 14:40:40 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-b00f2952-d7b2-4d93-b73d-59011a5bc368 tempest-CreateVolumesFromSnapshotTest-448065929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ecc42e9b-4e4c-4f6a-a16a-75849c869a2c" returned: 0 in 0.357s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:40:40 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-b00f2952-d7b2-4d93-b73d-59011a5bc368 tempest-CreateVolumesFromSnapshotTest-448065929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ecc42e9b-4e4c-4f6a-a16a-75849c869a2c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ecc42e9b-4e4c-4f6a-a16a-75849c869a2c.f3f4c512-d9b4-42c9-b1cf-5b16ea887d63 1G {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:40:40 devstack sudo[113323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ecc42e9b-4e4c-4f6a-a16a-75849c869a2c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ecc42e9b-4e4c-4f6a-a16a-75849c869a2c.f3f4c512-d9b4-42c9-b1cf-5b16ea887d63 1G Aug 26 14:40:40 devstack sudo[113323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:40:40 devstack sudo[113323]: pam_unix(sudo:session): session closed for user root Aug 26 14:40:40 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-b00f2952-d7b2-4d93-b73d-59011a5bc368 tempest-CreateVolumesFromSnapshotTest-448065929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ecc42e9b-4e4c-4f6a-a16a-75849c869a2c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ecc42e9b-4e4c-4f6a-a16a-75849c869a2c.f3f4c512-d9b4-42c9-b1cf-5b16ea887d63 1G" returned: 0 in 0.368s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:40:40 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-b00f2952-d7b2-4d93-b73d-59011a5bc368 tempest-CreateVolumesFromSnapshotTest-448065929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ecc42e9b-4e4c-4f6a-a16a-75849c869a2c -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ecc42e9b-4e4c-4f6a-a16a-75849c869a2c.f3f4c512-d9b4-42c9-b1cf-5b16ea887d63 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:40:40 devstack sudo[113329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ecc42e9b-4e4c-4f6a-a16a-75849c869a2c -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ecc42e9b-4e4c-4f6a-a16a-75849c869a2c.f3f4c512-d9b4-42c9-b1cf-5b16ea887d63 Aug 26 14:40:40 devstack sudo[113329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:40:40 devstack sudo[113329]: pam_unix(sudo:session): session closed for user root Aug 26 14:40:40 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-b00f2952-d7b2-4d93-b73d-59011a5bc368 tempest-CreateVolumesFromSnapshotTest-448065929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ecc42e9b-4e4c-4f6a-a16a-75849c869a2c -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ecc42e9b-4e4c-4f6a-a16a-75849c869a2c.f3f4c512-d9b4-42c9-b1cf-5b16ea887d63" returned: 0 in 0.292s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:40:40 devstack cinder-volume[94394]: WARNING cinder.volume.drivers.remotefs [None req-b00f2952-d7b2-4d93-b73d-59011a5bc368 tempest-CreateVolumesFromSnapshotTest-448065929 None] /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ecc42e9b-4e4c-4f6a-a16a-75849c869a2c.f3f4c512-d9b4-42c9-b1cf-5b16ea887d63 is being set with open permissions: ugo+rw Aug 26 14:40:40 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-b00f2952-d7b2-4d93-b73d-59011a5bc368 tempest-CreateVolumesFromSnapshotTest-448065929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ecc42e9b-4e4c-4f6a-a16a-75849c869a2c.f3f4c512-d9b4-42c9-b1cf-5b16ea887d63 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:40:40 devstack sudo[113334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ecc42e9b-4e4c-4f6a-a16a-75849c869a2c.f3f4c512-d9b4-42c9-b1cf-5b16ea887d63 Aug 26 14:40:40 devstack sudo[113334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:40:41 devstack sudo[113334]: pam_unix(sudo:session): session closed for user root Aug 26 14:40:41 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-b00f2952-d7b2-4d93-b73d-59011a5bc368 tempest-CreateVolumesFromSnapshotTest-448065929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ecc42e9b-4e4c-4f6a-a16a-75849c869a2c.f3f4c512-d9b4-42c9-b1cf-5b16ea887d63" returned: 0 in 0.253s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:40:41 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-b00f2952-d7b2-4d93-b73d-59011a5bc368 tempest-CreateVolumesFromSnapshotTest-448065929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ecc42e9b-4e4c-4f6a-a16a-75849c869a2c.info {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:40:41 devstack sudo[113337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ecc42e9b-4e4c-4f6a-a16a-75849c869a2c.info Aug 26 14:40:41 devstack sudo[113337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:40:41 devstack sudo[113337]: pam_unix(sudo:session): session closed for user root Aug 26 14:40:41 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-b00f2952-d7b2-4d93-b73d-59011a5bc368 tempest-CreateVolumesFromSnapshotTest-448065929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ecc42e9b-4e4c-4f6a-a16a-75849c869a2c.info" returned: 0 in 0.241s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:40:41 devstack cinder-volume[94394]: WARNING cinder.volume.drivers.remotefs [None req-b00f2952-d7b2-4d93-b73d-59011a5bc368 tempest-CreateVolumesFromSnapshotTest-448065929 None] /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ecc42e9b-4e4c-4f6a-a16a-75849c869a2c.info is being set with open permissions: ugo+rw Aug 26 14:40:41 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-b00f2952-d7b2-4d93-b73d-59011a5bc368 tempest-CreateVolumesFromSnapshotTest-448065929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ecc42e9b-4e4c-4f6a-a16a-75849c869a2c.info {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:40:41 devstack sudo[113340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ecc42e9b-4e4c-4f6a-a16a-75849c869a2c.info Aug 26 14:40:41 devstack sudo[113340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:40:41 devstack sudo[113340]: pam_unix(sudo:session): session closed for user root Aug 26 14:40:41 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-b00f2952-d7b2-4d93-b73d-59011a5bc368 tempest-CreateVolumesFromSnapshotTest-448065929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ecc42e9b-4e4c-4f6a-a16a-75849c869a2c.info" returned: 0 in 0.236s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:40:41 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-b00f2952-d7b2-4d93-b73d-59011a5bc368 tempest-CreateVolumesFromSnapshotTest-448065929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.830s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:40:41 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-b00f2952-d7b2-4d93-b73d-59011a5bc368 tempest-CreateVolumesFromSnapshotTest-448065929 None] Create snapshot completed successfully Aug 26 14:40:42 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-b819f6d3-6ef4-44c1-8329-5d9db10164a2 tempest-CreateVolumesFromSnapshotTest-448065929 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:40:42 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-b819f6d3-6ef4-44c1-8329-5d9db10164a2 tempest-CreateVolumesFromSnapshotTest-448065929 None] Flow 'volume_create_manager' (e26995d3-cf89-46cf-b14e-b0ecddce3c65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:40:42 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-b819f6d3-6ef4-44c1-8329-5d9db10164a2 tempest-CreateVolumesFromSnapshotTest-448065929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a086ed4c-2b77-48a9-b5b6-944c4d315d14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:40:42 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-b819f6d3-6ef4-44c1-8329-5d9db10164a2 tempest-CreateVolumesFromSnapshotTest-448065929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a086ed4c-2b77-48a9-b5b6-944c4d315d14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:40:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-950895405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea3b2573-f5c0-48c7-9173-b5e8a62921c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57fb2632a3a141179b2f40e9ee4f09aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:40:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:40:42Z,use_quota=True,user_id='8997de84788a442ab76d411bce0c656d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:40:42 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-b819f6d3-6ef4-44c1-8329-5d9db10164a2 tempest-CreateVolumesFromSnapshotTest-448065929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04b72923-4de6-4af2-85ae-ed983bb68288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:40:42 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-b819f6d3-6ef4-44c1-8329-5d9db10164a2 tempest-CreateVolumesFromSnapshotTest-448065929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04b72923-4de6-4af2-85ae-ed983bb68288) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:40:42 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-b819f6d3-6ef4-44c1-8329-5d9db10164a2 tempest-CreateVolumesFromSnapshotTest-448065929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8506f22e-75e6-4253-ac7c-502df0d1ceeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:40:42 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-b819f6d3-6ef4-44c1-8329-5d9db10164a2 tempest-CreateVolumesFromSnapshotTest-448065929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8506f22e-75e6-4253-ac7c-502df0d1ceeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea3b2573-f5c0-48c7-9173-b5e8a62921c0', 'volume_name': 'volume-ea3b2573-f5c0-48c7-9173-b5e8a62921c0', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:40:42 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-b819f6d3-6ef4-44c1-8329-5d9db10164a2 tempest-CreateVolumesFromSnapshotTest-448065929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44500973-c25a-492b-9d83-5c7b547e5c3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:40:42 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-b819f6d3-6ef4-44c1-8329-5d9db10164a2 tempest-CreateVolumesFromSnapshotTest-448065929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44500973-c25a-492b-9d83-5c7b547e5c3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:40:42 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-b819f6d3-6ef4-44c1-8329-5d9db10164a2 tempest-CreateVolumesFromSnapshotTest-448065929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48c1bfae-ae4a-4e78-a354-9f1993c336bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:40:42 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-b819f6d3-6ef4-44c1-8329-5d9db10164a2 tempest-CreateVolumesFromSnapshotTest-448065929 None] Volume ea3b2573-f5c0-48c7-9173-b5e8a62921c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea3b2573-f5c0-48c7-9173-b5e8a62921c0', 'volume_size': 1} Aug 26 14:40:42 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-b819f6d3-6ef4-44c1-8329-5d9db10164a2 tempest-CreateVolumesFromSnapshotTest-448065929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:40:42 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-b819f6d3-6ef4-44c1-8329-5d9db10164a2 tempest-CreateVolumesFromSnapshotTest-448065929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:40:42 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-b819f6d3-6ef4-44c1-8329-5d9db10164a2 tempest-CreateVolumesFromSnapshotTest-448065929 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:40:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-950895405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea3b2573-f5c0-48c7-9173-b5e8a62921c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57fb2632a3a141179b2f40e9ee4f09aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:40:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:40:42Z,use_quota=True,user_id='8997de84788a442ab76d411bce0c656d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:40:42 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-b819f6d3-6ef4-44c1-8329-5d9db10164a2 tempest-CreateVolumesFromSnapshotTest-448065929 None] Creating volume ea3b2573-f5c0-48c7-9173-b5e8a62921c0 {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:40:42 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-b819f6d3-6ef4-44c1-8329-5d9db10164a2 tempest-CreateVolumesFromSnapshotTest-448065929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:40:42 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-b819f6d3-6ef4-44c1-8329-5d9db10164a2 tempest-CreateVolumesFromSnapshotTest-448065929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:40:42 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-b819f6d3-6ef4-44c1-8329-5d9db10164a2 tempest-CreateVolumesFromSnapshotTest-448065929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:40:42 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-b819f6d3-6ef4-44c1-8329-5d9db10164a2 tempest-CreateVolumesFromSnapshotTest-448065929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:40:42 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-b819f6d3-6ef4-44c1-8329-5d9db10164a2 tempest-CreateVolumesFromSnapshotTest-448065929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:40:42 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-b819f6d3-6ef4-44c1-8329-5d9db10164a2 tempest-CreateVolumesFromSnapshotTest-448065929 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:40:42 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-b819f6d3-6ef4-44c1-8329-5d9db10164a2 tempest-CreateVolumesFromSnapshotTest-448065929 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:40:42 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-b819f6d3-6ef4-44c1-8329-5d9db10164a2 tempest-CreateVolumesFromSnapshotTest-448065929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ea3b2573-f5c0-48c7-9173-b5e8a62921c0 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:40:42 devstack sudo[113349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ea3b2573-f5c0-48c7-9173-b5e8a62921c0 1073741824 Aug 26 14:40:42 devstack sudo[113349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:40:42 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7b2dfff-00af-47bb-b9e7-8763458aeaf5 tempest-CreateVolumesFromSnapshotTest-448065929 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:40:42 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-b7b2dfff-00af-47bb-b9e7-8763458aeaf5 tempest-CreateVolumesFromSnapshotTest-448065929 None] Flow 'volume_create_manager' (ae926fcf-cb92-460a-a6cd-96660ecdf09d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:40:42 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-b7b2dfff-00af-47bb-b9e7-8763458aeaf5 tempest-CreateVolumesFromSnapshotTest-448065929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f70210c-525a-402e-8bea-06971224abfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:40:42 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-b7b2dfff-00af-47bb-b9e7-8763458aeaf5 tempest-CreateVolumesFromSnapshotTest-448065929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f70210c-525a-402e-8bea-06971224abfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:40:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-644099613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2588993-e2ec-4de4-83c8-9367a261bb82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57fb2632a3a141179b2f40e9ee4f09aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:40:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:40:43Z,use_quota=True,user_id='8997de84788a442ab76d411bce0c656d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:40:42 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-b7b2dfff-00af-47bb-b9e7-8763458aeaf5 tempest-CreateVolumesFromSnapshotTest-448065929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67d1af38-7070-42d6-a4bd-03971bdde02c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:40:42 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-b7b2dfff-00af-47bb-b9e7-8763458aeaf5 tempest-CreateVolumesFromSnapshotTest-448065929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67d1af38-7070-42d6-a4bd-03971bdde02c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:40:42 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-b7b2dfff-00af-47bb-b9e7-8763458aeaf5 tempest-CreateVolumesFromSnapshotTest-448065929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64a79180-b726-4432-a353-2bb0521238e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:40:42 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-b7b2dfff-00af-47bb-b9e7-8763458aeaf5 tempest-CreateVolumesFromSnapshotTest-448065929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64a79180-b726-4432-a353-2bb0521238e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2588993-e2ec-4de4-83c8-9367a261bb82', 'volume_name': 'volume-f2588993-e2ec-4de4-83c8-9367a261bb82', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:40:42 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-b7b2dfff-00af-47bb-b9e7-8763458aeaf5 tempest-CreateVolumesFromSnapshotTest-448065929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e1caf61-b394-46cc-8b3a-8439f210247b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:40:42 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-b7b2dfff-00af-47bb-b9e7-8763458aeaf5 tempest-CreateVolumesFromSnapshotTest-448065929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e1caf61-b394-46cc-8b3a-8439f210247b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:40:42 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-b7b2dfff-00af-47bb-b9e7-8763458aeaf5 tempest-CreateVolumesFromSnapshotTest-448065929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e46a214e-4727-43fe-87ab-a3daba1774a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:40:42 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-b7b2dfff-00af-47bb-b9e7-8763458aeaf5 tempest-CreateVolumesFromSnapshotTest-448065929 None] Volume f2588993-e2ec-4de4-83c8-9367a261bb82: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2588993-e2ec-4de4-83c8-9367a261bb82', 'volume_size': 1} Aug 26 14:40:42 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-b7b2dfff-00af-47bb-b9e7-8763458aeaf5 tempest-CreateVolumesFromSnapshotTest-448065929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:40:42 devstack sudo[113349]: pam_unix(sudo:session): session closed for user root Aug 26 14:40:42 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-b819f6d3-6ef4-44c1-8329-5d9db10164a2 tempest-CreateVolumesFromSnapshotTest-448065929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ea3b2573-f5c0-48c7-9173-b5e8a62921c0 1073741824" returned: 0 in 0.494s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:40:43 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-b819f6d3-6ef4-44c1-8329-5d9db10164a2 tempest-CreateVolumesFromSnapshotTest-448065929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ea3b2573-f5c0-48c7-9173-b5e8a62921c0 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:40:43 devstack sudo[113355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ea3b2573-f5c0-48c7-9173-b5e8a62921c0 Aug 26 14:40:43 devstack sudo[113355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:40:43 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-31d40fbb-1a26-4e91-b4e7-38158ef38759 tempest-CreateVolumesFromSnapshotTest-448065929 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:40:43 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-31d40fbb-1a26-4e91-b4e7-38158ef38759 tempest-CreateVolumesFromSnapshotTest-448065929 None] Flow 'volume_create_manager' (571ee194-5533-4db7-bf35-f31ec44ebdf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:40:43 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-31d40fbb-1a26-4e91-b4e7-38158ef38759 tempest-CreateVolumesFromSnapshotTest-448065929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2824844f-b9ff-46a3-b094-705decd9be9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:40:43 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-31d40fbb-1a26-4e91-b4e7-38158ef38759 tempest-CreateVolumesFromSnapshotTest-448065929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2824844f-b9ff-46a3-b094-705decd9be9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:40:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-858030779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a464aec-4171-4e46-8ba6-d5db59480853,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57fb2632a3a141179b2f40e9ee4f09aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:40:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:40:43Z,use_quota=True,user_id='8997de84788a442ab76d411bce0c656d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:40:43 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-31d40fbb-1a26-4e91-b4e7-38158ef38759 tempest-CreateVolumesFromSnapshotTest-448065929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27cebc77-d493-4d15-95fa-93acc4fbe59f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:40:43 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-31d40fbb-1a26-4e91-b4e7-38158ef38759 tempest-CreateVolumesFromSnapshotTest-448065929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27cebc77-d493-4d15-95fa-93acc4fbe59f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:40:43 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-31d40fbb-1a26-4e91-b4e7-38158ef38759 tempest-CreateVolumesFromSnapshotTest-448065929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28b1fc84-9b57-437a-85e6-fcecca704a32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:40:43 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-31d40fbb-1a26-4e91-b4e7-38158ef38759 tempest-CreateVolumesFromSnapshotTest-448065929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28b1fc84-9b57-437a-85e6-fcecca704a32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a464aec-4171-4e46-8ba6-d5db59480853', 'volume_name': 'volume-6a464aec-4171-4e46-8ba6-d5db59480853', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:40:43 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-31d40fbb-1a26-4e91-b4e7-38158ef38759 tempest-CreateVolumesFromSnapshotTest-448065929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2d10b4e-00f5-4f16-b225-afc2c2f11db6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:40:43 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-31d40fbb-1a26-4e91-b4e7-38158ef38759 tempest-CreateVolumesFromSnapshotTest-448065929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2d10b4e-00f5-4f16-b225-afc2c2f11db6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:40:43 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-31d40fbb-1a26-4e91-b4e7-38158ef38759 tempest-CreateVolumesFromSnapshotTest-448065929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc49f4fd-f0f9-4577-be59-f1e4764b9949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:40:43 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-31d40fbb-1a26-4e91-b4e7-38158ef38759 tempest-CreateVolumesFromSnapshotTest-448065929 None] Volume 6a464aec-4171-4e46-8ba6-d5db59480853: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a464aec-4171-4e46-8ba6-d5db59480853', 'volume_size': 1} Aug 26 14:40:43 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-31d40fbb-1a26-4e91-b4e7-38158ef38759 tempest-CreateVolumesFromSnapshotTest-448065929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:40:43 devstack sudo[113355]: pam_unix(sudo:session): session closed for user root Aug 26 14:40:43 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-b819f6d3-6ef4-44c1-8329-5d9db10164a2 tempest-CreateVolumesFromSnapshotTest-448065929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ea3b2573-f5c0-48c7-9173-b5e8a62921c0" returned: 0 in 0.319s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:40:43 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-b819f6d3-6ef4-44c1-8329-5d9db10164a2 tempest-CreateVolumesFromSnapshotTest-448065929 None] <== create_volume: return (871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:40:43 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-b819f6d3-6ef4-44c1-8329-5d9db10164a2 tempest-CreateVolumesFromSnapshotTest-448065929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.874s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:40:43 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-b7b2dfff-00af-47bb-b9e7-8763458aeaf5 tempest-CreateVolumesFromSnapshotTest-448065929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.528s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:40:43 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-b7b2dfff-00af-47bb-b9e7-8763458aeaf5 tempest-CreateVolumesFromSnapshotTest-448065929 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:40:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-644099613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2588993-e2ec-4de4-83c8-9367a261bb82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57fb2632a3a141179b2f40e9ee4f09aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:40:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:40:43Z,use_quota=True,user_id='8997de84788a442ab76d411bce0c656d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:40:43 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-b7b2dfff-00af-47bb-b9e7-8763458aeaf5 tempest-CreateVolumesFromSnapshotTest-448065929 None] Creating volume f2588993-e2ec-4de4-83c8-9367a261bb82 {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:40:43 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-b7b2dfff-00af-47bb-b9e7-8763458aeaf5 tempest-CreateVolumesFromSnapshotTest-448065929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:40:43 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-b7b2dfff-00af-47bb-b9e7-8763458aeaf5 tempest-CreateVolumesFromSnapshotTest-448065929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:40:43 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-b7b2dfff-00af-47bb-b9e7-8763458aeaf5 tempest-CreateVolumesFromSnapshotTest-448065929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:40:43 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-b7b2dfff-00af-47bb-b9e7-8763458aeaf5 tempest-CreateVolumesFromSnapshotTest-448065929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:40:43 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-b7b2dfff-00af-47bb-b9e7-8763458aeaf5 tempest-CreateVolumesFromSnapshotTest-448065929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:40:43 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-b7b2dfff-00af-47bb-b9e7-8763458aeaf5 tempest-CreateVolumesFromSnapshotTest-448065929 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:40:43 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-b7b2dfff-00af-47bb-b9e7-8763458aeaf5 tempest-CreateVolumesFromSnapshotTest-448065929 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:40:43 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-b7b2dfff-00af-47bb-b9e7-8763458aeaf5 tempest-CreateVolumesFromSnapshotTest-448065929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-f2588993-e2ec-4de4-83c8-9367a261bb82 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:40:43 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-b819f6d3-6ef4-44c1-8329-5d9db10164a2 tempest-CreateVolumesFromSnapshotTest-448065929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48c1bfae-ae4a-4e78-a354-9f1993c336bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea3b2573-f5c0-48c7-9173-b5e8a62921c0', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:40:43 devstack sudo[113358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-f2588993-e2ec-4de4-83c8-9367a261bb82 1073741824 Aug 26 14:40:43 devstack sudo[113358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:40:43 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-b819f6d3-6ef4-44c1-8329-5d9db10164a2 tempest-CreateVolumesFromSnapshotTest-448065929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6a9b258-c762-40eb-9d29-f0a3d90c5888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:40:43 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-b819f6d3-6ef4-44c1-8329-5d9db10164a2 tempest-CreateVolumesFromSnapshotTest-448065929 None] Volume volume-ea3b2573-f5c0-48c7-9173-b5e8a62921c0 (ea3b2573-f5c0-48c7-9173-b5e8a62921c0): created successfully Aug 26 14:40:43 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-b819f6d3-6ef4-44c1-8329-5d9db10164a2 tempest-CreateVolumesFromSnapshotTest-448065929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6a9b258-c762-40eb-9d29-f0a3d90c5888) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:40:43 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-b819f6d3-6ef4-44c1-8329-5d9db10164a2 tempest-CreateVolumesFromSnapshotTest-448065929 None] Flow 'volume_create_manager' (e26995d3-cf89-46cf-b14e-b0ecddce3c65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:40:43 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-b819f6d3-6ef4-44c1-8329-5d9db10164a2 tempest-CreateVolumesFromSnapshotTest-448065929 None] Created volume successfully. Aug 26 14:40:43 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-511c4bd2-2cca-47f1-887a-fd6342395081 tempest-CreateVolumesFromSnapshotTest-448065929 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:40:43 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-511c4bd2-2cca-47f1-887a-fd6342395081 tempest-CreateVolumesFromSnapshotTest-448065929 None] Flow 'volume_create_manager' (dc9a5d8c-0426-4a33-9a20-53a68d363e69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:40:43 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-511c4bd2-2cca-47f1-887a-fd6342395081 tempest-CreateVolumesFromSnapshotTest-448065929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55dff765-9039-4ff8-8e3f-d3f8eb11abd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:40:43 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-511c4bd2-2cca-47f1-887a-fd6342395081 tempest-CreateVolumesFromSnapshotTest-448065929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55dff765-9039-4ff8-8e3f-d3f8eb11abd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:40:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1921187130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10c09333-ac02-43f1-95c2-f1e725cf112f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57fb2632a3a141179b2f40e9ee4f09aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:40:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:40:44Z,use_quota=True,user_id='8997de84788a442ab76d411bce0c656d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:40:43 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-511c4bd2-2cca-47f1-887a-fd6342395081 tempest-CreateVolumesFromSnapshotTest-448065929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88946c19-71c7-4c83-a7c2-ecbc78938f8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:40:43 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-511c4bd2-2cca-47f1-887a-fd6342395081 tempest-CreateVolumesFromSnapshotTest-448065929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88946c19-71c7-4c83-a7c2-ecbc78938f8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:40:43 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-511c4bd2-2cca-47f1-887a-fd6342395081 tempest-CreateVolumesFromSnapshotTest-448065929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6257b51b-0255-40c7-89a0-31fc525be760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:40:43 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-511c4bd2-2cca-47f1-887a-fd6342395081 tempest-CreateVolumesFromSnapshotTest-448065929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6257b51b-0255-40c7-89a0-31fc525be760) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10c09333-ac02-43f1-95c2-f1e725cf112f', 'volume_name': 'volume-10c09333-ac02-43f1-95c2-f1e725cf112f', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:40:43 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-511c4bd2-2cca-47f1-887a-fd6342395081 tempest-CreateVolumesFromSnapshotTest-448065929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7c081c8-e339-451e-912b-a7bf33e77632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:40:43 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-511c4bd2-2cca-47f1-887a-fd6342395081 tempest-CreateVolumesFromSnapshotTest-448065929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7c081c8-e339-451e-912b-a7bf33e77632) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:40:43 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-511c4bd2-2cca-47f1-887a-fd6342395081 tempest-CreateVolumesFromSnapshotTest-448065929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (debf0974-02ae-48f3-8b9b-340f9f8bd789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:40:43 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-511c4bd2-2cca-47f1-887a-fd6342395081 tempest-CreateVolumesFromSnapshotTest-448065929 None] Volume 10c09333-ac02-43f1-95c2-f1e725cf112f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10c09333-ac02-43f1-95c2-f1e725cf112f', 'volume_size': 1} Aug 26 14:40:43 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-511c4bd2-2cca-47f1-887a-fd6342395081 tempest-CreateVolumesFromSnapshotTest-448065929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:40:43 devstack sudo[113358]: pam_unix(sudo:session): session closed for user root Aug 26 14:40:43 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-b7b2dfff-00af-47bb-b9e7-8763458aeaf5 tempest-CreateVolumesFromSnapshotTest-448065929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-f2588993-e2ec-4de4-83c8-9367a261bb82 1073741824" returned: 0 in 0.491s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:40:43 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-b7b2dfff-00af-47bb-b9e7-8763458aeaf5 tempest-CreateVolumesFromSnapshotTest-448065929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-f2588993-e2ec-4de4-83c8-9367a261bb82 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:40:43 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d1d5d1d-1b19-4241-bb20-73d8f12dec88 tempest-CreateVolumesFromSnapshotTest-448065929 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:40:43 devstack sudo[113364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-f2588993-e2ec-4de4-83c8-9367a261bb82 Aug 26 14:40:43 devstack sudo[113364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:40:43 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-2d1d5d1d-1b19-4241-bb20-73d8f12dec88 tempest-CreateVolumesFromSnapshotTest-448065929 None] Flow 'volume_create_manager' (81214d04-43a5-4959-8203-25e0cfe82324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:40:43 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-2d1d5d1d-1b19-4241-bb20-73d8f12dec88 tempest-CreateVolumesFromSnapshotTest-448065929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (225abd97-0510-4f42-a03b-52ccf81364e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:40:43 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-2d1d5d1d-1b19-4241-bb20-73d8f12dec88 tempest-CreateVolumesFromSnapshotTest-448065929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (225abd97-0510-4f42-a03b-52ccf81364e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:40:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1988765563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cf38234-0cda-4688-b730-09e13fee8aca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57fb2632a3a141179b2f40e9ee4f09aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:40:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:40:44Z,use_quota=True,user_id='8997de84788a442ab76d411bce0c656d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:40:43 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-2d1d5d1d-1b19-4241-bb20-73d8f12dec88 tempest-CreateVolumesFromSnapshotTest-448065929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2141f87e-8a04-4eed-ba67-92b7509141ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:40:43 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-2d1d5d1d-1b19-4241-bb20-73d8f12dec88 tempest-CreateVolumesFromSnapshotTest-448065929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2141f87e-8a04-4eed-ba67-92b7509141ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:40:43 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-2d1d5d1d-1b19-4241-bb20-73d8f12dec88 tempest-CreateVolumesFromSnapshotTest-448065929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28e8a970-5ed7-46ac-b495-21e82d11355f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:40:43 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-2d1d5d1d-1b19-4241-bb20-73d8f12dec88 tempest-CreateVolumesFromSnapshotTest-448065929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28e8a970-5ed7-46ac-b495-21e82d11355f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0cf38234-0cda-4688-b730-09e13fee8aca', 'volume_name': 'volume-0cf38234-0cda-4688-b730-09e13fee8aca', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:40:43 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-2d1d5d1d-1b19-4241-bb20-73d8f12dec88 tempest-CreateVolumesFromSnapshotTest-448065929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9437c8c3-b91f-485f-8d1c-4f2e268c93e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:40:43 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-2d1d5d1d-1b19-4241-bb20-73d8f12dec88 tempest-CreateVolumesFromSnapshotTest-448065929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9437c8c3-b91f-485f-8d1c-4f2e268c93e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:40:43 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-2d1d5d1d-1b19-4241-bb20-73d8f12dec88 tempest-CreateVolumesFromSnapshotTest-448065929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54d369f6-1eb0-4ada-bedc-da4056814902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:40:43 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-2d1d5d1d-1b19-4241-bb20-73d8f12dec88 tempest-CreateVolumesFromSnapshotTest-448065929 None] Volume 0cf38234-0cda-4688-b730-09e13fee8aca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0cf38234-0cda-4688-b730-09e13fee8aca', 'volume_size': 1} Aug 26 14:40:43 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-2d1d5d1d-1b19-4241-bb20-73d8f12dec88 tempest-CreateVolumesFromSnapshotTest-448065929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:40:44 devstack sudo[113364]: pam_unix(sudo:session): session closed for user root Aug 26 14:40:44 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-b7b2dfff-00af-47bb-b9e7-8763458aeaf5 tempest-CreateVolumesFromSnapshotTest-448065929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-f2588993-e2ec-4de4-83c8-9367a261bb82" returned: 0 in 0.248s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:40:44 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-b7b2dfff-00af-47bb-b9e7-8763458aeaf5 tempest-CreateVolumesFromSnapshotTest-448065929 None] <== create_volume: return (784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:40:44 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-b7b2dfff-00af-47bb-b9e7-8763458aeaf5 tempest-CreateVolumesFromSnapshotTest-448065929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.787s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:40:44 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-31d40fbb-1a26-4e91-b4e7-38158ef38759 tempest-CreateVolumesFromSnapshotTest-448065929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.929s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:40:44 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-31d40fbb-1a26-4e91-b4e7-38158ef38759 tempest-CreateVolumesFromSnapshotTest-448065929 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:40:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-858030779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a464aec-4171-4e46-8ba6-d5db59480853,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57fb2632a3a141179b2f40e9ee4f09aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:40:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:40:43Z,use_quota=True,user_id='8997de84788a442ab76d411bce0c656d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:40:44 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-31d40fbb-1a26-4e91-b4e7-38158ef38759 tempest-CreateVolumesFromSnapshotTest-448065929 None] Creating volume 6a464aec-4171-4e46-8ba6-d5db59480853 {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:40:44 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-31d40fbb-1a26-4e91-b4e7-38158ef38759 tempest-CreateVolumesFromSnapshotTest-448065929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:40:44 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-31d40fbb-1a26-4e91-b4e7-38158ef38759 tempest-CreateVolumesFromSnapshotTest-448065929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:40:44 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-31d40fbb-1a26-4e91-b4e7-38158ef38759 tempest-CreateVolumesFromSnapshotTest-448065929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:40:44 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-31d40fbb-1a26-4e91-b4e7-38158ef38759 tempest-CreateVolumesFromSnapshotTest-448065929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:40:44 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-31d40fbb-1a26-4e91-b4e7-38158ef38759 tempest-CreateVolumesFromSnapshotTest-448065929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:40:44 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-31d40fbb-1a26-4e91-b4e7-38158ef38759 tempest-CreateVolumesFromSnapshotTest-448065929 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:40:44 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-31d40fbb-1a26-4e91-b4e7-38158ef38759 tempest-CreateVolumesFromSnapshotTest-448065929 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:40:44 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-31d40fbb-1a26-4e91-b4e7-38158ef38759 tempest-CreateVolumesFromSnapshotTest-448065929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6a464aec-4171-4e46-8ba6-d5db59480853 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:40:44 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-b7b2dfff-00af-47bb-b9e7-8763458aeaf5 tempest-CreateVolumesFromSnapshotTest-448065929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e46a214e-4727-43fe-87ab-a3daba1774a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2588993-e2ec-4de4-83c8-9367a261bb82', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:40:44 devstack sudo[113367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6a464aec-4171-4e46-8ba6-d5db59480853 1073741824 Aug 26 14:40:44 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-b7b2dfff-00af-47bb-b9e7-8763458aeaf5 tempest-CreateVolumesFromSnapshotTest-448065929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9509eb1f-acbe-4761-9f4b-89384e07386e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:40:44 devstack sudo[113367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:40:44 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-b7b2dfff-00af-47bb-b9e7-8763458aeaf5 tempest-CreateVolumesFromSnapshotTest-448065929 None] Volume volume-f2588993-e2ec-4de4-83c8-9367a261bb82 (f2588993-e2ec-4de4-83c8-9367a261bb82): created successfully Aug 26 14:40:44 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-b7b2dfff-00af-47bb-b9e7-8763458aeaf5 tempest-CreateVolumesFromSnapshotTest-448065929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9509eb1f-acbe-4761-9f4b-89384e07386e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:40:44 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-b7b2dfff-00af-47bb-b9e7-8763458aeaf5 tempest-CreateVolumesFromSnapshotTest-448065929 None] Flow 'volume_create_manager' (ae926fcf-cb92-460a-a6cd-96660ecdf09d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:40:44 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-b7b2dfff-00af-47bb-b9e7-8763458aeaf5 tempest-CreateVolumesFromSnapshotTest-448065929 None] Created volume successfully. Aug 26 14:40:44 devstack sudo[113367]: pam_unix(sudo:session): session closed for user root Aug 26 14:40:44 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-31d40fbb-1a26-4e91-b4e7-38158ef38759 tempest-CreateVolumesFromSnapshotTest-448065929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6a464aec-4171-4e46-8ba6-d5db59480853 1073741824" returned: 0 in 0.404s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:40:44 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-31d40fbb-1a26-4e91-b4e7-38158ef38759 tempest-CreateVolumesFromSnapshotTest-448065929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6a464aec-4171-4e46-8ba6-d5db59480853 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:40:44 devstack sudo[113372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6a464aec-4171-4e46-8ba6-d5db59480853 Aug 26 14:40:44 devstack sudo[113372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:40:44 devstack sudo[113372]: pam_unix(sudo:session): session closed for user root Aug 26 14:40:44 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-31d40fbb-1a26-4e91-b4e7-38158ef38759 tempest-CreateVolumesFromSnapshotTest-448065929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6a464aec-4171-4e46-8ba6-d5db59480853" returned: 0 in 0.240s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:40:44 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-31d40fbb-1a26-4e91-b4e7-38158ef38759 tempest-CreateVolumesFromSnapshotTest-448065929 None] <== create_volume: return (678ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:40:44 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-31d40fbb-1a26-4e91-b4e7-38158ef38759 tempest-CreateVolumesFromSnapshotTest-448065929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.681s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:40:44 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-511c4bd2-2cca-47f1-887a-fd6342395081 tempest-CreateVolumesFromSnapshotTest-448065929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.168s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:40:44 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-511c4bd2-2cca-47f1-887a-fd6342395081 tempest-CreateVolumesFromSnapshotTest-448065929 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:40:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1921187130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10c09333-ac02-43f1-95c2-f1e725cf112f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57fb2632a3a141179b2f40e9ee4f09aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:40:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:40:44Z,use_quota=True,user_id='8997de84788a442ab76d411bce0c656d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:40:44 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-511c4bd2-2cca-47f1-887a-fd6342395081 tempest-CreateVolumesFromSnapshotTest-448065929 None] Creating volume 10c09333-ac02-43f1-95c2-f1e725cf112f {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:40:44 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-511c4bd2-2cca-47f1-887a-fd6342395081 tempest-CreateVolumesFromSnapshotTest-448065929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:40:44 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-511c4bd2-2cca-47f1-887a-fd6342395081 tempest-CreateVolumesFromSnapshotTest-448065929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:40:44 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-511c4bd2-2cca-47f1-887a-fd6342395081 tempest-CreateVolumesFromSnapshotTest-448065929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:40:44 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-511c4bd2-2cca-47f1-887a-fd6342395081 tempest-CreateVolumesFromSnapshotTest-448065929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:40:44 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-511c4bd2-2cca-47f1-887a-fd6342395081 tempest-CreateVolumesFromSnapshotTest-448065929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:40:44 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-511c4bd2-2cca-47f1-887a-fd6342395081 tempest-CreateVolumesFromSnapshotTest-448065929 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:40:44 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-511c4bd2-2cca-47f1-887a-fd6342395081 tempest-CreateVolumesFromSnapshotTest-448065929 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:40:44 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-511c4bd2-2cca-47f1-887a-fd6342395081 tempest-CreateVolumesFromSnapshotTest-448065929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-10c09333-ac02-43f1-95c2-f1e725cf112f 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:40:44 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-31d40fbb-1a26-4e91-b4e7-38158ef38759 tempest-CreateVolumesFromSnapshotTest-448065929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc49f4fd-f0f9-4577-be59-f1e4764b9949) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a464aec-4171-4e46-8ba6-d5db59480853', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:40:44 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-31d40fbb-1a26-4e91-b4e7-38158ef38759 tempest-CreateVolumesFromSnapshotTest-448065929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd1b239c-98d3-4fd1-91d0-f9a26fa57ca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:40:44 devstack sudo[113375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-10c09333-ac02-43f1-95c2-f1e725cf112f 1073741824 Aug 26 14:40:44 devstack sudo[113375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:40:44 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-31d40fbb-1a26-4e91-b4e7-38158ef38759 tempest-CreateVolumesFromSnapshotTest-448065929 None] Volume volume-6a464aec-4171-4e46-8ba6-d5db59480853 (6a464aec-4171-4e46-8ba6-d5db59480853): created successfully Aug 26 14:40:44 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-31d40fbb-1a26-4e91-b4e7-38158ef38759 tempest-CreateVolumesFromSnapshotTest-448065929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd1b239c-98d3-4fd1-91d0-f9a26fa57ca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:40:44 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-31d40fbb-1a26-4e91-b4e7-38158ef38759 tempest-CreateVolumesFromSnapshotTest-448065929 None] Flow 'volume_create_manager' (571ee194-5533-4db7-bf35-f31ec44ebdf6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:40:44 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-31d40fbb-1a26-4e91-b4e7-38158ef38759 tempest-CreateVolumesFromSnapshotTest-448065929 None] Created volume successfully. Aug 26 14:40:45 devstack sudo[113375]: pam_unix(sudo:session): session closed for user root Aug 26 14:40:45 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-511c4bd2-2cca-47f1-887a-fd6342395081 tempest-CreateVolumesFromSnapshotTest-448065929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-10c09333-ac02-43f1-95c2-f1e725cf112f 1073741824" returned: 0 in 0.458s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:40:45 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-511c4bd2-2cca-47f1-887a-fd6342395081 tempest-CreateVolumesFromSnapshotTest-448065929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-10c09333-ac02-43f1-95c2-f1e725cf112f {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:40:45 devstack sudo[113383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-10c09333-ac02-43f1-95c2-f1e725cf112f Aug 26 14:40:45 devstack sudo[113383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:40:45 devstack sudo[113383]: pam_unix(sudo:session): session closed for user root Aug 26 14:40:45 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-511c4bd2-2cca-47f1-887a-fd6342395081 tempest-CreateVolumesFromSnapshotTest-448065929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-10c09333-ac02-43f1-95c2-f1e725cf112f" returned: 0 in 0.243s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:40:45 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-511c4bd2-2cca-47f1-887a-fd6342395081 tempest-CreateVolumesFromSnapshotTest-448065929 None] <== create_volume: return (743ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:40:45 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-511c4bd2-2cca-47f1-887a-fd6342395081 tempest-CreateVolumesFromSnapshotTest-448065929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.746s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:40:45 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-2d1d5d1d-1b19-4241-bb20-73d8f12dec88 tempest-CreateVolumesFromSnapshotTest-448065929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.585s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:40:45 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-2d1d5d1d-1b19-4241-bb20-73d8f12dec88 tempest-CreateVolumesFromSnapshotTest-448065929 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:40:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1988765563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cf38234-0cda-4688-b730-09e13fee8aca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57fb2632a3a141179b2f40e9ee4f09aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:40:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:40:44Z,use_quota=True,user_id='8997de84788a442ab76d411bce0c656d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:40:45 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-2d1d5d1d-1b19-4241-bb20-73d8f12dec88 tempest-CreateVolumesFromSnapshotTest-448065929 None] Creating volume 0cf38234-0cda-4688-b730-09e13fee8aca {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:40:45 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-2d1d5d1d-1b19-4241-bb20-73d8f12dec88 tempest-CreateVolumesFromSnapshotTest-448065929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:40:45 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-2d1d5d1d-1b19-4241-bb20-73d8f12dec88 tempest-CreateVolumesFromSnapshotTest-448065929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:40:45 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-2d1d5d1d-1b19-4241-bb20-73d8f12dec88 tempest-CreateVolumesFromSnapshotTest-448065929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:40:45 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-2d1d5d1d-1b19-4241-bb20-73d8f12dec88 tempest-CreateVolumesFromSnapshotTest-448065929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:40:45 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-2d1d5d1d-1b19-4241-bb20-73d8f12dec88 tempest-CreateVolumesFromSnapshotTest-448065929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:40:45 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-2d1d5d1d-1b19-4241-bb20-73d8f12dec88 tempest-CreateVolumesFromSnapshotTest-448065929 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:40:45 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-2d1d5d1d-1b19-4241-bb20-73d8f12dec88 tempest-CreateVolumesFromSnapshotTest-448065929 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:40:45 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-2d1d5d1d-1b19-4241-bb20-73d8f12dec88 tempest-CreateVolumesFromSnapshotTest-448065929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0cf38234-0cda-4688-b730-09e13fee8aca 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:40:45 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-511c4bd2-2cca-47f1-887a-fd6342395081 tempest-CreateVolumesFromSnapshotTest-448065929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (debf0974-02ae-48f3-8b9b-340f9f8bd789) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10c09333-ac02-43f1-95c2-f1e725cf112f', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:40:45 devstack sudo[113386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0cf38234-0cda-4688-b730-09e13fee8aca 1073741824 Aug 26 14:40:45 devstack sudo[113386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:40:45 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-511c4bd2-2cca-47f1-887a-fd6342395081 tempest-CreateVolumesFromSnapshotTest-448065929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de4fdd6c-e2a1-40af-a87e-3aa5f8ba3bce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:40:45 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-511c4bd2-2cca-47f1-887a-fd6342395081 tempest-CreateVolumesFromSnapshotTest-448065929 None] Volume volume-10c09333-ac02-43f1-95c2-f1e725cf112f (10c09333-ac02-43f1-95c2-f1e725cf112f): created successfully Aug 26 14:40:45 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-511c4bd2-2cca-47f1-887a-fd6342395081 tempest-CreateVolumesFromSnapshotTest-448065929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de4fdd6c-e2a1-40af-a87e-3aa5f8ba3bce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:40:45 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-511c4bd2-2cca-47f1-887a-fd6342395081 tempest-CreateVolumesFromSnapshotTest-448065929 None] Flow 'volume_create_manager' (dc9a5d8c-0426-4a33-9a20-53a68d363e69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:40:45 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-511c4bd2-2cca-47f1-887a-fd6342395081 tempest-CreateVolumesFromSnapshotTest-448065929 None] Created volume successfully. Aug 26 14:40:46 devstack sudo[113386]: pam_unix(sudo:session): session closed for user root Aug 26 14:40:46 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-2d1d5d1d-1b19-4241-bb20-73d8f12dec88 tempest-CreateVolumesFromSnapshotTest-448065929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0cf38234-0cda-4688-b730-09e13fee8aca 1073741824" returned: 0 in 0.422s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:40:46 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-2d1d5d1d-1b19-4241-bb20-73d8f12dec88 tempest-CreateVolumesFromSnapshotTest-448065929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0cf38234-0cda-4688-b730-09e13fee8aca {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:40:46 devstack sudo[113392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0cf38234-0cda-4688-b730-09e13fee8aca Aug 26 14:40:46 devstack sudo[113392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:40:46 devstack sudo[113392]: pam_unix(sudo:session): session closed for user root Aug 26 14:40:46 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-2d1d5d1d-1b19-4241-bb20-73d8f12dec88 tempest-CreateVolumesFromSnapshotTest-448065929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0cf38234-0cda-4688-b730-09e13fee8aca" returned: 0 in 0.242s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:40:46 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-2d1d5d1d-1b19-4241-bb20-73d8f12dec88 tempest-CreateVolumesFromSnapshotTest-448065929 None] <== create_volume: return (699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:40:46 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-2d1d5d1d-1b19-4241-bb20-73d8f12dec88 tempest-CreateVolumesFromSnapshotTest-448065929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.702s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:40:46 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-2d1d5d1d-1b19-4241-bb20-73d8f12dec88 tempest-CreateVolumesFromSnapshotTest-448065929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54d369f6-1eb0-4ada-bedc-da4056814902) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0cf38234-0cda-4688-b730-09e13fee8aca', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:40:46 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-2d1d5d1d-1b19-4241-bb20-73d8f12dec88 tempest-CreateVolumesFromSnapshotTest-448065929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26d130df-333a-4b0c-8cab-51349b7a3b99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:40:46 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-2d1d5d1d-1b19-4241-bb20-73d8f12dec88 tempest-CreateVolumesFromSnapshotTest-448065929 None] Volume volume-0cf38234-0cda-4688-b730-09e13fee8aca (0cf38234-0cda-4688-b730-09e13fee8aca): created successfully Aug 26 14:40:46 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-2d1d5d1d-1b19-4241-bb20-73d8f12dec88 tempest-CreateVolumesFromSnapshotTest-448065929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26d130df-333a-4b0c-8cab-51349b7a3b99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:40:46 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-2d1d5d1d-1b19-4241-bb20-73d8f12dec88 tempest-CreateVolumesFromSnapshotTest-448065929 None] Flow 'volume_create_manager' (81214d04-43a5-4959-8203-25e0cfe82324) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:40:46 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-2d1d5d1d-1b19-4241-bb20-73d8f12dec88 tempest-CreateVolumesFromSnapshotTest-448065929 None] Created volume successfully. Aug 26 14:40:47 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-0a1f7fe7-a345-44ce-a1b6-ce541b543f92 tempest-CreateVolumesFromSnapshotTest-448065929 None] Acquiring lock "cinder-0cf38234-0cda-4688-b730-09e13fee8aca-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:40:47 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-0a1f7fe7-a345-44ce-a1b6-ce541b543f92 tempest-CreateVolumesFromSnapshotTest-448065929 None] Lock "cinder-0cf38234-0cda-4688-b730-09e13fee8aca-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:40:47 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-0a1f7fe7-a345-44ce-a1b6-ce541b543f92 tempest-CreateVolumesFromSnapshotTest-448065929 None] Acquiring lock "cinder-quobyte-0cf38234-0cda-4688-b730-09e13fee8aca" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:40:47 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-0a1f7fe7-a345-44ce-a1b6-ce541b543f92 tempest-CreateVolumesFromSnapshotTest-448065929 None] Lock "cinder-quobyte-0cf38234-0cda-4688-b730-09e13fee8aca" acquired by "delete_volume" :: waited 0.016s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:40:47 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e642495-065d-4320-a061-16d7c8b90478]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:40:47 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-0a1f7fe7-a345-44ce-a1b6-ce541b543f92 tempest-CreateVolumesFromSnapshotTest-448065929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0cf38234-0cda-4688-b730-09e13fee8aca {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:40:47 devstack sudo[113395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0cf38234-0cda-4688-b730-09e13fee8aca Aug 26 14:40:47 devstack sudo[113395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:40:47 devstack sudo[113395]: pam_unix(sudo:session): session closed for user root Aug 26 14:40:47 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-0a1f7fe7-a345-44ce-a1b6-ce541b543f92 tempest-CreateVolumesFromSnapshotTest-448065929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0cf38234-0cda-4688-b730-09e13fee8aca" returned: 0 in 0.342s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:40:47 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-0a1f7fe7-a345-44ce-a1b6-ce541b543f92 tempest-CreateVolumesFromSnapshotTest-448065929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0cf38234-0cda-4688-b730-09e13fee8aca {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:40:47 devstack sudo[113400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0cf38234-0cda-4688-b730-09e13fee8aca Aug 26 14:40:47 devstack sudo[113400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:40:47 devstack sudo[113400]: pam_unix(sudo:session): session closed for user root Aug 26 14:40:47 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-0a1f7fe7-a345-44ce-a1b6-ce541b543f92 tempest-CreateVolumesFromSnapshotTest-448065929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0cf38234-0cda-4688-b730-09e13fee8aca" returned: 0 in 0.245s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:40:47 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-0a1f7fe7-a345-44ce-a1b6-ce541b543f92 tempest-CreateVolumesFromSnapshotTest-448065929 None] Lock "cinder-quobyte-0cf38234-0cda-4688-b730-09e13fee8aca" released by "delete_volume" :: held 0.621s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:40:48 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-0a1f7fe7-a345-44ce-a1b6-ce541b543f92 tempest-CreateVolumesFromSnapshotTest-448065929 None] Created reservations ['dee33a55-1962-42c9-ba3b-6ca5d0b02a4e', 'c2be33e2-0855-469e-86d1-b353049d6245', '15e5d6bc-4c5d-41a2-9fab-aaff17604667', 'a3d9fa5d-f333-4a86-a4a8-26f7c1dbb674'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:40:48 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-0a1f7fe7-a345-44ce-a1b6-ce541b543f92 tempest-CreateVolumesFromSnapshotTest-448065929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:40:48 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-0a1f7fe7-a345-44ce-a1b6-ce541b543f92 tempest-CreateVolumesFromSnapshotTest-448065929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:40:48 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-0a1f7fe7-a345-44ce-a1b6-ce541b543f92 tempest-CreateVolumesFromSnapshotTest-448065929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:40:48 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-0a1f7fe7-a345-44ce-a1b6-ce541b543f92 tempest-CreateVolumesFromSnapshotTest-448065929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:40:48 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-0a1f7fe7-a345-44ce-a1b6-ce541b543f92 tempest-CreateVolumesFromSnapshotTest-448065929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:40:48 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-0a1f7fe7-a345-44ce-a1b6-ce541b543f92 tempest-CreateVolumesFromSnapshotTest-448065929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:40:48 devstack sudo[113403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:40:48 devstack sudo[113403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:40:48 devstack sudo[113403]: pam_unix(sudo:session): session closed for user root Aug 26 14:40:48 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-0a1f7fe7-a345-44ce-a1b6-ce541b543f92 tempest-CreateVolumesFromSnapshotTest-448065929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.238s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:40:48 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-0a1f7fe7-a345-44ce-a1b6-ce541b543f92 tempest-CreateVolumesFromSnapshotTest-448065929 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:40:48 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-0a1f7fe7-a345-44ce-a1b6-ce541b543f92 tempest-CreateVolumesFromSnapshotTest-448065929 None] Deleted volume successfully. Aug 26 14:40:48 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-0a1f7fe7-a345-44ce-a1b6-ce541b543f92 tempest-CreateVolumesFromSnapshotTest-448065929 None] Lock "cinder-0cf38234-0cda-4688-b730-09e13fee8aca-delete_volume" released by "delete_volume" :: held 1.049s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:40:48 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-fcb15607-4bea-4145-a514-d11a44af2a1e tempest-CreateVolumesFromSnapshotTest-448065929 None] Acquiring lock "cinder-10c09333-ac02-43f1-95c2-f1e725cf112f-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:40:48 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-fcb15607-4bea-4145-a514-d11a44af2a1e tempest-CreateVolumesFromSnapshotTest-448065929 None] Lock "cinder-10c09333-ac02-43f1-95c2-f1e725cf112f-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:40:48 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-fcb15607-4bea-4145-a514-d11a44af2a1e tempest-CreateVolumesFromSnapshotTest-448065929 None] Acquiring lock "cinder-quobyte-10c09333-ac02-43f1-95c2-f1e725cf112f" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:40:48 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-fcb15607-4bea-4145-a514-d11a44af2a1e tempest-CreateVolumesFromSnapshotTest-448065929 None] Lock "cinder-quobyte-10c09333-ac02-43f1-95c2-f1e725cf112f" acquired by "delete_volume" :: waited 0.023s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:40:48 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[b78a1c17-8b30-410b-b714-5fdf984fb912]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:40:48 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-fcb15607-4bea-4145-a514-d11a44af2a1e tempest-CreateVolumesFromSnapshotTest-448065929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-10c09333-ac02-43f1-95c2-f1e725cf112f {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:40:48 devstack sudo[113406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-10c09333-ac02-43f1-95c2-f1e725cf112f Aug 26 14:40:48 devstack sudo[113406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:40:48 devstack sudo[113406]: pam_unix(sudo:session): session closed for user root Aug 26 14:40:48 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-fcb15607-4bea-4145-a514-d11a44af2a1e tempest-CreateVolumesFromSnapshotTest-448065929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-10c09333-ac02-43f1-95c2-f1e725cf112f" returned: 0 in 0.352s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:40:48 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-fcb15607-4bea-4145-a514-d11a44af2a1e tempest-CreateVolumesFromSnapshotTest-448065929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-10c09333-ac02-43f1-95c2-f1e725cf112f {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:40:48 devstack sudo[113412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-10c09333-ac02-43f1-95c2-f1e725cf112f Aug 26 14:40:48 devstack sudo[113412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:40:49 devstack sudo[113412]: pam_unix(sudo:session): session closed for user root Aug 26 14:40:49 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-fcb15607-4bea-4145-a514-d11a44af2a1e tempest-CreateVolumesFromSnapshotTest-448065929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-10c09333-ac02-43f1-95c2-f1e725cf112f" returned: 0 in 0.241s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:40:49 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-fcb15607-4bea-4145-a514-d11a44af2a1e tempest-CreateVolumesFromSnapshotTest-448065929 None] Lock "cinder-quobyte-10c09333-ac02-43f1-95c2-f1e725cf112f" released by "delete_volume" :: held 0.634s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:40:49 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-fcb15607-4bea-4145-a514-d11a44af2a1e tempest-CreateVolumesFromSnapshotTest-448065929 None] Created reservations ['a811cdc3-aa65-4048-a4bc-0f92a01d0c42', '081ebe94-838d-4ec4-9a1a-c1f29883154a', '021be240-d7fa-4ca9-addc-09c46883c0e0', '5e6c340b-329a-42ca-950c-3bce2d141e3e'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:40:49 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-fcb15607-4bea-4145-a514-d11a44af2a1e tempest-CreateVolumesFromSnapshotTest-448065929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:40:49 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-fcb15607-4bea-4145-a514-d11a44af2a1e tempest-CreateVolumesFromSnapshotTest-448065929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:40:49 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-fcb15607-4bea-4145-a514-d11a44af2a1e tempest-CreateVolumesFromSnapshotTest-448065929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:40:49 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-fcb15607-4bea-4145-a514-d11a44af2a1e tempest-CreateVolumesFromSnapshotTest-448065929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:40:49 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-fcb15607-4bea-4145-a514-d11a44af2a1e tempest-CreateVolumesFromSnapshotTest-448065929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:40:49 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-fcb15607-4bea-4145-a514-d11a44af2a1e tempest-CreateVolumesFromSnapshotTest-448065929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:40:49 devstack sudo[113415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:40:49 devstack sudo[113415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:40:49 devstack sudo[113415]: pam_unix(sudo:session): session closed for user root Aug 26 14:40:49 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-fcb15607-4bea-4145-a514-d11a44af2a1e tempest-CreateVolumesFromSnapshotTest-448065929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.242s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:40:49 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-fcb15607-4bea-4145-a514-d11a44af2a1e tempest-CreateVolumesFromSnapshotTest-448065929 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:40:49 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-fcb15607-4bea-4145-a514-d11a44af2a1e tempest-CreateVolumesFromSnapshotTest-448065929 None] Deleted volume successfully. Aug 26 14:40:49 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-fcb15607-4bea-4145-a514-d11a44af2a1e tempest-CreateVolumesFromSnapshotTest-448065929 None] Lock "cinder-10c09333-ac02-43f1-95c2-f1e725cf112f-delete_volume" released by "delete_volume" :: held 1.071s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:40:49 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-968a3309-1660-4924-a596-067443348ca9 tempest-CreateVolumesFromSnapshotTest-448065929 None] Acquiring lock "cinder-6a464aec-4171-4e46-8ba6-d5db59480853-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:40:49 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-968a3309-1660-4924-a596-067443348ca9 tempest-CreateVolumesFromSnapshotTest-448065929 None] Lock "cinder-6a464aec-4171-4e46-8ba6-d5db59480853-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:40:49 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-968a3309-1660-4924-a596-067443348ca9 tempest-CreateVolumesFromSnapshotTest-448065929 None] Acquiring lock "cinder-quobyte-6a464aec-4171-4e46-8ba6-d5db59480853" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:40:49 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-968a3309-1660-4924-a596-067443348ca9 tempest-CreateVolumesFromSnapshotTest-448065929 None] Lock "cinder-quobyte-6a464aec-4171-4e46-8ba6-d5db59480853" acquired by "delete_volume" :: waited 0.013s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:40:49 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab6390c1-64bf-4aa4-b094-5c11a5064342]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:40:49 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-968a3309-1660-4924-a596-067443348ca9 tempest-CreateVolumesFromSnapshotTest-448065929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6a464aec-4171-4e46-8ba6-d5db59480853 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:40:49 devstack sudo[113418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6a464aec-4171-4e46-8ba6-d5db59480853 Aug 26 14:40:49 devstack sudo[113418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:40:50 devstack sudo[113418]: pam_unix(sudo:session): session closed for user root Aug 26 14:40:50 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-968a3309-1660-4924-a596-067443348ca9 tempest-CreateVolumesFromSnapshotTest-448065929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6a464aec-4171-4e46-8ba6-d5db59480853" returned: 0 in 0.347s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:40:50 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-968a3309-1660-4924-a596-067443348ca9 tempest-CreateVolumesFromSnapshotTest-448065929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6a464aec-4171-4e46-8ba6-d5db59480853 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:40:50 devstack sudo[113423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6a464aec-4171-4e46-8ba6-d5db59480853 Aug 26 14:40:50 devstack sudo[113423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:40:50 devstack sudo[113423]: pam_unix(sudo:session): session closed for user root Aug 26 14:40:50 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-968a3309-1660-4924-a596-067443348ca9 tempest-CreateVolumesFromSnapshotTest-448065929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6a464aec-4171-4e46-8ba6-d5db59480853" returned: 0 in 0.235s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:40:50 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-968a3309-1660-4924-a596-067443348ca9 tempest-CreateVolumesFromSnapshotTest-448065929 None] Lock "cinder-quobyte-6a464aec-4171-4e46-8ba6-d5db59480853" released by "delete_volume" :: held 0.620s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:40:50 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-968a3309-1660-4924-a596-067443348ca9 tempest-CreateVolumesFromSnapshotTest-448065929 None] Created reservations ['a871b4fc-ed67-46d0-816e-135b39ea6bb5', '5099d7ad-2f32-400d-85ba-4f11c9013035', '2bca9984-0c35-4940-8454-be355bd5815b', '2b2f7a5c-bea4-454b-b419-05d87efd1f66'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:40:50 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-968a3309-1660-4924-a596-067443348ca9 tempest-CreateVolumesFromSnapshotTest-448065929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:40:50 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-968a3309-1660-4924-a596-067443348ca9 tempest-CreateVolumesFromSnapshotTest-448065929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:40:50 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-968a3309-1660-4924-a596-067443348ca9 tempest-CreateVolumesFromSnapshotTest-448065929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:40:50 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-968a3309-1660-4924-a596-067443348ca9 tempest-CreateVolumesFromSnapshotTest-448065929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:40:50 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-968a3309-1660-4924-a596-067443348ca9 tempest-CreateVolumesFromSnapshotTest-448065929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:40:50 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-968a3309-1660-4924-a596-067443348ca9 tempest-CreateVolumesFromSnapshotTest-448065929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:40:50 devstack sudo[113427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:40:50 devstack sudo[113427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:40:50 devstack sudo[113427]: pam_unix(sudo:session): session closed for user root Aug 26 14:40:50 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-968a3309-1660-4924-a596-067443348ca9 tempest-CreateVolumesFromSnapshotTest-448065929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.236s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:40:50 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-968a3309-1660-4924-a596-067443348ca9 tempest-CreateVolumesFromSnapshotTest-448065929 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:40:50 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-968a3309-1660-4924-a596-067443348ca9 tempest-CreateVolumesFromSnapshotTest-448065929 None] Deleted volume successfully. Aug 26 14:40:50 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-968a3309-1660-4924-a596-067443348ca9 tempest-CreateVolumesFromSnapshotTest-448065929 None] Lock "cinder-6a464aec-4171-4e46-8ba6-d5db59480853-delete_volume" released by "delete_volume" :: held 1.035s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:40:50 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-6e3e5aad-0e27-411d-bed4-441926246421 tempest-CreateVolumesFromSnapshotTest-448065929 None] Acquiring lock "cinder-f2588993-e2ec-4de4-83c8-9367a261bb82-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:40:50 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-6e3e5aad-0e27-411d-bed4-441926246421 tempest-CreateVolumesFromSnapshotTest-448065929 None] Lock "cinder-f2588993-e2ec-4de4-83c8-9367a261bb82-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:40:50 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-6e3e5aad-0e27-411d-bed4-441926246421 tempest-CreateVolumesFromSnapshotTest-448065929 None] Acquiring lock "cinder-quobyte-f2588993-e2ec-4de4-83c8-9367a261bb82" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:40:50 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-6e3e5aad-0e27-411d-bed4-441926246421 tempest-CreateVolumesFromSnapshotTest-448065929 None] Lock "cinder-quobyte-f2588993-e2ec-4de4-83c8-9367a261bb82" acquired by "delete_volume" :: waited 0.016s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:40:50 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[1398b518-2a9a-41bf-bfdf-0ad4a8880f0f]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:40:50 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-6e3e5aad-0e27-411d-bed4-441926246421 tempest-CreateVolumesFromSnapshotTest-448065929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-f2588993-e2ec-4de4-83c8-9367a261bb82 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:40:50 devstack sudo[113431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-f2588993-e2ec-4de4-83c8-9367a261bb82 Aug 26 14:40:50 devstack sudo[113431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:40:51 devstack sudo[113431]: pam_unix(sudo:session): session closed for user root Aug 26 14:40:51 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-6e3e5aad-0e27-411d-bed4-441926246421 tempest-CreateVolumesFromSnapshotTest-448065929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-f2588993-e2ec-4de4-83c8-9367a261bb82" returned: 0 in 0.348s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:40:51 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-6e3e5aad-0e27-411d-bed4-441926246421 tempest-CreateVolumesFromSnapshotTest-448065929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-f2588993-e2ec-4de4-83c8-9367a261bb82 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:40:51 devstack sudo[113436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-f2588993-e2ec-4de4-83c8-9367a261bb82 Aug 26 14:40:51 devstack sudo[113436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:40:51 devstack sudo[113436]: pam_unix(sudo:session): session closed for user root Aug 26 14:40:51 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-6e3e5aad-0e27-411d-bed4-441926246421 tempest-CreateVolumesFromSnapshotTest-448065929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-f2588993-e2ec-4de4-83c8-9367a261bb82" returned: 0 in 0.240s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:40:51 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-6e3e5aad-0e27-411d-bed4-441926246421 tempest-CreateVolumesFromSnapshotTest-448065929 None] Lock "cinder-quobyte-f2588993-e2ec-4de4-83c8-9367a261bb82" released by "delete_volume" :: held 0.623s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:40:51 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-6e3e5aad-0e27-411d-bed4-441926246421 tempest-CreateVolumesFromSnapshotTest-448065929 None] Created reservations ['c4619f09-ab32-4d94-836d-d25cc63b80f4', 'c7494348-8b36-4508-b29a-af314ef9e961', '6ea24351-7ede-40c5-b3f6-57914ae442a3', '6814b533-4d9f-48b2-bdf2-445c5a8811b8'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:40:51 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-6e3e5aad-0e27-411d-bed4-441926246421 tempest-CreateVolumesFromSnapshotTest-448065929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:40:51 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-6e3e5aad-0e27-411d-bed4-441926246421 tempest-CreateVolumesFromSnapshotTest-448065929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:40:51 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-6e3e5aad-0e27-411d-bed4-441926246421 tempest-CreateVolumesFromSnapshotTest-448065929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:40:51 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-6e3e5aad-0e27-411d-bed4-441926246421 tempest-CreateVolumesFromSnapshotTest-448065929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:40:51 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-6e3e5aad-0e27-411d-bed4-441926246421 tempest-CreateVolumesFromSnapshotTest-448065929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:40:51 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-6e3e5aad-0e27-411d-bed4-441926246421 tempest-CreateVolumesFromSnapshotTest-448065929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:40:51 devstack sudo[113439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:40:51 devstack sudo[113439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:40:51 devstack sudo[113439]: pam_unix(sudo:session): session closed for user root Aug 26 14:40:51 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-6e3e5aad-0e27-411d-bed4-441926246421 tempest-CreateVolumesFromSnapshotTest-448065929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.260s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:40:51 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-6e3e5aad-0e27-411d-bed4-441926246421 tempest-CreateVolumesFromSnapshotTest-448065929 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:40:51 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-6e3e5aad-0e27-411d-bed4-441926246421 tempest-CreateVolumesFromSnapshotTest-448065929 None] Deleted volume successfully. Aug 26 14:40:51 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-6e3e5aad-0e27-411d-bed4-441926246421 tempest-CreateVolumesFromSnapshotTest-448065929 None] Lock "cinder-f2588993-e2ec-4de4-83c8-9367a261bb82-delete_volume" released by "delete_volume" :: held 1.068s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:40:51 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-a8fdc2aa-86a4-4966-b64b-38610eee1707 tempest-CreateVolumesFromSnapshotTest-448065929 None] Acquiring lock "cinder-ea3b2573-f5c0-48c7-9173-b5e8a62921c0-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:40:51 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-a8fdc2aa-86a4-4966-b64b-38610eee1707 tempest-CreateVolumesFromSnapshotTest-448065929 None] Lock "cinder-ea3b2573-f5c0-48c7-9173-b5e8a62921c0-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:40:51 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-a8fdc2aa-86a4-4966-b64b-38610eee1707 tempest-CreateVolumesFromSnapshotTest-448065929 None] Acquiring lock "cinder-quobyte-ea3b2573-f5c0-48c7-9173-b5e8a62921c0" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:40:51 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-a8fdc2aa-86a4-4966-b64b-38610eee1707 tempest-CreateVolumesFromSnapshotTest-448065929 None] Lock "cinder-quobyte-ea3b2573-f5c0-48c7-9173-b5e8a62921c0" acquired by "delete_volume" :: waited 0.015s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:40:51 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[578e83a5-6224-4d18-a87c-3adef33ee7b5]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:40:51 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-a8fdc2aa-86a4-4966-b64b-38610eee1707 tempest-CreateVolumesFromSnapshotTest-448065929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ea3b2573-f5c0-48c7-9173-b5e8a62921c0 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:40:52 devstack sudo[113442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ea3b2573-f5c0-48c7-9173-b5e8a62921c0 Aug 26 14:40:52 devstack sudo[113442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:40:52 devstack sudo[113442]: pam_unix(sudo:session): session closed for user root Aug 26 14:40:52 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-a8fdc2aa-86a4-4966-b64b-38610eee1707 tempest-CreateVolumesFromSnapshotTest-448065929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ea3b2573-f5c0-48c7-9173-b5e8a62921c0" returned: 0 in 0.356s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:40:52 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-a8fdc2aa-86a4-4966-b64b-38610eee1707 tempest-CreateVolumesFromSnapshotTest-448065929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ea3b2573-f5c0-48c7-9173-b5e8a62921c0 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:40:52 devstack sudo[113447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ea3b2573-f5c0-48c7-9173-b5e8a62921c0 Aug 26 14:40:52 devstack sudo[113447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:40:52 devstack sudo[113447]: pam_unix(sudo:session): session closed for user root Aug 26 14:40:52 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-a8fdc2aa-86a4-4966-b64b-38610eee1707 tempest-CreateVolumesFromSnapshotTest-448065929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ea3b2573-f5c0-48c7-9173-b5e8a62921c0" returned: 0 in 0.238s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:40:52 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-a8fdc2aa-86a4-4966-b64b-38610eee1707 tempest-CreateVolumesFromSnapshotTest-448065929 None] Lock "cinder-quobyte-ea3b2573-f5c0-48c7-9173-b5e8a62921c0" released by "delete_volume" :: held 0.632s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:40:52 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-a8fdc2aa-86a4-4966-b64b-38610eee1707 tempest-CreateVolumesFromSnapshotTest-448065929 None] Created reservations ['f3becba7-8f84-4a4d-9cc2-8483f9b1b0c8', '9260b14a-d94a-4083-bd6b-c03a2d72fbaf', '4a02a9f7-dcd0-4f4d-943b-d1d19f1a7b98', '2e16df92-5fb6-456e-839c-75e0f46ee752'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:40:52 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-a8fdc2aa-86a4-4966-b64b-38610eee1707 tempest-CreateVolumesFromSnapshotTest-448065929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:40:52 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-a8fdc2aa-86a4-4966-b64b-38610eee1707 tempest-CreateVolumesFromSnapshotTest-448065929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:40:52 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-a8fdc2aa-86a4-4966-b64b-38610eee1707 tempest-CreateVolumesFromSnapshotTest-448065929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:40:52 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-a8fdc2aa-86a4-4966-b64b-38610eee1707 tempest-CreateVolumesFromSnapshotTest-448065929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:40:52 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-a8fdc2aa-86a4-4966-b64b-38610eee1707 tempest-CreateVolumesFromSnapshotTest-448065929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:40:52 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-a8fdc2aa-86a4-4966-b64b-38610eee1707 tempest-CreateVolumesFromSnapshotTest-448065929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:40:52 devstack sudo[113450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:40:52 devstack sudo[113450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:40:52 devstack sudo[113450]: pam_unix(sudo:session): session closed for user root Aug 26 14:40:52 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-a8fdc2aa-86a4-4966-b64b-38610eee1707 tempest-CreateVolumesFromSnapshotTest-448065929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.244s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:40:52 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-a8fdc2aa-86a4-4966-b64b-38610eee1707 tempest-CreateVolumesFromSnapshotTest-448065929 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:40:52 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-a8fdc2aa-86a4-4966-b64b-38610eee1707 tempest-CreateVolumesFromSnapshotTest-448065929 None] Deleted volume successfully. Aug 26 14:40:52 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-a8fdc2aa-86a4-4966-b64b-38610eee1707 tempest-CreateVolumesFromSnapshotTest-448065929 None] Lock "cinder-ea3b2573-f5c0-48c7-9173-b5e8a62921c0-delete_volume" released by "delete_volume" :: held 1.063s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:40:53 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-4b29993e-c173-40ef-8c0f-e17b354d1159 tempest-CreateVolumesFromSnapshotTest-448065929 None] Acquiring lock "cinder-f3f4c512-d9b4-42c9-b1cf-5b16ea887d63-delete_snapshot" by "delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:40:53 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-4b29993e-c173-40ef-8c0f-e17b354d1159 tempest-CreateVolumesFromSnapshotTest-448065929 None] Lock "cinder-f3f4c512-d9b4-42c9-b1cf-5b16ea887d63-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:40:53 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-4b29993e-c173-40ef-8c0f-e17b354d1159 tempest-CreateVolumesFromSnapshotTest-448065929 None] Acquiring lock "cinder-quobyte-ecc42e9b-4e4c-4f6a-a16a-75849c869a2c" by "delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:40:53 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-4b29993e-c173-40ef-8c0f-e17b354d1159 tempest-CreateVolumesFromSnapshotTest-448065929 None] Lock "cinder-quobyte-ecc42e9b-4e4c-4f6a-a16a-75849c869a2c" acquired by "delete_snapshot" :: waited 0.017s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:40:53 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-4b29993e-c173-40ef-8c0f-e17b354d1159 tempest-CreateVolumesFromSnapshotTest-448065929 None] Acquiring lock "cinder-quobyte-f3f4c512-d9b4-42c9-b1cf-5b16ea887d63" by "_delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:40:53 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-4b29993e-c173-40ef-8c0f-e17b354d1159 tempest-CreateVolumesFromSnapshotTest-448065929 None] Lock "cinder-quobyte-f3f4c512-d9b4-42c9-b1cf-5b16ea887d63" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:40:53 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-4b29993e-c173-40ef-8c0f-e17b354d1159 tempest-CreateVolumesFromSnapshotTest-448065929 None] Deleting offline snapshot f3f4c512-d9b4-42c9-b1cf-5b16ea887d63 of volume ecc42e9b-4e4c-4f6a-a16a-75849c869a2c {{(pid=94394) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 14:40:53 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-4b29993e-c173-40ef-8c0f-e17b354d1159 tempest-CreateVolumesFromSnapshotTest-448065929 None] snapshot_file for this snap is: volume-ecc42e9b-4e4c-4f6a-a16a-75849c869a2c.f3f4c512-d9b4-42c9-b1cf-5b16ea887d63 {{(pid=94394) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 14:40:53 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[c88b8135-e4aa-4269-a207-1465f2277fed]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:40:53 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4b29993e-c173-40ef-8c0f-e17b354d1159 tempest-CreateVolumesFromSnapshotTest-448065929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ecc42e9b-4e4c-4f6a-a16a-75849c869a2c.f3f4c512-d9b4-42c9-b1cf-5b16ea887d63 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:40:53 devstack sudo[113453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ecc42e9b-4e4c-4f6a-a16a-75849c869a2c.f3f4c512-d9b4-42c9-b1cf-5b16ea887d63 Aug 26 14:40:53 devstack sudo[113453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:40:53 devstack sudo[113453]: pam_unix(sudo:session): session closed for user root Aug 26 14:40:53 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4b29993e-c173-40ef-8c0f-e17b354d1159 tempest-CreateVolumesFromSnapshotTest-448065929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ecc42e9b-4e4c-4f6a-a16a-75849c869a2c.f3f4c512-d9b4-42c9-b1cf-5b16ea887d63" returned: 0 in 0.342s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:40:53 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-4b29993e-c173-40ef-8c0f-e17b354d1159 tempest-CreateVolumesFromSnapshotTest-448065929 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ecc42e9b-4e4c-4f6a-a16a-75849c869a2c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94394) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 14:40:53 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e084fe5-0449-4371-8ea0-1e41012beda1]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:40:53 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4b29993e-c173-40ef-8c0f-e17b354d1159 tempest-CreateVolumesFromSnapshotTest-448065929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ecc42e9b-4e4c-4f6a-a16a-75849c869a2c {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:40:53 devstack sudo[113458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ecc42e9b-4e4c-4f6a-a16a-75849c869a2c Aug 26 14:40:53 devstack sudo[113458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:40:53 devstack sudo[113458]: pam_unix(sudo:session): session closed for user root Aug 26 14:40:53 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4b29993e-c173-40ef-8c0f-e17b354d1159 tempest-CreateVolumesFromSnapshotTest-448065929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ecc42e9b-4e4c-4f6a-a16a-75849c869a2c" returned: 0 in 0.352s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:40:53 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4b29993e-c173-40ef-8c0f-e17b354d1159 tempest-CreateVolumesFromSnapshotTest-448065929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ecc42e9b-4e4c-4f6a-a16a-75849c869a2c.f3f4c512-d9b4-42c9-b1cf-5b16ea887d63 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:40:53 devstack sudo[113463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ecc42e9b-4e4c-4f6a-a16a-75849c869a2c.f3f4c512-d9b4-42c9-b1cf-5b16ea887d63 Aug 26 14:40:53 devstack sudo[113463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:40:54 devstack sudo[113463]: pam_unix(sudo:session): session closed for user root Aug 26 14:40:54 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4b29993e-c173-40ef-8c0f-e17b354d1159 tempest-CreateVolumesFromSnapshotTest-448065929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ecc42e9b-4e4c-4f6a-a16a-75849c869a2c.f3f4c512-d9b4-42c9-b1cf-5b16ea887d63" returned: 0 in 0.354s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:40:54 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4b29993e-c173-40ef-8c0f-e17b354d1159 tempest-CreateVolumesFromSnapshotTest-448065929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ecc42e9b-4e4c-4f6a-a16a-75849c869a2c.f3f4c512-d9b4-42c9-b1cf-5b16ea887d63 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:40:54 devstack sudo[113468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ecc42e9b-4e4c-4f6a-a16a-75849c869a2c.f3f4c512-d9b4-42c9-b1cf-5b16ea887d63 Aug 26 14:40:54 devstack sudo[113468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:40:54 devstack sudo[113468]: pam_unix(sudo:session): session closed for user root Aug 26 14:40:54 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4b29993e-c173-40ef-8c0f-e17b354d1159 tempest-CreateVolumesFromSnapshotTest-448065929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ecc42e9b-4e4c-4f6a-a16a-75849c869a2c.f3f4c512-d9b4-42c9-b1cf-5b16ea887d63" returned: 0 in 0.236s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:40:54 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-4b29993e-c173-40ef-8c0f-e17b354d1159 tempest-CreateVolumesFromSnapshotTest-448065929 None] Lock "cinder-quobyte-f3f4c512-d9b4-42c9-b1cf-5b16ea887d63" released by "_delete_snapshot" :: held 1.383s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:40:54 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-4b29993e-c173-40ef-8c0f-e17b354d1159 tempest-CreateVolumesFromSnapshotTest-448065929 None] Lock "cinder-quobyte-ecc42e9b-4e4c-4f6a-a16a-75849c869a2c" released by "delete_snapshot" :: held 1.403s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:40:54 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-4b29993e-c173-40ef-8c0f-e17b354d1159 tempest-CreateVolumesFromSnapshotTest-448065929 None] Created reservations ['76fb592a-1cf1-4df0-84fc-3761417a472b', 'bd669b4e-c239-485d-8fce-fbf51c441e52', '5ba9c59c-6337-4897-8194-bd77c180cfe7', 'ad4e1cc8-bc64-4c0a-93b7-40a774e743a8'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:40:54 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-4b29993e-c173-40ef-8c0f-e17b354d1159 tempest-CreateVolumesFromSnapshotTest-448065929 None] Delete snapshot completed successfully. Aug 26 14:40:54 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-4b29993e-c173-40ef-8c0f-e17b354d1159 tempest-CreateVolumesFromSnapshotTest-448065929 None] Lock "cinder-f3f4c512-d9b4-42c9-b1cf-5b16ea887d63-delete_snapshot" released by "delete_snapshot" :: held 1.526s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:40:55 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-80fe1df3-dac9-4203-a665-76c292661dac tempest-CreateVolumesFromSnapshotTest-448065929 None] Acquiring lock "cinder-ecc42e9b-4e4c-4f6a-a16a-75849c869a2c-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:40:55 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-80fe1df3-dac9-4203-a665-76c292661dac tempest-CreateVolumesFromSnapshotTest-448065929 None] Lock "cinder-ecc42e9b-4e4c-4f6a-a16a-75849c869a2c-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:40:55 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-80fe1df3-dac9-4203-a665-76c292661dac tempest-CreateVolumesFromSnapshotTest-448065929 None] Acquiring lock "cinder-quobyte-ecc42e9b-4e4c-4f6a-a16a-75849c869a2c" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:40:55 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-80fe1df3-dac9-4203-a665-76c292661dac tempest-CreateVolumesFromSnapshotTest-448065929 None] Lock "cinder-quobyte-ecc42e9b-4e4c-4f6a-a16a-75849c869a2c" acquired by "delete_volume" :: waited 0.016s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:40:55 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2c607f3-4979-4694-a74f-34a8f326cb0b]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:40:55 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-80fe1df3-dac9-4203-a665-76c292661dac tempest-CreateVolumesFromSnapshotTest-448065929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ecc42e9b-4e4c-4f6a-a16a-75849c869a2c {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:40:55 devstack sudo[113471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ecc42e9b-4e4c-4f6a-a16a-75849c869a2c Aug 26 14:40:55 devstack sudo[113471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:40:55 devstack sudo[113471]: pam_unix(sudo:session): session closed for user root Aug 26 14:40:55 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-80fe1df3-dac9-4203-a665-76c292661dac tempest-CreateVolumesFromSnapshotTest-448065929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ecc42e9b-4e4c-4f6a-a16a-75849c869a2c" returned: 0 in 0.342s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:40:55 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-80fe1df3-dac9-4203-a665-76c292661dac tempest-CreateVolumesFromSnapshotTest-448065929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ecc42e9b-4e4c-4f6a-a16a-75849c869a2c {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:40:55 devstack sudo[113476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ecc42e9b-4e4c-4f6a-a16a-75849c869a2c Aug 26 14:40:55 devstack sudo[113476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:40:55 devstack sudo[113476]: pam_unix(sudo:session): session closed for user root Aug 26 14:40:55 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-80fe1df3-dac9-4203-a665-76c292661dac tempest-CreateVolumesFromSnapshotTest-448065929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ecc42e9b-4e4c-4f6a-a16a-75849c869a2c" returned: 0 in 0.235s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:40:55 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-80fe1df3-dac9-4203-a665-76c292661dac tempest-CreateVolumesFromSnapshotTest-448065929 None] Lock "cinder-quobyte-ecc42e9b-4e4c-4f6a-a16a-75849c869a2c" released by "delete_volume" :: held 0.632s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:40:55 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-80fe1df3-dac9-4203-a665-76c292661dac tempest-CreateVolumesFromSnapshotTest-448065929 None] Created reservations ['89424a92-4f11-4a9c-afcf-82232a9a98d8', '1e15c52e-9158-4087-9b35-f9e2109fa749', '08aa60e8-bb64-45b3-b4dc-40c04f485b04', 'a788caa2-bec9-41da-9e3a-82b99f8ec2af'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:40:56 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-80fe1df3-dac9-4203-a665-76c292661dac tempest-CreateVolumesFromSnapshotTest-448065929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:40:56 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-80fe1df3-dac9-4203-a665-76c292661dac tempest-CreateVolumesFromSnapshotTest-448065929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:40:56 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-80fe1df3-dac9-4203-a665-76c292661dac tempest-CreateVolumesFromSnapshotTest-448065929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:40:56 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-80fe1df3-dac9-4203-a665-76c292661dac tempest-CreateVolumesFromSnapshotTest-448065929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:40:56 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-80fe1df3-dac9-4203-a665-76c292661dac tempest-CreateVolumesFromSnapshotTest-448065929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:40:56 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-80fe1df3-dac9-4203-a665-76c292661dac tempest-CreateVolumesFromSnapshotTest-448065929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:40:56 devstack sudo[113479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:40:56 devstack sudo[113479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:40:56 devstack sudo[113479]: pam_unix(sudo:session): session closed for user root Aug 26 14:40:56 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-80fe1df3-dac9-4203-a665-76c292661dac tempest-CreateVolumesFromSnapshotTest-448065929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.241s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:40:56 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-80fe1df3-dac9-4203-a665-76c292661dac tempest-CreateVolumesFromSnapshotTest-448065929 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:40:56 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-80fe1df3-dac9-4203-a665-76c292661dac tempest-CreateVolumesFromSnapshotTest-448065929 None] Deleted volume successfully. Aug 26 14:40:56 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-80fe1df3-dac9-4203-a665-76c292661dac tempest-CreateVolumesFromSnapshotTest-448065929 None] Lock "cinder-ecc42e9b-4e4c-4f6a-a16a-75849c869a2c-delete_volume" released by "delete_volume" :: held 1.066s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:40:59 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb87e315-c32b-4306-9bd3-874998a15168 tempest-ProjectReaderTests-1785505571 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:40:59 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-fb87e315-c32b-4306-9bd3-874998a15168 tempest-ProjectReaderTests-1785505571 None] Flow 'volume_create_manager' (5f0eb299-0e07-4c8a-9b6d-a0022944bfab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:40:59 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-fb87e315-c32b-4306-9bd3-874998a15168 tempest-ProjectReaderTests-1785505571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (968cdb87-b2cd-4912-9d8e-6cae9b75ea73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:40:59 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-fb87e315-c32b-4306-9bd3-874998a15168 tempest-ProjectReaderTests-1785505571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (968cdb87-b2cd-4912-9d8e-6cae9b75ea73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:40:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-770907177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db8d3dae-700f-4fa6-8467-87748b087cba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5ae8ad60fe74d0a969bfbf9a7dd8e99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:40:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:40:59Z,use_quota=True,user_id='501b7c4d89e249e29fa72f394adfb377',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:40:59 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-fb87e315-c32b-4306-9bd3-874998a15168 tempest-ProjectReaderTests-1785505571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f98c8d2-889a-4f41-81b5-b2f6527b6c80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:40:59 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-fb87e315-c32b-4306-9bd3-874998a15168 tempest-ProjectReaderTests-1785505571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f98c8d2-889a-4f41-81b5-b2f6527b6c80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:40:59 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-fb87e315-c32b-4306-9bd3-874998a15168 tempest-ProjectReaderTests-1785505571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe6f1f08-8144-4e49-b468-cfc581f3cdac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:40:59 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-fb87e315-c32b-4306-9bd3-874998a15168 tempest-ProjectReaderTests-1785505571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe6f1f08-8144-4e49-b468-cfc581f3cdac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db8d3dae-700f-4fa6-8467-87748b087cba', 'volume_name': 'volume-db8d3dae-700f-4fa6-8467-87748b087cba', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:40:59 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-fb87e315-c32b-4306-9bd3-874998a15168 tempest-ProjectReaderTests-1785505571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b423c4e-2d65-42ed-9de6-1b86bf798f20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:40:59 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-fb87e315-c32b-4306-9bd3-874998a15168 tempest-ProjectReaderTests-1785505571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b423c4e-2d65-42ed-9de6-1b86bf798f20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:40:59 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-fb87e315-c32b-4306-9bd3-874998a15168 tempest-ProjectReaderTests-1785505571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59960283-71d9-4111-82e4-36d7d5ae4c8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:40:59 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-fb87e315-c32b-4306-9bd3-874998a15168 tempest-ProjectReaderTests-1785505571 None] Volume db8d3dae-700f-4fa6-8467-87748b087cba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db8d3dae-700f-4fa6-8467-87748b087cba', 'volume_size': 1} Aug 26 14:40:59 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-fb87e315-c32b-4306-9bd3-874998a15168 tempest-ProjectReaderTests-1785505571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:40:59 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-fb87e315-c32b-4306-9bd3-874998a15168 tempest-ProjectReaderTests-1785505571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:40:59 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-fb87e315-c32b-4306-9bd3-874998a15168 tempest-ProjectReaderTests-1785505571 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:40:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-770907177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db8d3dae-700f-4fa6-8467-87748b087cba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5ae8ad60fe74d0a969bfbf9a7dd8e99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:40:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:40:59Z,use_quota=True,user_id='501b7c4d89e249e29fa72f394adfb377',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:40:59 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-fb87e315-c32b-4306-9bd3-874998a15168 tempest-ProjectReaderTests-1785505571 None] Creating volume db8d3dae-700f-4fa6-8467-87748b087cba {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:40:59 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-fb87e315-c32b-4306-9bd3-874998a15168 tempest-ProjectReaderTests-1785505571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:40:59 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-fb87e315-c32b-4306-9bd3-874998a15168 tempest-ProjectReaderTests-1785505571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:40:59 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-fb87e315-c32b-4306-9bd3-874998a15168 tempest-ProjectReaderTests-1785505571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:40:59 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-fb87e315-c32b-4306-9bd3-874998a15168 tempest-ProjectReaderTests-1785505571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:40:59 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-fb87e315-c32b-4306-9bd3-874998a15168 tempest-ProjectReaderTests-1785505571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:40:59 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-fb87e315-c32b-4306-9bd3-874998a15168 tempest-ProjectReaderTests-1785505571 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:40:59 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-fb87e315-c32b-4306-9bd3-874998a15168 tempest-ProjectReaderTests-1785505571 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:40:59 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-fb87e315-c32b-4306-9bd3-874998a15168 tempest-ProjectReaderTests-1785505571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-db8d3dae-700f-4fa6-8467-87748b087cba 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:40:59 devstack sudo[113483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-db8d3dae-700f-4fa6-8467-87748b087cba 1073741824 Aug 26 14:40:59 devstack sudo[113483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:40:59 devstack sudo[113483]: pam_unix(sudo:session): session closed for user root Aug 26 14:40:59 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-fb87e315-c32b-4306-9bd3-874998a15168 tempest-ProjectReaderTests-1785505571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-db8d3dae-700f-4fa6-8467-87748b087cba 1073741824" returned: 0 in 0.398s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:41:00 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-fb87e315-c32b-4306-9bd3-874998a15168 tempest-ProjectReaderTests-1785505571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-db8d3dae-700f-4fa6-8467-87748b087cba {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:41:00 devstack sudo[113488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-db8d3dae-700f-4fa6-8467-87748b087cba Aug 26 14:41:00 devstack sudo[113488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:41:00 devstack sudo[113488]: pam_unix(sudo:session): session closed for user root Aug 26 14:41:00 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-fb87e315-c32b-4306-9bd3-874998a15168 tempest-ProjectReaderTests-1785505571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-db8d3dae-700f-4fa6-8467-87748b087cba" returned: 0 in 0.237s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:41:00 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-fb87e315-c32b-4306-9bd3-874998a15168 tempest-ProjectReaderTests-1785505571 None] <== create_volume: return (679ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:41:00 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-fb87e315-c32b-4306-9bd3-874998a15168 tempest-ProjectReaderTests-1785505571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.682s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:41:00 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-fb87e315-c32b-4306-9bd3-874998a15168 tempest-ProjectReaderTests-1785505571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59960283-71d9-4111-82e4-36d7d5ae4c8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db8d3dae-700f-4fa6-8467-87748b087cba', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:41:00 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-fb87e315-c32b-4306-9bd3-874998a15168 tempest-ProjectReaderTests-1785505571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcef542f-bdd2-4fb4-bad4-af89195d5631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:41:00 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-fb87e315-c32b-4306-9bd3-874998a15168 tempest-ProjectReaderTests-1785505571 None] Volume volume-db8d3dae-700f-4fa6-8467-87748b087cba (db8d3dae-700f-4fa6-8467-87748b087cba): created successfully Aug 26 14:41:00 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-fb87e315-c32b-4306-9bd3-874998a15168 tempest-ProjectReaderTests-1785505571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcef542f-bdd2-4fb4-bad4-af89195d5631) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:41:00 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-fb87e315-c32b-4306-9bd3-874998a15168 tempest-ProjectReaderTests-1785505571 None] Flow 'volume_create_manager' (5f0eb299-0e07-4c8a-9b6d-a0022944bfab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:41:00 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-fb87e315-c32b-4306-9bd3-874998a15168 tempest-ProjectReaderTests-1785505571 None] Created volume successfully. Aug 26 14:41:00 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-d32c1d62-4313-4e6a-8aef-07ff58b155d2 tempest-ProjectReaderTests-1785505571 None] Acquiring lock "cinder-db8d3dae-700f-4fa6-8467-87748b087cba-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:41:00 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-d32c1d62-4313-4e6a-8aef-07ff58b155d2 tempest-ProjectReaderTests-1785505571 None] Lock "cinder-db8d3dae-700f-4fa6-8467-87748b087cba-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:41:00 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-d32c1d62-4313-4e6a-8aef-07ff58b155d2 tempest-ProjectReaderTests-1785505571 None] Acquiring lock "cinder-quobyte-db8d3dae-700f-4fa6-8467-87748b087cba" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:41:00 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-d32c1d62-4313-4e6a-8aef-07ff58b155d2 tempest-ProjectReaderTests-1785505571 None] Lock "cinder-quobyte-db8d3dae-700f-4fa6-8467-87748b087cba" acquired by "delete_volume" :: waited 0.015s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:41:00 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c8157a6-c07c-43fc-8efa-4c5fc0b54869]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:41:00 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-d32c1d62-4313-4e6a-8aef-07ff58b155d2 tempest-ProjectReaderTests-1785505571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-db8d3dae-700f-4fa6-8467-87748b087cba {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:41:00 devstack sudo[113492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-db8d3dae-700f-4fa6-8467-87748b087cba Aug 26 14:41:00 devstack sudo[113492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:41:01 devstack sudo[113492]: pam_unix(sudo:session): session closed for user root Aug 26 14:41:01 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-d32c1d62-4313-4e6a-8aef-07ff58b155d2 tempest-ProjectReaderTests-1785505571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-db8d3dae-700f-4fa6-8467-87748b087cba" returned: 0 in 0.348s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:41:01 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-d32c1d62-4313-4e6a-8aef-07ff58b155d2 tempest-ProjectReaderTests-1785505571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-db8d3dae-700f-4fa6-8467-87748b087cba {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:41:01 devstack sudo[113497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-db8d3dae-700f-4fa6-8467-87748b087cba Aug 26 14:41:01 devstack sudo[113497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:41:01 devstack sudo[113497]: pam_unix(sudo:session): session closed for user root Aug 26 14:41:01 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-d32c1d62-4313-4e6a-8aef-07ff58b155d2 tempest-ProjectReaderTests-1785505571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-db8d3dae-700f-4fa6-8467-87748b087cba" returned: 0 in 0.242s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:41:01 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-d32c1d62-4313-4e6a-8aef-07ff58b155d2 tempest-ProjectReaderTests-1785505571 None] Lock "cinder-quobyte-db8d3dae-700f-4fa6-8467-87748b087cba" released by "delete_volume" :: held 0.628s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:41:01 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-d32c1d62-4313-4e6a-8aef-07ff58b155d2 tempest-ProjectReaderTests-1785505571 None] Created reservations ['3762c30e-94b5-4e77-ac37-2decec0abf2f', '11650138-4330-4d5d-9ef3-a533f82cf2a6', '8b36216d-d2f6-49d5-86fb-f9a05e07ee34', '35eb307d-2ba8-410c-928e-1eb237c46fb4'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:41:01 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-d32c1d62-4313-4e6a-8aef-07ff58b155d2 tempest-ProjectReaderTests-1785505571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:41:01 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-d32c1d62-4313-4e6a-8aef-07ff58b155d2 tempest-ProjectReaderTests-1785505571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:41:01 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-d32c1d62-4313-4e6a-8aef-07ff58b155d2 tempest-ProjectReaderTests-1785505571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:41:01 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-d32c1d62-4313-4e6a-8aef-07ff58b155d2 tempest-ProjectReaderTests-1785505571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:41:01 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-d32c1d62-4313-4e6a-8aef-07ff58b155d2 tempest-ProjectReaderTests-1785505571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:41:01 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-d32c1d62-4313-4e6a-8aef-07ff58b155d2 tempest-ProjectReaderTests-1785505571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:41:01 devstack sudo[113500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:41:01 devstack sudo[113500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:41:01 devstack sudo[113500]: pam_unix(sudo:session): session closed for user root Aug 26 14:41:01 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-d32c1d62-4313-4e6a-8aef-07ff58b155d2 tempest-ProjectReaderTests-1785505571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.237s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:41:01 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-d32c1d62-4313-4e6a-8aef-07ff58b155d2 tempest-ProjectReaderTests-1785505571 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:41:01 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-d32c1d62-4313-4e6a-8aef-07ff58b155d2 tempest-ProjectReaderTests-1785505571 None] Deleted volume successfully. Aug 26 14:41:01 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-d32c1d62-4313-4e6a-8aef-07ff58b155d2 tempest-ProjectReaderTests-1785505571 None] Lock "cinder-db8d3dae-700f-4fa6-8467-87748b087cba-delete_volume" released by "delete_volume" :: held 1.057s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:41:02 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-5cb14e5a-e783-4328-809b-0976d574e498 tempest-ProjectReaderTests-1785505571 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:41:02 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-5cb14e5a-e783-4328-809b-0976d574e498 tempest-ProjectReaderTests-1785505571 None] Flow 'volume_create_manager' (aaaa9479-23b2-4dc1-86b2-4b3479caea69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:41:02 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-5cb14e5a-e783-4328-809b-0976d574e498 tempest-ProjectReaderTests-1785505571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85570786-2904-4f47-8e4d-95402fd54b3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:41:02 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-5cb14e5a-e783-4328-809b-0976d574e498 tempest-ProjectReaderTests-1785505571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85570786-2904-4f47-8e4d-95402fd54b3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:41:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1616067411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b1d4f1b-b4c4-4e40-bec7-181cc27e344d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5ae8ad60fe74d0a969bfbf9a7dd8e99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:41:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:41:02Z,use_quota=True,user_id='501b7c4d89e249e29fa72f394adfb377',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:41:02 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-5cb14e5a-e783-4328-809b-0976d574e498 tempest-ProjectReaderTests-1785505571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19f05daf-cfc0-4c2e-9df4-42a5cb0ecd86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:41:02 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-5cb14e5a-e783-4328-809b-0976d574e498 tempest-ProjectReaderTests-1785505571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19f05daf-cfc0-4c2e-9df4-42a5cb0ecd86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:41:02 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-5cb14e5a-e783-4328-809b-0976d574e498 tempest-ProjectReaderTests-1785505571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36e51eee-4964-4509-be39-91b5cff2e9bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:41:02 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-5cb14e5a-e783-4328-809b-0976d574e498 tempest-ProjectReaderTests-1785505571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36e51eee-4964-4509-be39-91b5cff2e9bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b1d4f1b-b4c4-4e40-bec7-181cc27e344d', 'volume_name': 'volume-7b1d4f1b-b4c4-4e40-bec7-181cc27e344d', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:41:02 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-5cb14e5a-e783-4328-809b-0976d574e498 tempest-ProjectReaderTests-1785505571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a8cfb01-e9aa-4c34-a4f1-5c07689ecdee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:41:02 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-5cb14e5a-e783-4328-809b-0976d574e498 tempest-ProjectReaderTests-1785505571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a8cfb01-e9aa-4c34-a4f1-5c07689ecdee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:41:02 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-5cb14e5a-e783-4328-809b-0976d574e498 tempest-ProjectReaderTests-1785505571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d71f420b-7812-4a64-a5ba-6a5833fc4979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:41:02 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-5cb14e5a-e783-4328-809b-0976d574e498 tempest-ProjectReaderTests-1785505571 None] Volume 7b1d4f1b-b4c4-4e40-bec7-181cc27e344d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b1d4f1b-b4c4-4e40-bec7-181cc27e344d', 'volume_size': 1} Aug 26 14:41:02 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-5cb14e5a-e783-4328-809b-0976d574e498 tempest-ProjectReaderTests-1785505571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:41:02 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-5cb14e5a-e783-4328-809b-0976d574e498 tempest-ProjectReaderTests-1785505571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:41:02 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-5cb14e5a-e783-4328-809b-0976d574e498 tempest-ProjectReaderTests-1785505571 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:41:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1616067411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b1d4f1b-b4c4-4e40-bec7-181cc27e344d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5ae8ad60fe74d0a969bfbf9a7dd8e99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:41:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:41:02Z,use_quota=True,user_id='501b7c4d89e249e29fa72f394adfb377',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:41:02 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-5cb14e5a-e783-4328-809b-0976d574e498 tempest-ProjectReaderTests-1785505571 None] Creating volume 7b1d4f1b-b4c4-4e40-bec7-181cc27e344d {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:41:02 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-5cb14e5a-e783-4328-809b-0976d574e498 tempest-ProjectReaderTests-1785505571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:41:02 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-5cb14e5a-e783-4328-809b-0976d574e498 tempest-ProjectReaderTests-1785505571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:41:02 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-5cb14e5a-e783-4328-809b-0976d574e498 tempest-ProjectReaderTests-1785505571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:41:02 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-5cb14e5a-e783-4328-809b-0976d574e498 tempest-ProjectReaderTests-1785505571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:41:02 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-5cb14e5a-e783-4328-809b-0976d574e498 tempest-ProjectReaderTests-1785505571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:41:02 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-5cb14e5a-e783-4328-809b-0976d574e498 tempest-ProjectReaderTests-1785505571 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:41:02 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-5cb14e5a-e783-4328-809b-0976d574e498 tempest-ProjectReaderTests-1785505571 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:41:02 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-5cb14e5a-e783-4328-809b-0976d574e498 tempest-ProjectReaderTests-1785505571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-7b1d4f1b-b4c4-4e40-bec7-181cc27e344d 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:41:02 devstack sudo[113503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-7b1d4f1b-b4c4-4e40-bec7-181cc27e344d 1073741824 Aug 26 14:41:02 devstack sudo[113503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:41:02 devstack sudo[113503]: pam_unix(sudo:session): session closed for user root Aug 26 14:41:02 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-5cb14e5a-e783-4328-809b-0976d574e498 tempest-ProjectReaderTests-1785505571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-7b1d4f1b-b4c4-4e40-bec7-181cc27e344d 1073741824" returned: 0 in 0.400s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:41:02 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-5cb14e5a-e783-4328-809b-0976d574e498 tempest-ProjectReaderTests-1785505571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-7b1d4f1b-b4c4-4e40-bec7-181cc27e344d {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:41:02 devstack sudo[113509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-7b1d4f1b-b4c4-4e40-bec7-181cc27e344d Aug 26 14:41:02 devstack sudo[113509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:41:03 devstack sudo[113509]: pam_unix(sudo:session): session closed for user root Aug 26 14:41:03 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-5cb14e5a-e783-4328-809b-0976d574e498 tempest-ProjectReaderTests-1785505571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-7b1d4f1b-b4c4-4e40-bec7-181cc27e344d" returned: 0 in 0.247s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:41:03 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-5cb14e5a-e783-4328-809b-0976d574e498 tempest-ProjectReaderTests-1785505571 None] <== create_volume: return (685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:41:03 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-5cb14e5a-e783-4328-809b-0976d574e498 tempest-ProjectReaderTests-1785505571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.688s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:41:03 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-5cb14e5a-e783-4328-809b-0976d574e498 tempest-ProjectReaderTests-1785505571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d71f420b-7812-4a64-a5ba-6a5833fc4979) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b1d4f1b-b4c4-4e40-bec7-181cc27e344d', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:41:03 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-5cb14e5a-e783-4328-809b-0976d574e498 tempest-ProjectReaderTests-1785505571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (620697c9-a8bd-451e-8fdc-c38b6f74476a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:41:03 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-5cb14e5a-e783-4328-809b-0976d574e498 tempest-ProjectReaderTests-1785505571 None] Volume volume-7b1d4f1b-b4c4-4e40-bec7-181cc27e344d (7b1d4f1b-b4c4-4e40-bec7-181cc27e344d): created successfully Aug 26 14:41:03 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-5cb14e5a-e783-4328-809b-0976d574e498 tempest-ProjectReaderTests-1785505571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (620697c9-a8bd-451e-8fdc-c38b6f74476a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:41:03 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-5cb14e5a-e783-4328-809b-0976d574e498 tempest-ProjectReaderTests-1785505571 None] Flow 'volume_create_manager' (aaaa9479-23b2-4dc1-86b2-4b3479caea69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:41:03 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-5cb14e5a-e783-4328-809b-0976d574e498 tempest-ProjectReaderTests-1785505571 None] Created volume successfully. Aug 26 14:41:03 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-ac1c31cb-9e65-4c51-b87d-6a14c24e138d tempest-ProjectReaderTests-1785505571 None] Acquiring lock "cinder-7b1d4f1b-b4c4-4e40-bec7-181cc27e344d-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:41:03 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-ac1c31cb-9e65-4c51-b87d-6a14c24e138d tempest-ProjectReaderTests-1785505571 None] Lock "cinder-7b1d4f1b-b4c4-4e40-bec7-181cc27e344d-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:41:03 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-ac1c31cb-9e65-4c51-b87d-6a14c24e138d tempest-ProjectReaderTests-1785505571 None] Acquiring lock "cinder-quobyte-7b1d4f1b-b4c4-4e40-bec7-181cc27e344d" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:41:03 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-ac1c31cb-9e65-4c51-b87d-6a14c24e138d tempest-ProjectReaderTests-1785505571 None] Lock "cinder-quobyte-7b1d4f1b-b4c4-4e40-bec7-181cc27e344d" acquired by "delete_volume" :: waited 0.021s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:41:03 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[7790a381-be14-4613-ae00-5d97bd182065]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:41:03 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-ac1c31cb-9e65-4c51-b87d-6a14c24e138d tempest-ProjectReaderTests-1785505571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-7b1d4f1b-b4c4-4e40-bec7-181cc27e344d {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:41:03 devstack sudo[113512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-7b1d4f1b-b4c4-4e40-bec7-181cc27e344d Aug 26 14:41:03 devstack sudo[113512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:41:03 devstack sudo[113512]: pam_unix(sudo:session): session closed for user root Aug 26 14:41:03 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-ac1c31cb-9e65-4c51-b87d-6a14c24e138d tempest-ProjectReaderTests-1785505571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-7b1d4f1b-b4c4-4e40-bec7-181cc27e344d" returned: 0 in 0.347s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:41:03 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-ac1c31cb-9e65-4c51-b87d-6a14c24e138d tempest-ProjectReaderTests-1785505571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-7b1d4f1b-b4c4-4e40-bec7-181cc27e344d {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:41:03 devstack sudo[113517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-7b1d4f1b-b4c4-4e40-bec7-181cc27e344d Aug 26 14:41:03 devstack sudo[113517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:41:03 devstack sudo[113517]: pam_unix(sudo:session): session closed for user root Aug 26 14:41:03 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-ac1c31cb-9e65-4c51-b87d-6a14c24e138d tempest-ProjectReaderTests-1785505571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-7b1d4f1b-b4c4-4e40-bec7-181cc27e344d" returned: 0 in 0.237s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:41:04 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-ac1c31cb-9e65-4c51-b87d-6a14c24e138d tempest-ProjectReaderTests-1785505571 None] Lock "cinder-quobyte-7b1d4f1b-b4c4-4e40-bec7-181cc27e344d" released by "delete_volume" :: held 0.622s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:41:04 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-ac1c31cb-9e65-4c51-b87d-6a14c24e138d tempest-ProjectReaderTests-1785505571 None] Created reservations ['4f6a7795-4069-43b3-af14-880416345ae7', '8303c9f0-809a-4216-97c2-be156e974020', '0eb077aa-b037-46cf-9829-a28df15c3526', 'f0e6f950-117f-4df7-8ea4-85f431c03cc5'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:41:04 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-ac1c31cb-9e65-4c51-b87d-6a14c24e138d tempest-ProjectReaderTests-1785505571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:41:04 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-ac1c31cb-9e65-4c51-b87d-6a14c24e138d tempest-ProjectReaderTests-1785505571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:41:04 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-ac1c31cb-9e65-4c51-b87d-6a14c24e138d tempest-ProjectReaderTests-1785505571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:41:04 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-ac1c31cb-9e65-4c51-b87d-6a14c24e138d tempest-ProjectReaderTests-1785505571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:41:04 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-ac1c31cb-9e65-4c51-b87d-6a14c24e138d tempest-ProjectReaderTests-1785505571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:41:04 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-ac1c31cb-9e65-4c51-b87d-6a14c24e138d tempest-ProjectReaderTests-1785505571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:41:04 devstack sudo[113520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:41:04 devstack sudo[113520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:41:04 devstack sudo[113520]: pam_unix(sudo:session): session closed for user root Aug 26 14:41:04 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-ac1c31cb-9e65-4c51-b87d-6a14c24e138d tempest-ProjectReaderTests-1785505571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.248s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:41:04 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-ac1c31cb-9e65-4c51-b87d-6a14c24e138d tempest-ProjectReaderTests-1785505571 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:41:04 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-ac1c31cb-9e65-4c51-b87d-6a14c24e138d tempest-ProjectReaderTests-1785505571 None] Deleted volume successfully. Aug 26 14:41:04 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-ac1c31cb-9e65-4c51-b87d-6a14c24e138d tempest-ProjectReaderTests-1785505571 None] Lock "cinder-7b1d4f1b-b4c4-4e40-bec7-181cc27e344d-delete_volume" released by "delete_volume" :: held 1.145s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:41:04 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f433c5c-c23e-4440-b5ed-b3a5b727eecf tempest-ProjectReaderTests-1785505571 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:41:04 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-7f433c5c-c23e-4440-b5ed-b3a5b727eecf tempest-ProjectReaderTests-1785505571 None] Flow 'volume_create_manager' (85ab1748-cbdc-4983-a34b-0944feb1bde2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:41:04 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-7f433c5c-c23e-4440-b5ed-b3a5b727eecf tempest-ProjectReaderTests-1785505571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ed5f23e-cebd-4648-8238-9cf888857179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:41:04 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-7f433c5c-c23e-4440-b5ed-b3a5b727eecf tempest-ProjectReaderTests-1785505571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ed5f23e-cebd-4648-8238-9cf888857179) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:41:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-766015059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=774bac65-e197-4906-9609-6289bff47083,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5ae8ad60fe74d0a969bfbf9a7dd8e99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:41:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:41:05Z,use_quota=True,user_id='501b7c4d89e249e29fa72f394adfb377',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:41:04 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-7f433c5c-c23e-4440-b5ed-b3a5b727eecf tempest-ProjectReaderTests-1785505571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e564d9bb-42e9-4585-abd4-fd2d8217791f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:41:04 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-7f433c5c-c23e-4440-b5ed-b3a5b727eecf tempest-ProjectReaderTests-1785505571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e564d9bb-42e9-4585-abd4-fd2d8217791f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:41:04 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-7f433c5c-c23e-4440-b5ed-b3a5b727eecf tempest-ProjectReaderTests-1785505571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db67e53a-05f9-4176-804e-0d452e2f5e09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:41:04 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-7f433c5c-c23e-4440-b5ed-b3a5b727eecf tempest-ProjectReaderTests-1785505571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db67e53a-05f9-4176-804e-0d452e2f5e09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '774bac65-e197-4906-9609-6289bff47083', 'volume_name': 'volume-774bac65-e197-4906-9609-6289bff47083', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:41:04 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-7f433c5c-c23e-4440-b5ed-b3a5b727eecf tempest-ProjectReaderTests-1785505571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e567715e-f8f6-43a7-8524-9838fedd1edc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:41:04 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-7f433c5c-c23e-4440-b5ed-b3a5b727eecf tempest-ProjectReaderTests-1785505571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e567715e-f8f6-43a7-8524-9838fedd1edc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:41:04 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-7f433c5c-c23e-4440-b5ed-b3a5b727eecf tempest-ProjectReaderTests-1785505571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4eac7f30-88ca-4d69-a829-412b2b1c6969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:41:04 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-7f433c5c-c23e-4440-b5ed-b3a5b727eecf tempest-ProjectReaderTests-1785505571 None] Volume 774bac65-e197-4906-9609-6289bff47083: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-774bac65-e197-4906-9609-6289bff47083', 'volume_size': 1} Aug 26 14:41:04 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-7f433c5c-c23e-4440-b5ed-b3a5b727eecf tempest-ProjectReaderTests-1785505571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:41:04 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-7f433c5c-c23e-4440-b5ed-b3a5b727eecf tempest-ProjectReaderTests-1785505571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:41:04 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-7f433c5c-c23e-4440-b5ed-b3a5b727eecf tempest-ProjectReaderTests-1785505571 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:41:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-766015059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=774bac65-e197-4906-9609-6289bff47083,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5ae8ad60fe74d0a969bfbf9a7dd8e99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:41:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:41:05Z,use_quota=True,user_id='501b7c4d89e249e29fa72f394adfb377',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:41:04 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-7f433c5c-c23e-4440-b5ed-b3a5b727eecf tempest-ProjectReaderTests-1785505571 None] Creating volume 774bac65-e197-4906-9609-6289bff47083 {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:41:04 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-7f433c5c-c23e-4440-b5ed-b3a5b727eecf tempest-ProjectReaderTests-1785505571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:41:04 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-7f433c5c-c23e-4440-b5ed-b3a5b727eecf tempest-ProjectReaderTests-1785505571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:41:04 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-7f433c5c-c23e-4440-b5ed-b3a5b727eecf tempest-ProjectReaderTests-1785505571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:41:04 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-7f433c5c-c23e-4440-b5ed-b3a5b727eecf tempest-ProjectReaderTests-1785505571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:41:04 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-7f433c5c-c23e-4440-b5ed-b3a5b727eecf tempest-ProjectReaderTests-1785505571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:41:04 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-7f433c5c-c23e-4440-b5ed-b3a5b727eecf tempest-ProjectReaderTests-1785505571 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:41:04 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-7f433c5c-c23e-4440-b5ed-b3a5b727eecf tempest-ProjectReaderTests-1785505571 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:41:04 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-7f433c5c-c23e-4440-b5ed-b3a5b727eecf tempest-ProjectReaderTests-1785505571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-774bac65-e197-4906-9609-6289bff47083 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:41:04 devstack sudo[113523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-774bac65-e197-4906-9609-6289bff47083 1073741824 Aug 26 14:41:04 devstack sudo[113523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:41:05 devstack sudo[113523]: pam_unix(sudo:session): session closed for user root Aug 26 14:41:05 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-7f433c5c-c23e-4440-b5ed-b3a5b727eecf tempest-ProjectReaderTests-1785505571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-774bac65-e197-4906-9609-6289bff47083 1073741824" returned: 0 in 0.393s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:41:05 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-7f433c5c-c23e-4440-b5ed-b3a5b727eecf tempest-ProjectReaderTests-1785505571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-774bac65-e197-4906-9609-6289bff47083 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:41:05 devstack sudo[113529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-774bac65-e197-4906-9609-6289bff47083 Aug 26 14:41:05 devstack sudo[113529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:41:05 devstack sudo[113529]: pam_unix(sudo:session): session closed for user root Aug 26 14:41:05 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-7f433c5c-c23e-4440-b5ed-b3a5b727eecf tempest-ProjectReaderTests-1785505571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-774bac65-e197-4906-9609-6289bff47083" returned: 0 in 0.241s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:41:05 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-7f433c5c-c23e-4440-b5ed-b3a5b727eecf tempest-ProjectReaderTests-1785505571 None] <== create_volume: return (674ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:41:05 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-7f433c5c-c23e-4440-b5ed-b3a5b727eecf tempest-ProjectReaderTests-1785505571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.676s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:41:05 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-7f433c5c-c23e-4440-b5ed-b3a5b727eecf tempest-ProjectReaderTests-1785505571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4eac7f30-88ca-4d69-a829-412b2b1c6969) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-774bac65-e197-4906-9609-6289bff47083', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:41:05 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-7f433c5c-c23e-4440-b5ed-b3a5b727eecf tempest-ProjectReaderTests-1785505571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8320db4-5304-4a3f-8ae8-21b50636e7eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:41:05 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-7f433c5c-c23e-4440-b5ed-b3a5b727eecf tempest-ProjectReaderTests-1785505571 None] Volume volume-774bac65-e197-4906-9609-6289bff47083 (774bac65-e197-4906-9609-6289bff47083): created successfully Aug 26 14:41:05 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-7f433c5c-c23e-4440-b5ed-b3a5b727eecf tempest-ProjectReaderTests-1785505571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8320db4-5304-4a3f-8ae8-21b50636e7eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:41:05 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-7f433c5c-c23e-4440-b5ed-b3a5b727eecf tempest-ProjectReaderTests-1785505571 None] Flow 'volume_create_manager' (85ab1748-cbdc-4983-a34b-0944feb1bde2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:41:05 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-7f433c5c-c23e-4440-b5ed-b3a5b727eecf tempest-ProjectReaderTests-1785505571 None] Created volume successfully. Aug 26 14:41:05 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-9e65271d-143f-4feb-91b6-d81ccda7a195 tempest-ProjectReaderTests-1785505571 None] Acquiring lock "cinder-774bac65-e197-4906-9609-6289bff47083-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:41:05 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-9e65271d-143f-4feb-91b6-d81ccda7a195 tempest-ProjectReaderTests-1785505571 None] Lock "cinder-774bac65-e197-4906-9609-6289bff47083-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:41:06 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-9e65271d-143f-4feb-91b6-d81ccda7a195 tempest-ProjectReaderTests-1785505571 None] Acquiring lock "cinder-quobyte-774bac65-e197-4906-9609-6289bff47083" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:41:06 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-9e65271d-143f-4feb-91b6-d81ccda7a195 tempest-ProjectReaderTests-1785505571 None] Lock "cinder-quobyte-774bac65-e197-4906-9609-6289bff47083" acquired by "delete_volume" :: waited 0.015s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:41:06 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[a45e866e-37d7-469c-ad23-1e44e6391477]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:41:06 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-9e65271d-143f-4feb-91b6-d81ccda7a195 tempest-ProjectReaderTests-1785505571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-774bac65-e197-4906-9609-6289bff47083 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:41:06 devstack sudo[113532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-774bac65-e197-4906-9609-6289bff47083 Aug 26 14:41:06 devstack sudo[113532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:41:06 devstack sudo[113532]: pam_unix(sudo:session): session closed for user root Aug 26 14:41:06 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-9e65271d-143f-4feb-91b6-d81ccda7a195 tempest-ProjectReaderTests-1785505571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-774bac65-e197-4906-9609-6289bff47083" returned: 0 in 0.337s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:41:06 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-9e65271d-143f-4feb-91b6-d81ccda7a195 tempest-ProjectReaderTests-1785505571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-774bac65-e197-4906-9609-6289bff47083 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:41:06 devstack sudo[113537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-774bac65-e197-4906-9609-6289bff47083 Aug 26 14:41:06 devstack sudo[113537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:41:06 devstack sudo[113537]: pam_unix(sudo:session): session closed for user root Aug 26 14:41:06 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-9e65271d-143f-4feb-91b6-d81ccda7a195 tempest-ProjectReaderTests-1785505571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-774bac65-e197-4906-9609-6289bff47083" returned: 0 in 0.240s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:41:06 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-9e65271d-143f-4feb-91b6-d81ccda7a195 tempest-ProjectReaderTests-1785505571 None] Lock "cinder-quobyte-774bac65-e197-4906-9609-6289bff47083" released by "delete_volume" :: held 0.613s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:41:06 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-9e65271d-143f-4feb-91b6-d81ccda7a195 tempest-ProjectReaderTests-1785505571 None] Created reservations ['3b4a8b51-8737-4a2a-b4cb-c6e5af9b0764', 'aa4e545b-4842-4c17-b639-77db6fc46827', 'cccd2001-a7c7-4ad5-a029-72baffce22ba', '26a2abd3-f230-431c-8f5b-f34c8bef4753'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:41:06 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-9e65271d-143f-4feb-91b6-d81ccda7a195 tempest-ProjectReaderTests-1785505571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:41:06 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-9e65271d-143f-4feb-91b6-d81ccda7a195 tempest-ProjectReaderTests-1785505571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:41:06 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-9e65271d-143f-4feb-91b6-d81ccda7a195 tempest-ProjectReaderTests-1785505571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:41:06 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-9e65271d-143f-4feb-91b6-d81ccda7a195 tempest-ProjectReaderTests-1785505571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:41:06 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-9e65271d-143f-4feb-91b6-d81ccda7a195 tempest-ProjectReaderTests-1785505571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:41:06 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-9e65271d-143f-4feb-91b6-d81ccda7a195 tempest-ProjectReaderTests-1785505571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:41:06 devstack sudo[113540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:41:06 devstack sudo[113540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:41:06 devstack sudo[113540]: pam_unix(sudo:session): session closed for user root Aug 26 14:41:06 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-9e65271d-143f-4feb-91b6-d81ccda7a195 tempest-ProjectReaderTests-1785505571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.236s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:41:06 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-9e65271d-143f-4feb-91b6-d81ccda7a195 tempest-ProjectReaderTests-1785505571 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:41:06 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-9e65271d-143f-4feb-91b6-d81ccda7a195 tempest-ProjectReaderTests-1785505571 None] Deleted volume successfully. Aug 26 14:41:07 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-9e65271d-143f-4feb-91b6-d81ccda7a195 tempest-ProjectReaderTests-1785505571 None] Lock "cinder-774bac65-e197-4906-9609-6289bff47083-delete_volume" released by "delete_volume" :: held 1.037s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:41:07 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e69128c-dffe-473c-befc-f28770acab15 tempest-ProjectReaderTests-1785505571 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:41:07 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-8e69128c-dffe-473c-befc-f28770acab15 tempest-ProjectReaderTests-1785505571 None] Flow 'volume_create_manager' (1f0758cb-0940-4332-b4b5-03186c9f11ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:41:07 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-8e69128c-dffe-473c-befc-f28770acab15 tempest-ProjectReaderTests-1785505571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (831314f0-e42a-4267-855b-01d1b20bf61e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:41:07 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-8e69128c-dffe-473c-befc-f28770acab15 tempest-ProjectReaderTests-1785505571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (831314f0-e42a-4267-855b-01d1b20bf61e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:41:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-427785414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9944ede6-74bb-4b8a-874d-944d3bebc1b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5ae8ad60fe74d0a969bfbf9a7dd8e99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:41:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:41:07Z,use_quota=True,user_id='501b7c4d89e249e29fa72f394adfb377',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:41:07 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-8e69128c-dffe-473c-befc-f28770acab15 tempest-ProjectReaderTests-1785505571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0f93bf0-d725-4658-bacb-0ad6cbaf0c56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:41:07 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-8e69128c-dffe-473c-befc-f28770acab15 tempest-ProjectReaderTests-1785505571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0f93bf0-d725-4658-bacb-0ad6cbaf0c56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:41:07 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-8e69128c-dffe-473c-befc-f28770acab15 tempest-ProjectReaderTests-1785505571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8447df8-8667-4216-877d-8a01b6f949f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:41:07 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-8e69128c-dffe-473c-befc-f28770acab15 tempest-ProjectReaderTests-1785505571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8447df8-8667-4216-877d-8a01b6f949f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9944ede6-74bb-4b8a-874d-944d3bebc1b8', 'volume_name': 'volume-9944ede6-74bb-4b8a-874d-944d3bebc1b8', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:41:07 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-8e69128c-dffe-473c-befc-f28770acab15 tempest-ProjectReaderTests-1785505571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be777062-0218-4339-861e-3b4b2a76a8b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:41:07 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-8e69128c-dffe-473c-befc-f28770acab15 tempest-ProjectReaderTests-1785505571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be777062-0218-4339-861e-3b4b2a76a8b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:41:07 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-8e69128c-dffe-473c-befc-f28770acab15 tempest-ProjectReaderTests-1785505571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cee93c76-4a0c-438d-b05e-ff0a68c78830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:41:07 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-8e69128c-dffe-473c-befc-f28770acab15 tempest-ProjectReaderTests-1785505571 None] Volume 9944ede6-74bb-4b8a-874d-944d3bebc1b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9944ede6-74bb-4b8a-874d-944d3bebc1b8', 'volume_size': 1} Aug 26 14:41:07 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-8e69128c-dffe-473c-befc-f28770acab15 tempest-ProjectReaderTests-1785505571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:41:07 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-8e69128c-dffe-473c-befc-f28770acab15 tempest-ProjectReaderTests-1785505571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:41:07 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-8e69128c-dffe-473c-befc-f28770acab15 tempest-ProjectReaderTests-1785505571 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:41:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-427785414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9944ede6-74bb-4b8a-874d-944d3bebc1b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5ae8ad60fe74d0a969bfbf9a7dd8e99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:41:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:41:07Z,use_quota=True,user_id='501b7c4d89e249e29fa72f394adfb377',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:41:07 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-8e69128c-dffe-473c-befc-f28770acab15 tempest-ProjectReaderTests-1785505571 None] Creating volume 9944ede6-74bb-4b8a-874d-944d3bebc1b8 {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:41:07 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-8e69128c-dffe-473c-befc-f28770acab15 tempest-ProjectReaderTests-1785505571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:41:07 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-8e69128c-dffe-473c-befc-f28770acab15 tempest-ProjectReaderTests-1785505571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:41:07 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-8e69128c-dffe-473c-befc-f28770acab15 tempest-ProjectReaderTests-1785505571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:41:07 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-8e69128c-dffe-473c-befc-f28770acab15 tempest-ProjectReaderTests-1785505571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:41:07 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-8e69128c-dffe-473c-befc-f28770acab15 tempest-ProjectReaderTests-1785505571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:41:07 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-8e69128c-dffe-473c-befc-f28770acab15 tempest-ProjectReaderTests-1785505571 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:41:07 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-8e69128c-dffe-473c-befc-f28770acab15 tempest-ProjectReaderTests-1785505571 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:41:07 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-8e69128c-dffe-473c-befc-f28770acab15 tempest-ProjectReaderTests-1785505571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9944ede6-74bb-4b8a-874d-944d3bebc1b8 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:41:07 devstack sudo[113543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9944ede6-74bb-4b8a-874d-944d3bebc1b8 1073741824 Aug 26 14:41:07 devstack sudo[113543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:41:07 devstack sudo[113543]: pam_unix(sudo:session): session closed for user root Aug 26 14:41:07 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-8e69128c-dffe-473c-befc-f28770acab15 tempest-ProjectReaderTests-1785505571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9944ede6-74bb-4b8a-874d-944d3bebc1b8 1073741824" returned: 0 in 0.394s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:41:08 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-8e69128c-dffe-473c-befc-f28770acab15 tempest-ProjectReaderTests-1785505571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9944ede6-74bb-4b8a-874d-944d3bebc1b8 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:41:08 devstack sudo[113549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9944ede6-74bb-4b8a-874d-944d3bebc1b8 Aug 26 14:41:08 devstack sudo[113549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:41:08 devstack sudo[113549]: pam_unix(sudo:session): session closed for user root Aug 26 14:41:08 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-8e69128c-dffe-473c-befc-f28770acab15 tempest-ProjectReaderTests-1785505571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9944ede6-74bb-4b8a-874d-944d3bebc1b8" returned: 0 in 0.239s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:41:08 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-8e69128c-dffe-473c-befc-f28770acab15 tempest-ProjectReaderTests-1785505571 None] <== create_volume: return (674ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:41:08 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-8e69128c-dffe-473c-befc-f28770acab15 tempest-ProjectReaderTests-1785505571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.676s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:41:08 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-8e69128c-dffe-473c-befc-f28770acab15 tempest-ProjectReaderTests-1785505571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cee93c76-4a0c-438d-b05e-ff0a68c78830) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9944ede6-74bb-4b8a-874d-944d3bebc1b8', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:41:08 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-8e69128c-dffe-473c-befc-f28770acab15 tempest-ProjectReaderTests-1785505571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e83030e-d382-4c0d-a3f3-8839cd804857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:41:08 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-8e69128c-dffe-473c-befc-f28770acab15 tempest-ProjectReaderTests-1785505571 None] Volume volume-9944ede6-74bb-4b8a-874d-944d3bebc1b8 (9944ede6-74bb-4b8a-874d-944d3bebc1b8): created successfully Aug 26 14:41:08 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-8e69128c-dffe-473c-befc-f28770acab15 tempest-ProjectReaderTests-1785505571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e83030e-d382-4c0d-a3f3-8839cd804857) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:41:08 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-8e69128c-dffe-473c-befc-f28770acab15 tempest-ProjectReaderTests-1785505571 None] Flow 'volume_create_manager' (1f0758cb-0940-4332-b4b5-03186c9f11ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:41:08 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-8e69128c-dffe-473c-befc-f28770acab15 tempest-ProjectReaderTests-1785505571 None] Created volume successfully. Aug 26 14:41:08 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-799fd839-aa64-4b29-a1b2-e5e7b154b511 tempest-ProjectReaderTests-1785505571 None] Acquiring lock "cinder-9944ede6-74bb-4b8a-874d-944d3bebc1b8-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:41:08 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-799fd839-aa64-4b29-a1b2-e5e7b154b511 tempest-ProjectReaderTests-1785505571 None] Lock "cinder-9944ede6-74bb-4b8a-874d-944d3bebc1b8-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:41:08 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-799fd839-aa64-4b29-a1b2-e5e7b154b511 tempest-ProjectReaderTests-1785505571 None] Acquiring lock "cinder-quobyte-9944ede6-74bb-4b8a-874d-944d3bebc1b8" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:41:08 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-799fd839-aa64-4b29-a1b2-e5e7b154b511 tempest-ProjectReaderTests-1785505571 None] Lock "cinder-quobyte-9944ede6-74bb-4b8a-874d-944d3bebc1b8" acquired by "delete_volume" :: waited 0.015s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:41:08 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[2477bb7e-7513-44c5-965f-959df59960e2]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:41:08 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-799fd839-aa64-4b29-a1b2-e5e7b154b511 tempest-ProjectReaderTests-1785505571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9944ede6-74bb-4b8a-874d-944d3bebc1b8 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:41:08 devstack sudo[113552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9944ede6-74bb-4b8a-874d-944d3bebc1b8 Aug 26 14:41:08 devstack sudo[113552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:41:08 devstack sudo[113552]: pam_unix(sudo:session): session closed for user root Aug 26 14:41:08 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-799fd839-aa64-4b29-a1b2-e5e7b154b511 tempest-ProjectReaderTests-1785505571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9944ede6-74bb-4b8a-874d-944d3bebc1b8" returned: 0 in 0.355s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:41:08 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-799fd839-aa64-4b29-a1b2-e5e7b154b511 tempest-ProjectReaderTests-1785505571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9944ede6-74bb-4b8a-874d-944d3bebc1b8 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:41:09 devstack sudo[113557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9944ede6-74bb-4b8a-874d-944d3bebc1b8 Aug 26 14:41:09 devstack sudo[113557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:41:09 devstack sudo[113557]: pam_unix(sudo:session): session closed for user root Aug 26 14:41:09 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-799fd839-aa64-4b29-a1b2-e5e7b154b511 tempest-ProjectReaderTests-1785505571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9944ede6-74bb-4b8a-874d-944d3bebc1b8" returned: 0 in 0.253s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:41:09 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-799fd839-aa64-4b29-a1b2-e5e7b154b511 tempest-ProjectReaderTests-1785505571 None] Lock "cinder-quobyte-9944ede6-74bb-4b8a-874d-944d3bebc1b8" released by "delete_volume" :: held 0.647s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:41:09 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-799fd839-aa64-4b29-a1b2-e5e7b154b511 tempest-ProjectReaderTests-1785505571 None] Created reservations ['cff57dca-6087-4f5f-a2bb-21119767cf58', 'e875757f-7838-4bd5-ba6e-e562e9da07db', '322e8119-73ee-4a81-83f0-beb87ef93c9b', '0c648c10-2440-447a-a5dd-bf4184cad69f'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:41:09 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-799fd839-aa64-4b29-a1b2-e5e7b154b511 tempest-ProjectReaderTests-1785505571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:41:09 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-799fd839-aa64-4b29-a1b2-e5e7b154b511 tempest-ProjectReaderTests-1785505571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:41:09 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-799fd839-aa64-4b29-a1b2-e5e7b154b511 tempest-ProjectReaderTests-1785505571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:41:09 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-799fd839-aa64-4b29-a1b2-e5e7b154b511 tempest-ProjectReaderTests-1785505571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:41:09 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-799fd839-aa64-4b29-a1b2-e5e7b154b511 tempest-ProjectReaderTests-1785505571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:41:09 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-799fd839-aa64-4b29-a1b2-e5e7b154b511 tempest-ProjectReaderTests-1785505571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:41:09 devstack sudo[113560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:41:09 devstack sudo[113560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:41:09 devstack sudo[113560]: pam_unix(sudo:session): session closed for user root Aug 26 14:41:09 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-799fd839-aa64-4b29-a1b2-e5e7b154b511 tempest-ProjectReaderTests-1785505571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.242s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:41:09 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-799fd839-aa64-4b29-a1b2-e5e7b154b511 tempest-ProjectReaderTests-1785505571 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:41:09 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-799fd839-aa64-4b29-a1b2-e5e7b154b511 tempest-ProjectReaderTests-1785505571 None] Deleted volume successfully. Aug 26 14:41:09 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-799fd839-aa64-4b29-a1b2-e5e7b154b511 tempest-ProjectReaderTests-1785505571 None] Lock "cinder-9944ede6-74bb-4b8a-874d-944d3bebc1b8-delete_volume" released by "delete_volume" :: held 1.095s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:41:19 devstack cinder-volume[94394]: DEBUG dbcounter [-] [94394] Writing DB stats cinder:UPDATE=157,cinder:SELECT=122,cinder:INSERT=41,cinder:DELETE=13 {{(pid=94394) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 14:41:19 devstack cinder-volume[94394]: DEBUG dbcounter [-] [94394] Writing DB stats cinder:SELECT=106,cinder:UPDATE=187,cinder:INSERT=39,cinder:DELETE=18 {{(pid=94394) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 14:41:29 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-83ccfb74-ba57-47f0-a1a4-2920737e5560 tempest-SnapshotDependencyTests-260387955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:41:29 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-83ccfb74-ba57-47f0-a1a4-2920737e5560 tempest-SnapshotDependencyTests-260387955 None] Flow 'volume_create_manager' (4e40079b-b2f8-4a5d-a228-e3fd719f2b61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:41:29 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-83ccfb74-ba57-47f0-a1a4-2920737e5560 tempest-SnapshotDependencyTests-260387955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5fad6a0-169c-4304-ab64-c2129d32b82c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:41:29 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-83ccfb74-ba57-47f0-a1a4-2920737e5560 tempest-SnapshotDependencyTests-260387955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5fad6a0-169c-4304-ab64-c2129d32b82c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:41:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-922728662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77c467c3-a87a-4403-a260-cac6645396c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11add2f62a8d45ac86b4bf5a9ee90d91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:41:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:41:30Z,use_quota=True,user_id='9ddcf088583b4b389a559a735422fd59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:41:29 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-83ccfb74-ba57-47f0-a1a4-2920737e5560 tempest-SnapshotDependencyTests-260387955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0df488aa-ebca-4561-9105-6c1148010bd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:41:29 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-83ccfb74-ba57-47f0-a1a4-2920737e5560 tempest-SnapshotDependencyTests-260387955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0df488aa-ebca-4561-9105-6c1148010bd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:41:29 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-83ccfb74-ba57-47f0-a1a4-2920737e5560 tempest-SnapshotDependencyTests-260387955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c49e6a74-46b5-4f11-9716-d8f6edfa05d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:41:29 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-83ccfb74-ba57-47f0-a1a4-2920737e5560 tempest-SnapshotDependencyTests-260387955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c49e6a74-46b5-4f11-9716-d8f6edfa05d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77c467c3-a87a-4403-a260-cac6645396c9', 'volume_name': 'volume-77c467c3-a87a-4403-a260-cac6645396c9', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:41:29 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-83ccfb74-ba57-47f0-a1a4-2920737e5560 tempest-SnapshotDependencyTests-260387955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1197404-0c81-46f9-94d0-779381c01c44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:41:29 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-83ccfb74-ba57-47f0-a1a4-2920737e5560 tempest-SnapshotDependencyTests-260387955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1197404-0c81-46f9-94d0-779381c01c44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:41:29 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-83ccfb74-ba57-47f0-a1a4-2920737e5560 tempest-SnapshotDependencyTests-260387955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7977499-be33-4b98-bc16-ed1d454744d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:41:29 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-83ccfb74-ba57-47f0-a1a4-2920737e5560 tempest-SnapshotDependencyTests-260387955 None] Volume 77c467c3-a87a-4403-a260-cac6645396c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77c467c3-a87a-4403-a260-cac6645396c9', 'volume_size': 1} Aug 26 14:41:29 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-83ccfb74-ba57-47f0-a1a4-2920737e5560 tempest-SnapshotDependencyTests-260387955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:41:29 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-83ccfb74-ba57-47f0-a1a4-2920737e5560 tempest-SnapshotDependencyTests-260387955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:41:29 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-83ccfb74-ba57-47f0-a1a4-2920737e5560 tempest-SnapshotDependencyTests-260387955 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:41:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-922728662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77c467c3-a87a-4403-a260-cac6645396c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11add2f62a8d45ac86b4bf5a9ee90d91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:41:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:41:30Z,use_quota=True,user_id='9ddcf088583b4b389a559a735422fd59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:41:29 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-83ccfb74-ba57-47f0-a1a4-2920737e5560 tempest-SnapshotDependencyTests-260387955 None] Creating volume 77c467c3-a87a-4403-a260-cac6645396c9 {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:41:29 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-83ccfb74-ba57-47f0-a1a4-2920737e5560 tempest-SnapshotDependencyTests-260387955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:41:29 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-83ccfb74-ba57-47f0-a1a4-2920737e5560 tempest-SnapshotDependencyTests-260387955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:41:29 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-83ccfb74-ba57-47f0-a1a4-2920737e5560 tempest-SnapshotDependencyTests-260387955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:41:29 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-83ccfb74-ba57-47f0-a1a4-2920737e5560 tempest-SnapshotDependencyTests-260387955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:41:29 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-83ccfb74-ba57-47f0-a1a4-2920737e5560 tempest-SnapshotDependencyTests-260387955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:41:29 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-83ccfb74-ba57-47f0-a1a4-2920737e5560 tempest-SnapshotDependencyTests-260387955 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:41:29 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-83ccfb74-ba57-47f0-a1a4-2920737e5560 tempest-SnapshotDependencyTests-260387955 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:41:29 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-83ccfb74-ba57-47f0-a1a4-2920737e5560 tempest-SnapshotDependencyTests-260387955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-77c467c3-a87a-4403-a260-cac6645396c9 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:41:29 devstack sudo[113569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-77c467c3-a87a-4403-a260-cac6645396c9 1073741824 Aug 26 14:41:29 devstack sudo[113569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:41:30 devstack sudo[113569]: pam_unix(sudo:session): session closed for user root Aug 26 14:41:30 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-83ccfb74-ba57-47f0-a1a4-2920737e5560 tempest-SnapshotDependencyTests-260387955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-77c467c3-a87a-4403-a260-cac6645396c9 1073741824" returned: 0 in 0.413s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:41:30 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-83ccfb74-ba57-47f0-a1a4-2920737e5560 tempest-SnapshotDependencyTests-260387955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-77c467c3-a87a-4403-a260-cac6645396c9 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:41:30 devstack sudo[113575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-77c467c3-a87a-4403-a260-cac6645396c9 Aug 26 14:41:30 devstack sudo[113575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:41:30 devstack sudo[113575]: pam_unix(sudo:session): session closed for user root Aug 26 14:41:30 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-83ccfb74-ba57-47f0-a1a4-2920737e5560 tempest-SnapshotDependencyTests-260387955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-77c467c3-a87a-4403-a260-cac6645396c9" returned: 0 in 0.237s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:41:30 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-83ccfb74-ba57-47f0-a1a4-2920737e5560 tempest-SnapshotDependencyTests-260387955 None] <== create_volume: return (688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:41:30 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-83ccfb74-ba57-47f0-a1a4-2920737e5560 tempest-SnapshotDependencyTests-260387955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.690s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:41:30 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-83ccfb74-ba57-47f0-a1a4-2920737e5560 tempest-SnapshotDependencyTests-260387955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7977499-be33-4b98-bc16-ed1d454744d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77c467c3-a87a-4403-a260-cac6645396c9', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:41:30 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-83ccfb74-ba57-47f0-a1a4-2920737e5560 tempest-SnapshotDependencyTests-260387955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14d444ce-52dd-4b14-8c2f-4c84b18ff1fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:41:30 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-83ccfb74-ba57-47f0-a1a4-2920737e5560 tempest-SnapshotDependencyTests-260387955 None] Volume volume-77c467c3-a87a-4403-a260-cac6645396c9 (77c467c3-a87a-4403-a260-cac6645396c9): created successfully Aug 26 14:41:30 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-83ccfb74-ba57-47f0-a1a4-2920737e5560 tempest-SnapshotDependencyTests-260387955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14d444ce-52dd-4b14-8c2f-4c84b18ff1fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:41:30 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-83ccfb74-ba57-47f0-a1a4-2920737e5560 tempest-SnapshotDependencyTests-260387955 None] Flow 'volume_create_manager' (4e40079b-b2f8-4a5d-a228-e3fd719f2b61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:41:30 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-83ccfb74-ba57-47f0-a1a4-2920737e5560 tempest-SnapshotDependencyTests-260387955 None] Created volume successfully. Aug 26 14:41:30 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-713e300c-a269-474d-b6f0-ce5674ff93a0 tempest-SnapshotDependencyTests-260387955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:41:30 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-713e300c-a269-474d-b6f0-ce5674ff93a0 tempest-SnapshotDependencyTests-260387955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:41:30 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-713e300c-a269-474d-b6f0-ce5674ff93a0 tempest-SnapshotDependencyTests-260387955 None] Creating offline snapshot b9fc4543-24ce-44b5-b15f-e255754f4b9a of volume 77c467c3-a87a-4403-a260-cac6645396c9 {{(pid=94394) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 14:41:30 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ae465c0-435e-4456-96bf-278b0815c1ec]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:41:30 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-713e300c-a269-474d-b6f0-ce5674ff93a0 tempest-SnapshotDependencyTests-260387955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-77c467c3-a87a-4403-a260-cac6645396c9 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:41:30 devstack sudo[113579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-77c467c3-a87a-4403-a260-cac6645396c9 Aug 26 14:41:30 devstack sudo[113579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:41:31 devstack sudo[113579]: pam_unix(sudo:session): session closed for user root Aug 26 14:41:31 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-713e300c-a269-474d-b6f0-ce5674ff93a0 tempest-SnapshotDependencyTests-260387955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-77c467c3-a87a-4403-a260-cac6645396c9" returned: 0 in 0.347s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:41:31 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-713e300c-a269-474d-b6f0-ce5674ff93a0 tempest-SnapshotDependencyTests-260387955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-77c467c3-a87a-4403-a260-cac6645396c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-77c467c3-a87a-4403-a260-cac6645396c9.b9fc4543-24ce-44b5-b15f-e255754f4b9a 1G {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:41:31 devstack sudo[113584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-77c467c3-a87a-4403-a260-cac6645396c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-77c467c3-a87a-4403-a260-cac6645396c9.b9fc4543-24ce-44b5-b15f-e255754f4b9a 1G Aug 26 14:41:31 devstack sudo[113584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:41:31 devstack sudo[113584]: pam_unix(sudo:session): session closed for user root Aug 26 14:41:31 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-713e300c-a269-474d-b6f0-ce5674ff93a0 tempest-SnapshotDependencyTests-260387955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-77c467c3-a87a-4403-a260-cac6645396c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-77c467c3-a87a-4403-a260-cac6645396c9.b9fc4543-24ce-44b5-b15f-e255754f4b9a 1G" returned: 0 in 0.379s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:41:31 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-713e300c-a269-474d-b6f0-ce5674ff93a0 tempest-SnapshotDependencyTests-260387955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77c467c3-a87a-4403-a260-cac6645396c9 -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-77c467c3-a87a-4403-a260-cac6645396c9.b9fc4543-24ce-44b5-b15f-e255754f4b9a {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:41:31 devstack sudo[113589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77c467c3-a87a-4403-a260-cac6645396c9 -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-77c467c3-a87a-4403-a260-cac6645396c9.b9fc4543-24ce-44b5-b15f-e255754f4b9a Aug 26 14:41:31 devstack sudo[113589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:41:31 devstack sudo[113589]: pam_unix(sudo:session): session closed for user root Aug 26 14:41:31 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-713e300c-a269-474d-b6f0-ce5674ff93a0 tempest-SnapshotDependencyTests-260387955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77c467c3-a87a-4403-a260-cac6645396c9 -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-77c467c3-a87a-4403-a260-cac6645396c9.b9fc4543-24ce-44b5-b15f-e255754f4b9a" returned: 0 in 0.293s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:41:31 devstack cinder-volume[94394]: WARNING cinder.volume.drivers.remotefs [None req-713e300c-a269-474d-b6f0-ce5674ff93a0 tempest-SnapshotDependencyTests-260387955 None] /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-77c467c3-a87a-4403-a260-cac6645396c9.b9fc4543-24ce-44b5-b15f-e255754f4b9a is being set with open permissions: ugo+rw Aug 26 14:41:31 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-713e300c-a269-474d-b6f0-ce5674ff93a0 tempest-SnapshotDependencyTests-260387955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-77c467c3-a87a-4403-a260-cac6645396c9.b9fc4543-24ce-44b5-b15f-e255754f4b9a {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:41:31 devstack sudo[113594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-77c467c3-a87a-4403-a260-cac6645396c9.b9fc4543-24ce-44b5-b15f-e255754f4b9a Aug 26 14:41:31 devstack sudo[113594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:41:32 devstack sudo[113594]: pam_unix(sudo:session): session closed for user root Aug 26 14:41:32 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-713e300c-a269-474d-b6f0-ce5674ff93a0 tempest-SnapshotDependencyTests-260387955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-77c467c3-a87a-4403-a260-cac6645396c9.b9fc4543-24ce-44b5-b15f-e255754f4b9a" returned: 0 in 0.243s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:41:32 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-713e300c-a269-474d-b6f0-ce5674ff93a0 tempest-SnapshotDependencyTests-260387955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-77c467c3-a87a-4403-a260-cac6645396c9.info {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:41:32 devstack sudo[113597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-77c467c3-a87a-4403-a260-cac6645396c9.info Aug 26 14:41:32 devstack sudo[113597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:41:32 devstack sudo[113597]: pam_unix(sudo:session): session closed for user root Aug 26 14:41:32 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-713e300c-a269-474d-b6f0-ce5674ff93a0 tempest-SnapshotDependencyTests-260387955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-77c467c3-a87a-4403-a260-cac6645396c9.info" returned: 0 in 0.238s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:41:32 devstack cinder-volume[94394]: WARNING cinder.volume.drivers.remotefs [None req-713e300c-a269-474d-b6f0-ce5674ff93a0 tempest-SnapshotDependencyTests-260387955 None] /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-77c467c3-a87a-4403-a260-cac6645396c9.info is being set with open permissions: ugo+rw Aug 26 14:41:32 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-713e300c-a269-474d-b6f0-ce5674ff93a0 tempest-SnapshotDependencyTests-260387955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-77c467c3-a87a-4403-a260-cac6645396c9.info {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:41:32 devstack sudo[113600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-77c467c3-a87a-4403-a260-cac6645396c9.info Aug 26 14:41:32 devstack sudo[113600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:41:32 devstack sudo[113600]: pam_unix(sudo:session): session closed for user root Aug 26 14:41:32 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-713e300c-a269-474d-b6f0-ce5674ff93a0 tempest-SnapshotDependencyTests-260387955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-77c467c3-a87a-4403-a260-cac6645396c9.info" returned: 0 in 0.241s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:41:32 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-713e300c-a269-474d-b6f0-ce5674ff93a0 tempest-SnapshotDependencyTests-260387955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.820s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:41:32 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-713e300c-a269-474d-b6f0-ce5674ff93a0 tempest-SnapshotDependencyTests-260387955 None] Create snapshot completed successfully Aug 26 14:41:33 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b5afd0c-ef8e-4ec2-ab2a-f58d1e62c065 tempest-SnapshotDependencyTests-260387955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:41:33 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-7b5afd0c-ef8e-4ec2-ab2a-f58d1e62c065 tempest-SnapshotDependencyTests-260387955 None] Flow 'volume_create_manager' (43e772d9-a3ea-414a-b31e-4656dcb9ba14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:41:33 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-7b5afd0c-ef8e-4ec2-ab2a-f58d1e62c065 tempest-SnapshotDependencyTests-260387955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b19a2d2-39c5-4621-85f4-469e088c1f03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:41:33 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-7b5afd0c-ef8e-4ec2-ab2a-f58d1e62c065 tempest-SnapshotDependencyTests-260387955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b19a2d2-39c5-4621-85f4-469e088c1f03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:41:33Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96b529e0-b039-4e18-bb00-e754df5642fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11add2f62a8d45ac86b4bf5a9ee90d91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:41:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b9fc4543-24ce-44b5-b15f-e255754f4b9a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:41:33Z,use_quota=True,user_id='9ddcf088583b4b389a559a735422fd59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:41:33 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-7b5afd0c-ef8e-4ec2-ab2a-f58d1e62c065 tempest-SnapshotDependencyTests-260387955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8080f648-3b00-4fae-86d9-8f2451c21940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:41:33 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-7b5afd0c-ef8e-4ec2-ab2a-f58d1e62c065 tempest-SnapshotDependencyTests-260387955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8080f648-3b00-4fae-86d9-8f2451c21940) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:41:33 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-7b5afd0c-ef8e-4ec2-ab2a-f58d1e62c065 tempest-SnapshotDependencyTests-260387955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5e75e05-3699-468e-9156-873d8b32e64c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:41:33 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-7b5afd0c-ef8e-4ec2-ab2a-f58d1e62c065 tempest-SnapshotDependencyTests-260387955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5e75e05-3699-468e-9156-873d8b32e64c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '96b529e0-b039-4e18-bb00-e754df5642fc', 'volume_name': 'volume-96b529e0-b039-4e18-bb00-e754df5642fc', 'volume_size': 1, 'snapshot_id': 'b9fc4543-24ce-44b5-b15f-e255754f4b9a'}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:41:33 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-7b5afd0c-ef8e-4ec2-ab2a-f58d1e62c065 tempest-SnapshotDependencyTests-260387955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d481d56-210e-4d59-86b6-476bf732980f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:41:33 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-7b5afd0c-ef8e-4ec2-ab2a-f58d1e62c065 tempest-SnapshotDependencyTests-260387955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d481d56-210e-4d59-86b6-476bf732980f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:41:33 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-7b5afd0c-ef8e-4ec2-ab2a-f58d1e62c065 tempest-SnapshotDependencyTests-260387955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43bd9037-2b0c-4157-b4cd-3388db0a43da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:41:33 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-7b5afd0c-ef8e-4ec2-ab2a-f58d1e62c065 tempest-SnapshotDependencyTests-260387955 None] Volume 96b529e0-b039-4e18-bb00-e754df5642fc: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-96b529e0-b039-4e18-bb00-e754df5642fc', 'volume_size': 1, 'snapshot_id': 'b9fc4543-24ce-44b5-b15f-e255754f4b9a'} Aug 26 14:41:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-7b5afd0c-ef8e-4ec2-ab2a-f58d1e62c065 tempest-SnapshotDependencyTests-260387955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:41:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-7b5afd0c-ef8e-4ec2-ab2a-f58d1e62c065 tempest-SnapshotDependencyTests-260387955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:41:33 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-7b5afd0c-ef8e-4ec2-ab2a-f58d1e62c065 tempest-SnapshotDependencyTests-260387955 None] Acquiring lock "cinder-quobyte-b9fc4543-24ce-44b5-b15f-e255754f4b9a-96b529e0-b039-4e18-bb00-e754df5642fc" by "_create_volume_from_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:41:33 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-7b5afd0c-ef8e-4ec2-ab2a-f58d1e62c065 tempest-SnapshotDependencyTests-260387955 None] Lock "cinder-quobyte-b9fc4543-24ce-44b5-b15f-e255754f4b9a-96b529e0-b039-4e18-bb00-e754df5642fc" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:41:33 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-7b5afd0c-ef8e-4ec2-ab2a-f58d1e62c065 tempest-SnapshotDependencyTests-260387955 None] Creating volume 96b529e0-b039-4e18-bb00-e754df5642fc from snapshot b9fc4543-24ce-44b5-b15f-e255754f4b9a {{(pid=94394) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Aug 26 14:41:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-7b5afd0c-ef8e-4ec2-ab2a-f58d1e62c065 tempest-SnapshotDependencyTests-260387955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:41:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-7b5afd0c-ef8e-4ec2-ab2a-f58d1e62c065 tempest-SnapshotDependencyTests-260387955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:41:33 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-7b5afd0c-ef8e-4ec2-ab2a-f58d1e62c065 tempest-SnapshotDependencyTests-260387955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:41:33 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-7b5afd0c-ef8e-4ec2-ab2a-f58d1e62c065 tempest-SnapshotDependencyTests-260387955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:41:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-7b5afd0c-ef8e-4ec2-ab2a-f58d1e62c065 tempest-SnapshotDependencyTests-260387955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:41:33 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-7b5afd0c-ef8e-4ec2-ab2a-f58d1e62c065 tempest-SnapshotDependencyTests-260387955 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:41:33 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-7b5afd0c-ef8e-4ec2-ab2a-f58d1e62c065 tempest-SnapshotDependencyTests-260387955 None] Acquiring lock "cinder-quobyte-96b529e0-b039-4e18-bb00-e754df5642fc" by "_copy_volume_from_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:41:33 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-7b5afd0c-ef8e-4ec2-ab2a-f58d1e62c065 tempest-SnapshotDependencyTests-260387955 None] Lock "cinder-quobyte-96b529e0-b039-4e18-bb00-e754df5642fc" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:41:33 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-7b5afd0c-ef8e-4ec2-ab2a-f58d1e62c065 tempest-SnapshotDependencyTests-260387955 None] snapshot: b9fc4543-24ce-44b5-b15f-e255754f4b9a, volume: 96b529e0-b039-4e18-bb00-e754df5642fc, {{(pid=94394) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 26 14:41:33 devstack cinder-volume[94394]: DEBUG oslo_service.periodic_task [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94394) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 14:41:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:41:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:41:33 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:41:33 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:41:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:41:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:41:33 devstack sudo[113603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:41:33 devstack sudo[113603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:41:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-7b5afd0c-ef8e-4ec2-ab2a-f58d1e62c065 tempest-SnapshotDependencyTests-260387955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:41:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-7b5afd0c-ef8e-4ec2-ab2a-f58d1e62c065 tempest-SnapshotDependencyTests-260387955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:41:33 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-7b5afd0c-ef8e-4ec2-ab2a-f58d1e62c065 tempest-SnapshotDependencyTests-260387955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:41:33 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-7b5afd0c-ef8e-4ec2-ab2a-f58d1e62c065 tempest-SnapshotDependencyTests-260387955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:41:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-7b5afd0c-ef8e-4ec2-ab2a-f58d1e62c065 tempest-SnapshotDependencyTests-260387955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:41:33 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae3aaf93-b2c0-4785-a44f-d4d2f90c76d9]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:41:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-7b5afd0c-ef8e-4ec2-ab2a-f58d1e62c065 tempest-SnapshotDependencyTests-260387955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-77c467c3-a87a-4403-a260-cac6645396c9.b9fc4543-24ce-44b5-b15f-e255754f4b9a {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:41:33 devstack sudo[113617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-77c467c3-a87a-4403-a260-cac6645396c9.b9fc4543-24ce-44b5-b15f-e255754f4b9a Aug 26 14:41:33 devstack sudo[113617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:41:33 devstack sudo[113603]: pam_unix(sudo:session): session closed for user root Aug 26 14:41:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.277s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:41:33 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:41:33 devstack cinder-volume[94394]: DEBUG oslo_service.periodic_task [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Running periodic task VolumeManager._thread_info {{(pid=94394) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 14:41:33 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] thread count: 28 {{(pid=94394) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 14:41:33 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] thread info: [<_MainThread(MainThread, started 126600738033792)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94394) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 14:41:34 devstack sudo[113617]: pam_unix(sudo:session): session closed for user root Aug 26 14:41:34 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-7b5afd0c-ef8e-4ec2-ab2a-f58d1e62c065 tempest-SnapshotDependencyTests-260387955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-77c467c3-a87a-4403-a260-cac6645396c9.b9fc4543-24ce-44b5-b15f-e255754f4b9a" returned: 0 in 0.385s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:41:34 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-7b5afd0c-ef8e-4ec2-ab2a-f58d1e62c065 tempest-SnapshotDependencyTests-260387955 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-77c467c3-a87a-4403-a260-cac6645396c9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94394) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 14:41:34 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[320514b5-afed-4a2b-b702-d2b4bf477ecd]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:41:34 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-7b5afd0c-ef8e-4ec2-ab2a-f58d1e62c065 tempest-SnapshotDependencyTests-260387955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-77c467c3-a87a-4403-a260-cac6645396c9 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:41:34 devstack sudo[113647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-77c467c3-a87a-4403-a260-cac6645396c9 Aug 26 14:41:34 devstack sudo[113647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:41:34 devstack sudo[113647]: pam_unix(sudo:session): session closed for user root Aug 26 14:41:34 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-7b5afd0c-ef8e-4ec2-ab2a-f58d1e62c065 tempest-SnapshotDependencyTests-260387955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-77c467c3-a87a-4403-a260-cac6645396c9" returned: 0 in 0.355s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:41:34 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-7b5afd0c-ef8e-4ec2-ab2a-f58d1e62c065 tempest-SnapshotDependencyTests-260387955 None] will copy from snapshot at /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-77c467c3-a87a-4403-a260-cac6645396c9 {{(pid=94394) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 26 14:41:34 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-7b5afd0c-ef8e-4ec2-ab2a-f58d1e62c065 tempest-SnapshotDependencyTests-260387955 None] Creating direct copy from snapshot {{(pid=94394) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 26 14:41:34 devstack cinder-volume[94394]: DEBUG cinder.utils [None req-7b5afd0c-ef8e-4ec2-ab2a-f58d1e62c065 tempest-SnapshotDependencyTests-260387955 None] Path /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-96b529e0-b039-4e18-bb00-e754df5642fc not found in is_blk_device check {{(pid=94394) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 26 14:41:34 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-7b5afd0c-ef8e-4ec2-ab2a-f58d1e62c065 tempest-SnapshotDependencyTests-260387955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-77c467c3-a87a-4403-a260-cac6645396c9 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-96b529e0-b039-4e18-bb00-e754df5642fc {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:41:34 devstack sudo[113652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-77c467c3-a87a-4403-a260-cac6645396c9 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-96b529e0-b039-4e18-bb00-e754df5642fc Aug 26 14:41:34 devstack sudo[113652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:41:38 devstack sudo[113652]: pam_unix(sudo:session): session closed for user root Aug 26 14:41:38 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-7b5afd0c-ef8e-4ec2-ab2a-f58d1e62c065 tempest-SnapshotDependencyTests-260387955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-77c467c3-a87a-4403-a260-cac6645396c9 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-96b529e0-b039-4e18-bb00-e754df5642fc" returned: 0 in 4.043s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:41:38 devstack cinder-volume[94394]: DEBUG cinder.image.image_utils [None req-7b5afd0c-ef8e-4ec2-ab2a-f58d1e62c065 tempest-SnapshotDependencyTests-260387955 None] Image conversion details: src /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-77c467c3-a87a-4403-a260-cac6645396c9, size 1024.00 MB, duration 4.04 sec, destination /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-96b529e0-b039-4e18-bb00-e754df5642fc {{(pid=94394) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 14:41:38 devstack cinder-volume[94394]: INFO cinder.image.image_utils [None req-7b5afd0c-ef8e-4ec2-ab2a-f58d1e62c065 tempest-SnapshotDependencyTests-260387955 None] Converted 1024.00 MB image at 253.21 MB/s Aug 26 14:41:38 devstack cinder-volume[94394]: WARNING cinder.volume.drivers.remotefs [None req-7b5afd0c-ef8e-4ec2-ab2a-f58d1e62c065 tempest-SnapshotDependencyTests-260387955 None] /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-96b529e0-b039-4e18-bb00-e754df5642fc is being set with open permissions: ugo+rw Aug 26 14:41:38 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-7b5afd0c-ef8e-4ec2-ab2a-f58d1e62c065 tempest-SnapshotDependencyTests-260387955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-96b529e0-b039-4e18-bb00-e754df5642fc {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:41:38 devstack sudo[113665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-96b529e0-b039-4e18-bb00-e754df5642fc Aug 26 14:41:38 devstack sudo[113665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:41:38 devstack sudo[113665]: pam_unix(sudo:session): session closed for user root Aug 26 14:41:38 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-7b5afd0c-ef8e-4ec2-ab2a-f58d1e62c065 tempest-SnapshotDependencyTests-260387955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-96b529e0-b039-4e18-bb00-e754df5642fc" returned: 0 in 0.236s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:41:38 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-7b5afd0c-ef8e-4ec2-ab2a-f58d1e62c065 tempest-SnapshotDependencyTests-260387955 None] Lock "cinder-quobyte-96b529e0-b039-4e18-bb00-e754df5642fc" released by "_copy_volume_from_snapshot" :: held 5.131s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:41:38 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-7b5afd0c-ef8e-4ec2-ab2a-f58d1e62c065 tempest-SnapshotDependencyTests-260387955 None] Lock "cinder-quobyte-b9fc4543-24ce-44b5-b15f-e255754f4b9a-96b529e0-b039-4e18-bb00-e754df5642fc" released by "_create_volume_from_snapshot" :: held 5.194s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:41:38 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-7b5afd0c-ef8e-4ec2-ab2a-f58d1e62c065 tempest-SnapshotDependencyTests-260387955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.208s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:41:38 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-7b5afd0c-ef8e-4ec2-ab2a-f58d1e62c065 tempest-SnapshotDependencyTests-260387955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43bd9037-2b0c-4157-b4cd-3388db0a43da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96b529e0-b039-4e18-bb00-e754df5642fc', 'volume_size': 1, 'snapshot_id': 'b9fc4543-24ce-44b5-b15f-e255754f4b9a'}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:41:38 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-7b5afd0c-ef8e-4ec2-ab2a-f58d1e62c065 tempest-SnapshotDependencyTests-260387955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f92cd38a-94d9-42b1-87bf-1dcf83f63194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:41:38 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-7b5afd0c-ef8e-4ec2-ab2a-f58d1e62c065 tempest-SnapshotDependencyTests-260387955 None] Volume volume-96b529e0-b039-4e18-bb00-e754df5642fc (96b529e0-b039-4e18-bb00-e754df5642fc): created successfully Aug 26 14:41:38 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-7b5afd0c-ef8e-4ec2-ab2a-f58d1e62c065 tempest-SnapshotDependencyTests-260387955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f92cd38a-94d9-42b1-87bf-1dcf83f63194) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:41:38 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-7b5afd0c-ef8e-4ec2-ab2a-f58d1e62c065 tempest-SnapshotDependencyTests-260387955 None] Flow 'volume_create_manager' (43e772d9-a3ea-414a-b31e-4656dcb9ba14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:41:38 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-7b5afd0c-ef8e-4ec2-ab2a-f58d1e62c065 tempest-SnapshotDependencyTests-260387955 None] Created volume successfully. Aug 26 14:41:38 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-f2f070ca-55be-4f8d-9f50-7922e31c8ca5 tempest-SnapshotDependencyTests-260387955 None] Acquiring lock "cinder-b9fc4543-24ce-44b5-b15f-e255754f4b9a-delete_snapshot" by "delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:41:38 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-f2f070ca-55be-4f8d-9f50-7922e31c8ca5 tempest-SnapshotDependencyTests-260387955 None] Lock "cinder-b9fc4543-24ce-44b5-b15f-e255754f4b9a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:41:38 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-f2f070ca-55be-4f8d-9f50-7922e31c8ca5 tempest-SnapshotDependencyTests-260387955 None] Acquiring lock "cinder-quobyte-77c467c3-a87a-4403-a260-cac6645396c9" by "delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:41:39 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-f2f070ca-55be-4f8d-9f50-7922e31c8ca5 tempest-SnapshotDependencyTests-260387955 None] Lock "cinder-quobyte-77c467c3-a87a-4403-a260-cac6645396c9" acquired by "delete_snapshot" :: waited 0.016s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:41:39 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-f2f070ca-55be-4f8d-9f50-7922e31c8ca5 tempest-SnapshotDependencyTests-260387955 None] Acquiring lock "cinder-quobyte-b9fc4543-24ce-44b5-b15f-e255754f4b9a" by "_delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:41:39 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-f2f070ca-55be-4f8d-9f50-7922e31c8ca5 tempest-SnapshotDependencyTests-260387955 None] Lock "cinder-quobyte-b9fc4543-24ce-44b5-b15f-e255754f4b9a" acquired by "_delete_snapshot" :: waited 0.054s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:41:39 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-f2f070ca-55be-4f8d-9f50-7922e31c8ca5 tempest-SnapshotDependencyTests-260387955 None] Deleting offline snapshot b9fc4543-24ce-44b5-b15f-e255754f4b9a of volume 77c467c3-a87a-4403-a260-cac6645396c9 {{(pid=94394) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 14:41:39 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-f2f070ca-55be-4f8d-9f50-7922e31c8ca5 tempest-SnapshotDependencyTests-260387955 None] snapshot_file for this snap is: volume-77c467c3-a87a-4403-a260-cac6645396c9.b9fc4543-24ce-44b5-b15f-e255754f4b9a {{(pid=94394) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 14:41:39 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[91c37125-14ef-4755-8d8d-06f8f66f9f1a]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:41:39 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-f2f070ca-55be-4f8d-9f50-7922e31c8ca5 tempest-SnapshotDependencyTests-260387955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-77c467c3-a87a-4403-a260-cac6645396c9.b9fc4543-24ce-44b5-b15f-e255754f4b9a {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:41:39 devstack sudo[113668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-77c467c3-a87a-4403-a260-cac6645396c9.b9fc4543-24ce-44b5-b15f-e255754f4b9a Aug 26 14:41:39 devstack sudo[113668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:41:39 devstack sudo[113668]: pam_unix(sudo:session): session closed for user root Aug 26 14:41:39 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-f2f070ca-55be-4f8d-9f50-7922e31c8ca5 tempest-SnapshotDependencyTests-260387955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-77c467c3-a87a-4403-a260-cac6645396c9.b9fc4543-24ce-44b5-b15f-e255754f4b9a" returned: 0 in 0.344s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:41:39 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-f2f070ca-55be-4f8d-9f50-7922e31c8ca5 tempest-SnapshotDependencyTests-260387955 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-77c467c3-a87a-4403-a260-cac6645396c9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94394) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 14:41:39 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5f7c967-1bca-4ad1-8511-cfb26eebe644]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:41:39 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-f2f070ca-55be-4f8d-9f50-7922e31c8ca5 tempest-SnapshotDependencyTests-260387955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-77c467c3-a87a-4403-a260-cac6645396c9 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:41:39 devstack sudo[113674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-77c467c3-a87a-4403-a260-cac6645396c9 Aug 26 14:41:39 devstack sudo[113674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:41:39 devstack sudo[113674]: pam_unix(sudo:session): session closed for user root Aug 26 14:41:39 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-f2f070ca-55be-4f8d-9f50-7922e31c8ca5 tempest-SnapshotDependencyTests-260387955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-77c467c3-a87a-4403-a260-cac6645396c9" returned: 0 in 0.522s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:41:39 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-f2f070ca-55be-4f8d-9f50-7922e31c8ca5 tempest-SnapshotDependencyTests-260387955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-77c467c3-a87a-4403-a260-cac6645396c9.b9fc4543-24ce-44b5-b15f-e255754f4b9a {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:41:40 devstack sudo[113679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-77c467c3-a87a-4403-a260-cac6645396c9.b9fc4543-24ce-44b5-b15f-e255754f4b9a Aug 26 14:41:40 devstack sudo[113679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:41:40 devstack sudo[113679]: pam_unix(sudo:session): session closed for user root Aug 26 14:41:40 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-f2f070ca-55be-4f8d-9f50-7922e31c8ca5 tempest-SnapshotDependencyTests-260387955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-77c467c3-a87a-4403-a260-cac6645396c9.b9fc4543-24ce-44b5-b15f-e255754f4b9a" returned: 0 in 0.328s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:41:40 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-f2f070ca-55be-4f8d-9f50-7922e31c8ca5 tempest-SnapshotDependencyTests-260387955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-77c467c3-a87a-4403-a260-cac6645396c9.b9fc4543-24ce-44b5-b15f-e255754f4b9a {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:41:40 devstack sudo[113684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-77c467c3-a87a-4403-a260-cac6645396c9.b9fc4543-24ce-44b5-b15f-e255754f4b9a Aug 26 14:41:40 devstack sudo[113684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:41:40 devstack sudo[113684]: pam_unix(sudo:session): session closed for user root Aug 26 14:41:40 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-f2f070ca-55be-4f8d-9f50-7922e31c8ca5 tempest-SnapshotDependencyTests-260387955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-77c467c3-a87a-4403-a260-cac6645396c9.b9fc4543-24ce-44b5-b15f-e255754f4b9a" returned: 0 in 0.245s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:41:40 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-f2f070ca-55be-4f8d-9f50-7922e31c8ca5 tempest-SnapshotDependencyTests-260387955 None] Lock "cinder-quobyte-b9fc4543-24ce-44b5-b15f-e255754f4b9a" released by "_delete_snapshot" :: held 1.531s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:41:40 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-f2f070ca-55be-4f8d-9f50-7922e31c8ca5 tempest-SnapshotDependencyTests-260387955 None] Lock "cinder-quobyte-77c467c3-a87a-4403-a260-cac6645396c9" released by "delete_snapshot" :: held 1.592s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:41:40 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-f2f070ca-55be-4f8d-9f50-7922e31c8ca5 tempest-SnapshotDependencyTests-260387955 None] Created reservations ['ea405bc3-ecc8-4998-b2ea-6ff2a923cb83', 'b761cdb5-5965-4675-a5a4-b612751078f5', '580a97ae-8ee8-42ae-b864-d1d8514cf407', 'f640bf50-849b-46e7-8558-6ef375673b97'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:41:40 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-f2f070ca-55be-4f8d-9f50-7922e31c8ca5 tempest-SnapshotDependencyTests-260387955 None] Delete snapshot completed successfully. Aug 26 14:41:40 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-f2f070ca-55be-4f8d-9f50-7922e31c8ca5 tempest-SnapshotDependencyTests-260387955 None] Lock "cinder-b9fc4543-24ce-44b5-b15f-e255754f4b9a-delete_snapshot" released by "delete_snapshot" :: held 1.719s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:41:41 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-9b8391e8-b9e7-42cc-a3f5-e9855dc963a0 tempest-SnapshotDependencyTests-260387955 None] Acquiring lock "cinder-77c467c3-a87a-4403-a260-cac6645396c9-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:41:41 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-9b8391e8-b9e7-42cc-a3f5-e9855dc963a0 tempest-SnapshotDependencyTests-260387955 None] Lock "cinder-77c467c3-a87a-4403-a260-cac6645396c9-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:41:41 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-9b8391e8-b9e7-42cc-a3f5-e9855dc963a0 tempest-SnapshotDependencyTests-260387955 None] Acquiring lock "cinder-quobyte-77c467c3-a87a-4403-a260-cac6645396c9" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:41:41 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-9b8391e8-b9e7-42cc-a3f5-e9855dc963a0 tempest-SnapshotDependencyTests-260387955 None] Lock "cinder-quobyte-77c467c3-a87a-4403-a260-cac6645396c9" acquired by "delete_volume" :: waited 0.014s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:41:41 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[78b07777-438a-46f4-91af-8615fabff4c9]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:41:41 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-9b8391e8-b9e7-42cc-a3f5-e9855dc963a0 tempest-SnapshotDependencyTests-260387955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-77c467c3-a87a-4403-a260-cac6645396c9 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:41:41 devstack sudo[113688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-77c467c3-a87a-4403-a260-cac6645396c9 Aug 26 14:41:41 devstack sudo[113688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:41:41 devstack sudo[113688]: pam_unix(sudo:session): session closed for user root Aug 26 14:41:41 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-9b8391e8-b9e7-42cc-a3f5-e9855dc963a0 tempest-SnapshotDependencyTests-260387955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-77c467c3-a87a-4403-a260-cac6645396c9" returned: 0 in 0.354s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:41:41 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-9b8391e8-b9e7-42cc-a3f5-e9855dc963a0 tempest-SnapshotDependencyTests-260387955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-77c467c3-a87a-4403-a260-cac6645396c9 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:41:41 devstack sudo[113693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-77c467c3-a87a-4403-a260-cac6645396c9 Aug 26 14:41:41 devstack sudo[113693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:41:41 devstack sudo[113693]: pam_unix(sudo:session): session closed for user root Aug 26 14:41:41 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-9b8391e8-b9e7-42cc-a3f5-e9855dc963a0 tempest-SnapshotDependencyTests-260387955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-77c467c3-a87a-4403-a260-cac6645396c9" returned: 0 in 0.242s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:41:41 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-9b8391e8-b9e7-42cc-a3f5-e9855dc963a0 tempest-SnapshotDependencyTests-260387955 None] Lock "cinder-quobyte-77c467c3-a87a-4403-a260-cac6645396c9" released by "delete_volume" :: held 0.650s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:41:41 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-9b8391e8-b9e7-42cc-a3f5-e9855dc963a0 tempest-SnapshotDependencyTests-260387955 None] Created reservations ['6abb18ac-b8c0-4302-9701-1815da15b233', '2a1baf13-4c20-4e1c-84c0-749aae20e0c7', 'be6711e1-3bed-4fda-a54d-ed64a16e9fa5', 'c8b5db2c-4292-48fc-8bb1-a9fdc37ec0ed'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:41:41 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-9b8391e8-b9e7-42cc-a3f5-e9855dc963a0 tempest-SnapshotDependencyTests-260387955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:41:41 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-9b8391e8-b9e7-42cc-a3f5-e9855dc963a0 tempest-SnapshotDependencyTests-260387955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:41:41 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-9b8391e8-b9e7-42cc-a3f5-e9855dc963a0 tempest-SnapshotDependencyTests-260387955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:41:41 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-9b8391e8-b9e7-42cc-a3f5-e9855dc963a0 tempest-SnapshotDependencyTests-260387955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:41:41 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-9b8391e8-b9e7-42cc-a3f5-e9855dc963a0 tempest-SnapshotDependencyTests-260387955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:41:41 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-9b8391e8-b9e7-42cc-a3f5-e9855dc963a0 tempest-SnapshotDependencyTests-260387955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:41:41 devstack sudo[113696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:41:41 devstack sudo[113696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:41:42 devstack sudo[113696]: pam_unix(sudo:session): session closed for user root Aug 26 14:41:42 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-9b8391e8-b9e7-42cc-a3f5-e9855dc963a0 tempest-SnapshotDependencyTests-260387955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.237s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:41:42 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-9b8391e8-b9e7-42cc-a3f5-e9855dc963a0 tempest-SnapshotDependencyTests-260387955 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:41:42 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-9b8391e8-b9e7-42cc-a3f5-e9855dc963a0 tempest-SnapshotDependencyTests-260387955 None] Deleted volume successfully. Aug 26 14:41:42 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-9b8391e8-b9e7-42cc-a3f5-e9855dc963a0 tempest-SnapshotDependencyTests-260387955 None] Lock "cinder-77c467c3-a87a-4403-a260-cac6645396c9-delete_volume" released by "delete_volume" :: held 1.073s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:41:42 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-42473080-d221-4e07-bf9d-078918d16bc1 tempest-SnapshotDependencyTests-260387955 None] Acquiring lock "cinder-96b529e0-b039-4e18-bb00-e754df5642fc-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:41:42 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-42473080-d221-4e07-bf9d-078918d16bc1 tempest-SnapshotDependencyTests-260387955 None] Lock "cinder-96b529e0-b039-4e18-bb00-e754df5642fc-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:41:42 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-42473080-d221-4e07-bf9d-078918d16bc1 tempest-SnapshotDependencyTests-260387955 None] Acquiring lock "cinder-quobyte-96b529e0-b039-4e18-bb00-e754df5642fc" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:41:42 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-42473080-d221-4e07-bf9d-078918d16bc1 tempest-SnapshotDependencyTests-260387955 None] Lock "cinder-quobyte-96b529e0-b039-4e18-bb00-e754df5642fc" acquired by "delete_volume" :: waited 0.013s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:41:42 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[f917b8ca-da48-4cf4-9401-c8c8e66169e3]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:41:42 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-42473080-d221-4e07-bf9d-078918d16bc1 tempest-SnapshotDependencyTests-260387955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-96b529e0-b039-4e18-bb00-e754df5642fc {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:41:42 devstack sudo[113699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-96b529e0-b039-4e18-bb00-e754df5642fc Aug 26 14:41:42 devstack sudo[113699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:41:42 devstack sudo[113699]: pam_unix(sudo:session): session closed for user root Aug 26 14:41:42 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-42473080-d221-4e07-bf9d-078918d16bc1 tempest-SnapshotDependencyTests-260387955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-96b529e0-b039-4e18-bb00-e754df5642fc" returned: 0 in 0.348s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:41:42 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-42473080-d221-4e07-bf9d-078918d16bc1 tempest-SnapshotDependencyTests-260387955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-96b529e0-b039-4e18-bb00-e754df5642fc {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:41:42 devstack sudo[113710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-96b529e0-b039-4e18-bb00-e754df5642fc Aug 26 14:41:42 devstack sudo[113710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:41:42 devstack sudo[113710]: pam_unix(sudo:session): session closed for user root Aug 26 14:41:42 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-42473080-d221-4e07-bf9d-078918d16bc1 tempest-SnapshotDependencyTests-260387955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-96b529e0-b039-4e18-bb00-e754df5642fc" returned: 0 in 0.248s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:41:42 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-42473080-d221-4e07-bf9d-078918d16bc1 tempest-SnapshotDependencyTests-260387955 None] Lock "cinder-quobyte-96b529e0-b039-4e18-bb00-e754df5642fc" released by "delete_volume" :: held 0.632s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:41:43 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-42473080-d221-4e07-bf9d-078918d16bc1 tempest-SnapshotDependencyTests-260387955 None] Created reservations ['b1635914-86af-4b57-9609-81fd74a6f580', '6923c791-be84-480a-85dc-19b98df66564', '2b2586e2-3117-4ea0-937f-c5b5f2d40cfa', '86e76bd6-6513-41e9-9a1a-49678dcaaf39'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:41:43 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-42473080-d221-4e07-bf9d-078918d16bc1 tempest-SnapshotDependencyTests-260387955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:41:43 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-42473080-d221-4e07-bf9d-078918d16bc1 tempest-SnapshotDependencyTests-260387955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:41:43 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-42473080-d221-4e07-bf9d-078918d16bc1 tempest-SnapshotDependencyTests-260387955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:41:43 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-42473080-d221-4e07-bf9d-078918d16bc1 tempest-SnapshotDependencyTests-260387955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:41:43 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-42473080-d221-4e07-bf9d-078918d16bc1 tempest-SnapshotDependencyTests-260387955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:41:43 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-42473080-d221-4e07-bf9d-078918d16bc1 tempest-SnapshotDependencyTests-260387955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:41:43 devstack sudo[113713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:41:43 devstack sudo[113713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:41:43 devstack sudo[113713]: pam_unix(sudo:session): session closed for user root Aug 26 14:41:43 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-42473080-d221-4e07-bf9d-078918d16bc1 tempest-SnapshotDependencyTests-260387955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.241s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:41:43 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-42473080-d221-4e07-bf9d-078918d16bc1 tempest-SnapshotDependencyTests-260387955 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:41:43 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-42473080-d221-4e07-bf9d-078918d16bc1 tempest-SnapshotDependencyTests-260387955 None] Deleted volume successfully. Aug 26 14:41:43 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-42473080-d221-4e07-bf9d-078918d16bc1 tempest-SnapshotDependencyTests-260387955 None] Lock "cinder-96b529e0-b039-4e18-bb00-e754df5642fc-delete_volume" released by "delete_volume" :: held 1.067s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:41:53 devstack cinder-volume[94394]: DEBUG dbcounter [-] [94394] Writing DB stats cinder:UPDATE=31,cinder:SELECT=23,cinder:INSERT=9,cinder:DELETE=2 {{(pid=94394) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 14:41:53 devstack cinder-volume[94394]: DEBUG dbcounter [-] [94394] Writing DB stats cinder:SELECT=27,cinder:UPDATE=28,cinder:DELETE=3,cinder:INSERT=6 {{(pid=94394) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 14:42:03 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-12acb4d5-9955-4fb0-86a2-f0dbfe6c890b tempest-CreateVolumesFromImageTest-1405516079 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:42:03 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-12acb4d5-9955-4fb0-86a2-f0dbfe6c890b tempest-CreateVolumesFromImageTest-1405516079 None] Flow 'volume_create_manager' (c38c0a41-9dff-4c00-8e86-e0c4a997aeb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:42:03 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-12acb4d5-9955-4fb0-86a2-f0dbfe6c890b tempest-CreateVolumesFromImageTest-1405516079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ec86252-4001-4f5c-bcdd-b097d18ff18e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:03 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-12acb4d5-9955-4fb0-86a2-f0dbfe6c890b tempest-CreateVolumesFromImageTest-1405516079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ec86252-4001-4f5c-bcdd-b097d18ff18e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:42:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-173225078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3daa48c1-76cf-43ab-8870-e61fd1500853,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84c1d5c2e1b04c79bd7b29049e5b9c9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:42:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:42:03Z,use_quota=True,user_id='7417ff24c0484a9aab88464232ef552e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:03 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-12acb4d5-9955-4fb0-86a2-f0dbfe6c890b tempest-CreateVolumesFromImageTest-1405516079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da95be19-3435-4a97-ba7f-b739a0e695dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:03 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-12acb4d5-9955-4fb0-86a2-f0dbfe6c890b tempest-CreateVolumesFromImageTest-1405516079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da95be19-3435-4a97-ba7f-b739a0e695dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:03 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-12acb4d5-9955-4fb0-86a2-f0dbfe6c890b tempest-CreateVolumesFromImageTest-1405516079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12a788ea-9e8d-4667-8065-a2267e5138e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:03 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-12acb4d5-9955-4fb0-86a2-f0dbfe6c890b tempest-CreateVolumesFromImageTest-1405516079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12a788ea-9e8d-4667-8065-a2267e5138e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3daa48c1-76cf-43ab-8870-e61fd1500853', 'volume_name': 'volume-3daa48c1-76cf-43ab-8870-e61fd1500853', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:03 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-12acb4d5-9955-4fb0-86a2-f0dbfe6c890b tempest-CreateVolumesFromImageTest-1405516079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31926701-bab2-4ca6-a875-763e7bb04b52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:03 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-12acb4d5-9955-4fb0-86a2-f0dbfe6c890b tempest-CreateVolumesFromImageTest-1405516079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31926701-bab2-4ca6-a875-763e7bb04b52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:03 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-12acb4d5-9955-4fb0-86a2-f0dbfe6c890b tempest-CreateVolumesFromImageTest-1405516079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (329479fe-2621-4830-9392-cbbf03121323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:03 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-12acb4d5-9955-4fb0-86a2-f0dbfe6c890b tempest-CreateVolumesFromImageTest-1405516079 None] Volume 3daa48c1-76cf-43ab-8870-e61fd1500853: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3daa48c1-76cf-43ab-8870-e61fd1500853', 'volume_size': 1} Aug 26 14:42:03 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-12acb4d5-9955-4fb0-86a2-f0dbfe6c890b tempest-CreateVolumesFromImageTest-1405516079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:42:03 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-12acb4d5-9955-4fb0-86a2-f0dbfe6c890b tempest-CreateVolumesFromImageTest-1405516079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:42:03 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-12acb4d5-9955-4fb0-86a2-f0dbfe6c890b tempest-CreateVolumesFromImageTest-1405516079 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:42:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-173225078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3daa48c1-76cf-43ab-8870-e61fd1500853,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84c1d5c2e1b04c79bd7b29049e5b9c9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:42:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:42:03Z,use_quota=True,user_id='7417ff24c0484a9aab88464232ef552e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:42:03 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-12acb4d5-9955-4fb0-86a2-f0dbfe6c890b tempest-CreateVolumesFromImageTest-1405516079 None] Creating volume 3daa48c1-76cf-43ab-8870-e61fd1500853 {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:42:03 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-12acb4d5-9955-4fb0-86a2-f0dbfe6c890b tempest-CreateVolumesFromImageTest-1405516079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:42:03 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-12acb4d5-9955-4fb0-86a2-f0dbfe6c890b tempest-CreateVolumesFromImageTest-1405516079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:42:03 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-12acb4d5-9955-4fb0-86a2-f0dbfe6c890b tempest-CreateVolumesFromImageTest-1405516079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:42:03 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-12acb4d5-9955-4fb0-86a2-f0dbfe6c890b tempest-CreateVolumesFromImageTest-1405516079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:42:03 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-12acb4d5-9955-4fb0-86a2-f0dbfe6c890b tempest-CreateVolumesFromImageTest-1405516079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:42:03 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-12acb4d5-9955-4fb0-86a2-f0dbfe6c890b tempest-CreateVolumesFromImageTest-1405516079 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:42:03 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-12acb4d5-9955-4fb0-86a2-f0dbfe6c890b tempest-CreateVolumesFromImageTest-1405516079 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:42:03 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-12acb4d5-9955-4fb0-86a2-f0dbfe6c890b tempest-CreateVolumesFromImageTest-1405516079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3daa48c1-76cf-43ab-8870-e61fd1500853 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:03 devstack sudo[113762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3daa48c1-76cf-43ab-8870-e61fd1500853 1073741824 Aug 26 14:42:03 devstack sudo[113762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:03 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-1311d10a-250d-4013-8844-a930474368c7 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:42:03 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-1311d10a-250d-4013-8844-a930474368c7 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Flow 'volume_create_manager' (ac47ef8e-ac24-4540-afaf-69575da3d050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:42:03 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-1311d10a-250d-4013-8844-a930474368c7 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d63131fa-a571-4689-9b0a-18565cc20dd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:03 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-54561572-5802-4eb3-b2b9-7d31afb1c381 tempest-CreateVolumesFromImageTest-1405516079 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:42:03 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-54561572-5802-4eb3-b2b9-7d31afb1c381 tempest-CreateVolumesFromImageTest-1405516079 None] Flow 'volume_create_manager' (7ad100c7-86ef-4f67-a589-f5bfc021d022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:42:03 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-54561572-5802-4eb3-b2b9-7d31afb1c381 tempest-CreateVolumesFromImageTest-1405516079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da193ef3-159f-4a3d-8fdf-e906335570cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:03 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-1311d10a-250d-4013-8844-a930474368c7 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d63131fa-a571-4689-9b0a-18565cc20dd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:42:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-316825066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=555f8b55-e1d3-47eb-9a2b-64d108f0b06a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e20f015f2e54f39a25d8e4fb8bffa56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:42:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:42:03Z,use_quota=True,user_id='3b4abd77b9b346faa86977c51283196d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:03 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-1311d10a-250d-4013-8844-a930474368c7 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b11d6e3f-2d7e-4507-9aa7-d2bb867ae05a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:03 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-1311d10a-250d-4013-8844-a930474368c7 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b11d6e3f-2d7e-4507-9aa7-d2bb867ae05a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:03 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-1311d10a-250d-4013-8844-a930474368c7 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2089461-b8ba-4764-b06a-6b3b5bef63ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:03 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-1311d10a-250d-4013-8844-a930474368c7 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2089461-b8ba-4764-b06a-6b3b5bef63ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '555f8b55-e1d3-47eb-9a2b-64d108f0b06a', 'volume_name': 'volume-555f8b55-e1d3-47eb-9a2b-64d108f0b06a', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:03 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-1311d10a-250d-4013-8844-a930474368c7 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e19c366f-8659-48da-a02b-70e307fdfe01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:03 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-1311d10a-250d-4013-8844-a930474368c7 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e19c366f-8659-48da-a02b-70e307fdfe01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:03 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-1311d10a-250d-4013-8844-a930474368c7 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8d747eb-5821-4259-8aa5-089cc67279b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:03 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-1311d10a-250d-4013-8844-a930474368c7 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Volume 555f8b55-e1d3-47eb-9a2b-64d108f0b06a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-555f8b55-e1d3-47eb-9a2b-64d108f0b06a', 'volume_size': 1} Aug 26 14:42:03 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-1311d10a-250d-4013-8844-a930474368c7 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:42:03 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-54561572-5802-4eb3-b2b9-7d31afb1c381 tempest-CreateVolumesFromImageTest-1405516079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da193ef3-159f-4a3d-8fdf-e906335570cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:42:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1640407979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a1948b7-da6a-488a-8405-e08629bb613e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84c1d5c2e1b04c79bd7b29049e5b9c9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:42:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:42:04Z,use_quota=True,user_id='7417ff24c0484a9aab88464232ef552e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:03 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-54561572-5802-4eb3-b2b9-7d31afb1c381 tempest-CreateVolumesFromImageTest-1405516079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8568651-78f5-4b7e-af7b-1422f9858cde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:03 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-54561572-5802-4eb3-b2b9-7d31afb1c381 tempest-CreateVolumesFromImageTest-1405516079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8568651-78f5-4b7e-af7b-1422f9858cde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:03 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-54561572-5802-4eb3-b2b9-7d31afb1c381 tempest-CreateVolumesFromImageTest-1405516079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05f06e66-b529-41e7-b1da-c0d96eca2e18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:03 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-54561572-5802-4eb3-b2b9-7d31afb1c381 tempest-CreateVolumesFromImageTest-1405516079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05f06e66-b529-41e7-b1da-c0d96eca2e18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a1948b7-da6a-488a-8405-e08629bb613e', 'volume_name': 'volume-0a1948b7-da6a-488a-8405-e08629bb613e', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:03 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-54561572-5802-4eb3-b2b9-7d31afb1c381 tempest-CreateVolumesFromImageTest-1405516079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba584c58-c174-410c-bdc3-12a79eff517a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:03 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-54561572-5802-4eb3-b2b9-7d31afb1c381 tempest-CreateVolumesFromImageTest-1405516079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba584c58-c174-410c-bdc3-12a79eff517a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:03 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-54561572-5802-4eb3-b2b9-7d31afb1c381 tempest-CreateVolumesFromImageTest-1405516079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc8ae8f7-6490-485f-905a-71b3ae513619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:03 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-54561572-5802-4eb3-b2b9-7d31afb1c381 tempest-CreateVolumesFromImageTest-1405516079 None] Volume 0a1948b7-da6a-488a-8405-e08629bb613e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a1948b7-da6a-488a-8405-e08629bb613e', 'volume_size': 1} Aug 26 14:42:03 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-54561572-5802-4eb3-b2b9-7d31afb1c381 tempest-CreateVolumesFromImageTest-1405516079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:42:03 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-09f1532c-efce-4d62-9fee-4d874d5d5b29 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:42:03 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-09f1532c-efce-4d62-9fee-4d874d5d5b29 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Flow 'volume_create_manager' (4310f0ff-4f86-4de2-822c-bad377f97389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:42:04 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-09f1532c-efce-4d62-9fee-4d874d5d5b29 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0fa3096-5c38-4228-a008-b943e262dff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:04 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-09f1532c-efce-4d62-9fee-4d874d5d5b29 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0fa3096-5c38-4228-a008-b943e262dff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:42:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-862286122',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=839c1e2a-1e7a-4ad6-a829-7624ecbe0348,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec8f26288b124661a14ab7719680c9d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:42:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:42:04Z,use_quota=True,user_id='aeeb1907462d4a7c9669bb590fc4a260',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:04 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-09f1532c-efce-4d62-9fee-4d874d5d5b29 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (182d70c4-c15c-4195-8b91-736a74e0dbbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:04 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-09f1532c-efce-4d62-9fee-4d874d5d5b29 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (182d70c4-c15c-4195-8b91-736a74e0dbbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:04 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-09f1532c-efce-4d62-9fee-4d874d5d5b29 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1f44da9-7160-49ba-9738-c5df04b3407b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:04 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-09f1532c-efce-4d62-9fee-4d874d5d5b29 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1f44da9-7160-49ba-9738-c5df04b3407b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '839c1e2a-1e7a-4ad6-a829-7624ecbe0348', 'volume_name': 'volume-839c1e2a-1e7a-4ad6-a829-7624ecbe0348', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:04 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-09f1532c-efce-4d62-9fee-4d874d5d5b29 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c46d2d15-15f3-43ec-8bff-42f09370dc3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:04 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-09f1532c-efce-4d62-9fee-4d874d5d5b29 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c46d2d15-15f3-43ec-8bff-42f09370dc3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:04 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-09f1532c-efce-4d62-9fee-4d874d5d5b29 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0c1276e-01c0-4429-bab5-2e3a688dcf20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:04 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-09f1532c-efce-4d62-9fee-4d874d5d5b29 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Volume 839c1e2a-1e7a-4ad6-a829-7624ecbe0348: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-839c1e2a-1e7a-4ad6-a829-7624ecbe0348', 'volume_size': 1} Aug 26 14:42:04 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-09f1532c-efce-4d62-9fee-4d874d5d5b29 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:42:04 devstack sudo[113762]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:04 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-12acb4d5-9955-4fb0-86a2-f0dbfe6c890b tempest-CreateVolumesFromImageTest-1405516079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3daa48c1-76cf-43ab-8870-e61fd1500853 1073741824" returned: 0 in 0.638s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:04 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-12acb4d5-9955-4fb0-86a2-f0dbfe6c890b tempest-CreateVolumesFromImageTest-1405516079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3daa48c1-76cf-43ab-8870-e61fd1500853 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:04 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-90f1f673-4bc6-4db0-a099-e284b2ba2631 tempest-CreateVolumesFromImageTest-1405516079 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:42:04 devstack sudo[113769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3daa48c1-76cf-43ab-8870-e61fd1500853 Aug 26 14:42:04 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-90f1f673-4bc6-4db0-a099-e284b2ba2631 tempest-CreateVolumesFromImageTest-1405516079 None] Flow 'volume_create_manager' (6e4bd27e-b188-4b18-9c10-8bc919932b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:42:04 devstack sudo[113769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:04 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-90f1f673-4bc6-4db0-a099-e284b2ba2631 tempest-CreateVolumesFromImageTest-1405516079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59456e49-9159-4a87-95d8-1cd34d799d7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:04 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-90f1f673-4bc6-4db0-a099-e284b2ba2631 tempest-CreateVolumesFromImageTest-1405516079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59456e49-9159-4a87-95d8-1cd34d799d7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:42:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-934190891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69002b7c-381c-4181-a82b-ba244e4543ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84c1d5c2e1b04c79bd7b29049e5b9c9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:42:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:42:04Z,use_quota=True,user_id='7417ff24c0484a9aab88464232ef552e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:04 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-90f1f673-4bc6-4db0-a099-e284b2ba2631 tempest-CreateVolumesFromImageTest-1405516079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a18f62bb-1e8b-4733-b86f-87ab10577987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:04 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-90f1f673-4bc6-4db0-a099-e284b2ba2631 tempest-CreateVolumesFromImageTest-1405516079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a18f62bb-1e8b-4733-b86f-87ab10577987) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:04 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-90f1f673-4bc6-4db0-a099-e284b2ba2631 tempest-CreateVolumesFromImageTest-1405516079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c32a178-f2ef-4108-af98-120edb62945f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:04 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-90f1f673-4bc6-4db0-a099-e284b2ba2631 tempest-CreateVolumesFromImageTest-1405516079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c32a178-f2ef-4108-af98-120edb62945f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69002b7c-381c-4181-a82b-ba244e4543ee', 'volume_name': 'volume-69002b7c-381c-4181-a82b-ba244e4543ee', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:04 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-90f1f673-4bc6-4db0-a099-e284b2ba2631 tempest-CreateVolumesFromImageTest-1405516079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22835aac-e3e1-469c-aac3-bbe1748beb07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:04 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-90f1f673-4bc6-4db0-a099-e284b2ba2631 tempest-CreateVolumesFromImageTest-1405516079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22835aac-e3e1-469c-aac3-bbe1748beb07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:04 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-90f1f673-4bc6-4db0-a099-e284b2ba2631 tempest-CreateVolumesFromImageTest-1405516079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b76c7335-164b-4189-8b68-090c1d622415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:04 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-90f1f673-4bc6-4db0-a099-e284b2ba2631 tempest-CreateVolumesFromImageTest-1405516079 None] Volume 69002b7c-381c-4181-a82b-ba244e4543ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69002b7c-381c-4181-a82b-ba244e4543ee', 'volume_size': 1} Aug 26 14:42:04 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-90f1f673-4bc6-4db0-a099-e284b2ba2631 tempest-CreateVolumesFromImageTest-1405516079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:42:04 devstack sudo[113769]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:04 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-12acb4d5-9955-4fb0-86a2-f0dbfe6c890b tempest-CreateVolumesFromImageTest-1405516079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3daa48c1-76cf-43ab-8870-e61fd1500853" returned: 0 in 0.347s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:04 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-12acb4d5-9955-4fb0-86a2-f0dbfe6c890b tempest-CreateVolumesFromImageTest-1405516079 None] <== create_volume: return (1073ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:42:04 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-12acb4d5-9955-4fb0-86a2-f0dbfe6c890b tempest-CreateVolumesFromImageTest-1405516079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.080s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:42:04 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-1311d10a-250d-4013-8844-a930474368c7 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.795s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:42:04 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-1311d10a-250d-4013-8844-a930474368c7 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:42:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-316825066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=555f8b55-e1d3-47eb-9a2b-64d108f0b06a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e20f015f2e54f39a25d8e4fb8bffa56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:42:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:42:03Z,use_quota=True,user_id='3b4abd77b9b346faa86977c51283196d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:42:04 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-1311d10a-250d-4013-8844-a930474368c7 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Creating volume 555f8b55-e1d3-47eb-9a2b-64d108f0b06a {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:42:04 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-1311d10a-250d-4013-8844-a930474368c7 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:42:04 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-1311d10a-250d-4013-8844-a930474368c7 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:42:04 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-1311d10a-250d-4013-8844-a930474368c7 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:42:04 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-1311d10a-250d-4013-8844-a930474368c7 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:42:04 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-1311d10a-250d-4013-8844-a930474368c7 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:42:04 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-1311d10a-250d-4013-8844-a930474368c7 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:42:04 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-1311d10a-250d-4013-8844-a930474368c7 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:42:04 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-1311d10a-250d-4013-8844-a930474368c7 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-555f8b55-e1d3-47eb-9a2b-64d108f0b06a 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:04 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-12acb4d5-9955-4fb0-86a2-f0dbfe6c890b tempest-CreateVolumesFromImageTest-1405516079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (329479fe-2621-4830-9392-cbbf03121323) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3daa48c1-76cf-43ab-8870-e61fd1500853', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:04 devstack sudo[113772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-555f8b55-e1d3-47eb-9a2b-64d108f0b06a 1073741824 Aug 26 14:42:04 devstack sudo[113772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:04 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-12acb4d5-9955-4fb0-86a2-f0dbfe6c890b tempest-CreateVolumesFromImageTest-1405516079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3e29368-3468-4510-ba6a-8d5c51dcf44a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:04 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-12acb4d5-9955-4fb0-86a2-f0dbfe6c890b tempest-CreateVolumesFromImageTest-1405516079 None] Volume volume-3daa48c1-76cf-43ab-8870-e61fd1500853 (3daa48c1-76cf-43ab-8870-e61fd1500853): created successfully Aug 26 14:42:04 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-12acb4d5-9955-4fb0-86a2-f0dbfe6c890b tempest-CreateVolumesFromImageTest-1405516079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3e29368-3468-4510-ba6a-8d5c51dcf44a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:04 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-12acb4d5-9955-4fb0-86a2-f0dbfe6c890b tempest-CreateVolumesFromImageTest-1405516079 None] Flow 'volume_create_manager' (c38c0a41-9dff-4c00-8e86-e0c4a997aeb0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:42:04 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-12acb4d5-9955-4fb0-86a2-f0dbfe6c890b tempest-CreateVolumesFromImageTest-1405516079 None] Created volume successfully. Aug 26 14:42:04 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0c974ec-8e52-4769-8fe7-b85fae4ebb1b tempest-CreateVolumesFromImageTest-1405516079 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:42:04 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-d0c974ec-8e52-4769-8fe7-b85fae4ebb1b tempest-CreateVolumesFromImageTest-1405516079 None] Flow 'volume_create_manager' (fe19a3ae-9354-4abb-9b95-dc62203dc1d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:42:04 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-d0c974ec-8e52-4769-8fe7-b85fae4ebb1b tempest-CreateVolumesFromImageTest-1405516079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f70d5a00-930a-4c6c-b87c-5df367d5b5ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:04 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-d0c974ec-8e52-4769-8fe7-b85fae4ebb1b tempest-CreateVolumesFromImageTest-1405516079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f70d5a00-930a-4c6c-b87c-5df367d5b5ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:42:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-947309944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8064a98c-8f08-4590-ac1b-944fe429895d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84c1d5c2e1b04c79bd7b29049e5b9c9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:42:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:42:05Z,use_quota=True,user_id='7417ff24c0484a9aab88464232ef552e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:04 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-d0c974ec-8e52-4769-8fe7-b85fae4ebb1b tempest-CreateVolumesFromImageTest-1405516079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (235593fc-cd29-4a7f-bd03-a71a9f0bad4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:04 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-d0c974ec-8e52-4769-8fe7-b85fae4ebb1b tempest-CreateVolumesFromImageTest-1405516079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (235593fc-cd29-4a7f-bd03-a71a9f0bad4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:04 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-d0c974ec-8e52-4769-8fe7-b85fae4ebb1b tempest-CreateVolumesFromImageTest-1405516079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b688a0ed-a4f3-49fc-969e-bc10a885ae18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:04 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-d0c974ec-8e52-4769-8fe7-b85fae4ebb1b tempest-CreateVolumesFromImageTest-1405516079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b688a0ed-a4f3-49fc-969e-bc10a885ae18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8064a98c-8f08-4590-ac1b-944fe429895d', 'volume_name': 'volume-8064a98c-8f08-4590-ac1b-944fe429895d', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:04 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-d0c974ec-8e52-4769-8fe7-b85fae4ebb1b tempest-CreateVolumesFromImageTest-1405516079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10c94425-e777-4862-b101-584e41dcb401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:05 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-d0c974ec-8e52-4769-8fe7-b85fae4ebb1b tempest-CreateVolumesFromImageTest-1405516079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10c94425-e777-4862-b101-584e41dcb401) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:05 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-d0c974ec-8e52-4769-8fe7-b85fae4ebb1b tempest-CreateVolumesFromImageTest-1405516079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bb98e81-df5a-4a5d-a27a-172e9912fa0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:05 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-d0c974ec-8e52-4769-8fe7-b85fae4ebb1b tempest-CreateVolumesFromImageTest-1405516079 None] Volume 8064a98c-8f08-4590-ac1b-944fe429895d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8064a98c-8f08-4590-ac1b-944fe429895d', 'volume_size': 1} Aug 26 14:42:05 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-d0c974ec-8e52-4769-8fe7-b85fae4ebb1b tempest-CreateVolumesFromImageTest-1405516079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:42:05 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f7f79d7-e4cb-46dc-bf51-1d755fd26ee7 tempest-CreateVolumesFromImageTest-1405516079 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:42:05 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-6f7f79d7-e4cb-46dc-bf51-1d755fd26ee7 tempest-CreateVolumesFromImageTest-1405516079 None] Flow 'volume_create_manager' (14bd0bbf-6d6f-4b19-a855-10ebc2581647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:42:05 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-6f7f79d7-e4cb-46dc-bf51-1d755fd26ee7 tempest-CreateVolumesFromImageTest-1405516079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cdded74-af54-4a5f-b96d-04e9a39b8e1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:05 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-6f7f79d7-e4cb-46dc-bf51-1d755fd26ee7 tempest-CreateVolumesFromImageTest-1405516079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cdded74-af54-4a5f-b96d-04e9a39b8e1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:42:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-779568876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21ec32a7-9362-498c-9322-c94f9f2c566f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84c1d5c2e1b04c79bd7b29049e5b9c9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:42:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:42:05Z,use_quota=True,user_id='7417ff24c0484a9aab88464232ef552e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:05 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-6f7f79d7-e4cb-46dc-bf51-1d755fd26ee7 tempest-CreateVolumesFromImageTest-1405516079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c078bec-8956-4671-badd-0d00a5b08a31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:05 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-6f7f79d7-e4cb-46dc-bf51-1d755fd26ee7 tempest-CreateVolumesFromImageTest-1405516079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c078bec-8956-4671-badd-0d00a5b08a31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:05 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-6f7f79d7-e4cb-46dc-bf51-1d755fd26ee7 tempest-CreateVolumesFromImageTest-1405516079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (446a5377-a71e-4cfd-91c0-adf78a56c816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:05 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-6f7f79d7-e4cb-46dc-bf51-1d755fd26ee7 tempest-CreateVolumesFromImageTest-1405516079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (446a5377-a71e-4cfd-91c0-adf78a56c816) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21ec32a7-9362-498c-9322-c94f9f2c566f', 'volume_name': 'volume-21ec32a7-9362-498c-9322-c94f9f2c566f', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:05 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-6f7f79d7-e4cb-46dc-bf51-1d755fd26ee7 tempest-CreateVolumesFromImageTest-1405516079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ad8aa76-611a-43b1-826f-275bb2850d8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:05 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-6f7f79d7-e4cb-46dc-bf51-1d755fd26ee7 tempest-CreateVolumesFromImageTest-1405516079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ad8aa76-611a-43b1-826f-275bb2850d8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:05 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-6f7f79d7-e4cb-46dc-bf51-1d755fd26ee7 tempest-CreateVolumesFromImageTest-1405516079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (196d894a-921f-42c9-a55e-f454b8d98abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:05 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-6f7f79d7-e4cb-46dc-bf51-1d755fd26ee7 tempest-CreateVolumesFromImageTest-1405516079 None] Volume 21ec32a7-9362-498c-9322-c94f9f2c566f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21ec32a7-9362-498c-9322-c94f9f2c566f', 'volume_size': 1} Aug 26 14:42:05 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-6f7f79d7-e4cb-46dc-bf51-1d755fd26ee7 tempest-CreateVolumesFromImageTest-1405516079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:42:05 devstack sudo[113772]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:05 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-1311d10a-250d-4013-8844-a930474368c7 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-555f8b55-e1d3-47eb-9a2b-64d108f0b06a 1073741824" returned: 0 in 0.640s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:05 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-1311d10a-250d-4013-8844-a930474368c7 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-555f8b55-e1d3-47eb-9a2b-64d108f0b06a {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:05 devstack sudo[113777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-555f8b55-e1d3-47eb-9a2b-64d108f0b06a Aug 26 14:42:05 devstack sudo[113777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:05 devstack sudo[113777]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:05 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-1311d10a-250d-4013-8844-a930474368c7 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-555f8b55-e1d3-47eb-9a2b-64d108f0b06a" returned: 0 in 0.246s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:05 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-1311d10a-250d-4013-8844-a930474368c7 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] <== create_volume: return (923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:42:05 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-1311d10a-250d-4013-8844-a930474368c7 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.926s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:42:05 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-54561572-5802-4eb3-b2b9-7d31afb1c381 tempest-CreateVolumesFromImageTest-1405516079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.659s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:42:05 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-54561572-5802-4eb3-b2b9-7d31afb1c381 tempest-CreateVolumesFromImageTest-1405516079 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:42:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1640407979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a1948b7-da6a-488a-8405-e08629bb613e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84c1d5c2e1b04c79bd7b29049e5b9c9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:42:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:42:04Z,use_quota=True,user_id='7417ff24c0484a9aab88464232ef552e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:42:05 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-54561572-5802-4eb3-b2b9-7d31afb1c381 tempest-CreateVolumesFromImageTest-1405516079 None] Creating volume 0a1948b7-da6a-488a-8405-e08629bb613e {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:42:05 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-54561572-5802-4eb3-b2b9-7d31afb1c381 tempest-CreateVolumesFromImageTest-1405516079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:42:05 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-54561572-5802-4eb3-b2b9-7d31afb1c381 tempest-CreateVolumesFromImageTest-1405516079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:42:05 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-54561572-5802-4eb3-b2b9-7d31afb1c381 tempest-CreateVolumesFromImageTest-1405516079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:42:05 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-54561572-5802-4eb3-b2b9-7d31afb1c381 tempest-CreateVolumesFromImageTest-1405516079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:42:05 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-54561572-5802-4eb3-b2b9-7d31afb1c381 tempest-CreateVolumesFromImageTest-1405516079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:42:05 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-54561572-5802-4eb3-b2b9-7d31afb1c381 tempest-CreateVolumesFromImageTest-1405516079 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:42:05 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-54561572-5802-4eb3-b2b9-7d31afb1c381 tempest-CreateVolumesFromImageTest-1405516079 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:42:05 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-54561572-5802-4eb3-b2b9-7d31afb1c381 tempest-CreateVolumesFromImageTest-1405516079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0a1948b7-da6a-488a-8405-e08629bb613e 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:05 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-1311d10a-250d-4013-8844-a930474368c7 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8d747eb-5821-4259-8aa5-089cc67279b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-555f8b55-e1d3-47eb-9a2b-64d108f0b06a', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:05 devstack sudo[113780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0a1948b7-da6a-488a-8405-e08629bb613e 1073741824 Aug 26 14:42:05 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-1311d10a-250d-4013-8844-a930474368c7 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c03418a-a0b0-443b-b2c8-ddde1d39275a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:05 devstack sudo[113780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:05 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-1311d10a-250d-4013-8844-a930474368c7 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Volume volume-555f8b55-e1d3-47eb-9a2b-64d108f0b06a (555f8b55-e1d3-47eb-9a2b-64d108f0b06a): created successfully Aug 26 14:42:05 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-1311d10a-250d-4013-8844-a930474368c7 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c03418a-a0b0-443b-b2c8-ddde1d39275a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:05 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-1311d10a-250d-4013-8844-a930474368c7 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Flow 'volume_create_manager' (ac47ef8e-ac24-4540-afaf-69575da3d050) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:42:05 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-1311d10a-250d-4013-8844-a930474368c7 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Created volume successfully. Aug 26 14:42:06 devstack sudo[113780]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:06 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-54561572-5802-4eb3-b2b9-7d31afb1c381 tempest-CreateVolumesFromImageTest-1405516079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0a1948b7-da6a-488a-8405-e08629bb613e 1073741824" returned: 0 in 0.479s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:06 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-54561572-5802-4eb3-b2b9-7d31afb1c381 tempest-CreateVolumesFromImageTest-1405516079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0a1948b7-da6a-488a-8405-e08629bb613e {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:06 devstack sudo[113786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0a1948b7-da6a-488a-8405-e08629bb613e Aug 26 14:42:06 devstack sudo[113786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:06 devstack sudo[113786]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:06 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-54561572-5802-4eb3-b2b9-7d31afb1c381 tempest-CreateVolumesFromImageTest-1405516079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0a1948b7-da6a-488a-8405-e08629bb613e" returned: 0 in 0.269s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:06 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-54561572-5802-4eb3-b2b9-7d31afb1c381 tempest-CreateVolumesFromImageTest-1405516079 None] <== create_volume: return (792ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:42:06 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-54561572-5802-4eb3-b2b9-7d31afb1c381 tempest-CreateVolumesFromImageTest-1405516079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.797s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:42:06 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-09f1532c-efce-4d62-9fee-4d874d5d5b29 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.344s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:42:06 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-09f1532c-efce-4d62-9fee-4d874d5d5b29 tempest-CreateVolumesFromSnapshotTest-1806966364 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:42:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-862286122',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=839c1e2a-1e7a-4ad6-a829-7624ecbe0348,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec8f26288b124661a14ab7719680c9d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:42:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:42:04Z,use_quota=True,user_id='aeeb1907462d4a7c9669bb590fc4a260',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:42:06 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-09f1532c-efce-4d62-9fee-4d874d5d5b29 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Creating volume 839c1e2a-1e7a-4ad6-a829-7624ecbe0348 {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:42:06 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-09f1532c-efce-4d62-9fee-4d874d5d5b29 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:42:06 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-09f1532c-efce-4d62-9fee-4d874d5d5b29 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:42:06 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-09f1532c-efce-4d62-9fee-4d874d5d5b29 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:42:06 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-09f1532c-efce-4d62-9fee-4d874d5d5b29 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:42:06 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-09f1532c-efce-4d62-9fee-4d874d5d5b29 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:42:06 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-09f1532c-efce-4d62-9fee-4d874d5d5b29 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:42:06 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-09f1532c-efce-4d62-9fee-4d874d5d5b29 tempest-CreateVolumesFromSnapshotTest-1806966364 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:42:06 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-09f1532c-efce-4d62-9fee-4d874d5d5b29 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-839c1e2a-1e7a-4ad6-a829-7624ecbe0348 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:06 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-54561572-5802-4eb3-b2b9-7d31afb1c381 tempest-CreateVolumesFromImageTest-1405516079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc8ae8f7-6490-485f-905a-71b3ae513619) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a1948b7-da6a-488a-8405-e08629bb613e', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:06 devstack sudo[113789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-839c1e2a-1e7a-4ad6-a829-7624ecbe0348 1073741824 Aug 26 14:42:06 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-54561572-5802-4eb3-b2b9-7d31afb1c381 tempest-CreateVolumesFromImageTest-1405516079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4693c3b8-546e-454f-a8cf-2e51c56b553e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:06 devstack sudo[113789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:06 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-54561572-5802-4eb3-b2b9-7d31afb1c381 tempest-CreateVolumesFromImageTest-1405516079 None] Volume volume-0a1948b7-da6a-488a-8405-e08629bb613e (0a1948b7-da6a-488a-8405-e08629bb613e): created successfully Aug 26 14:42:06 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-54561572-5802-4eb3-b2b9-7d31afb1c381 tempest-CreateVolumesFromImageTest-1405516079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4693c3b8-546e-454f-a8cf-2e51c56b553e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:06 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-54561572-5802-4eb3-b2b9-7d31afb1c381 tempest-CreateVolumesFromImageTest-1405516079 None] Flow 'volume_create_manager' (7ad100c7-86ef-4f67-a589-f5bfc021d022) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:42:06 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-54561572-5802-4eb3-b2b9-7d31afb1c381 tempest-CreateVolumesFromImageTest-1405516079 None] Created volume successfully. Aug 26 14:42:06 devstack sudo[113789]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:06 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-09f1532c-efce-4d62-9fee-4d874d5d5b29 tempest-CreateVolumesFromSnapshotTest-1806966364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-839c1e2a-1e7a-4ad6-a829-7624ecbe0348 1073741824" returned: 0 in 0.466s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:06 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-09f1532c-efce-4d62-9fee-4d874d5d5b29 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-839c1e2a-1e7a-4ad6-a829-7624ecbe0348 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:06 devstack sudo[113795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-839c1e2a-1e7a-4ad6-a829-7624ecbe0348 Aug 26 14:42:06 devstack sudo[113795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:07 devstack sudo[113795]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:07 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-09f1532c-efce-4d62-9fee-4d874d5d5b29 tempest-CreateVolumesFromSnapshotTest-1806966364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-839c1e2a-1e7a-4ad6-a829-7624ecbe0348" returned: 0 in 0.355s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:07 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-09f1532c-efce-4d62-9fee-4d874d5d5b29 tempest-CreateVolumesFromSnapshotTest-1806966364 None] <== create_volume: return (870ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:42:07 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-09f1532c-efce-4d62-9fee-4d874d5d5b29 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:42:07 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-90f1f673-4bc6-4db0-a099-e284b2ba2631 tempest-CreateVolumesFromImageTest-1405516079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.845s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:42:07 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-90f1f673-4bc6-4db0-a099-e284b2ba2631 tempest-CreateVolumesFromImageTest-1405516079 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:42:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-934190891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69002b7c-381c-4181-a82b-ba244e4543ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84c1d5c2e1b04c79bd7b29049e5b9c9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:42:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:42:04Z,use_quota=True,user_id='7417ff24c0484a9aab88464232ef552e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:42:07 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-90f1f673-4bc6-4db0-a099-e284b2ba2631 tempest-CreateVolumesFromImageTest-1405516079 None] Creating volume 69002b7c-381c-4181-a82b-ba244e4543ee {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:42:07 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-90f1f673-4bc6-4db0-a099-e284b2ba2631 tempest-CreateVolumesFromImageTest-1405516079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:42:07 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-90f1f673-4bc6-4db0-a099-e284b2ba2631 tempest-CreateVolumesFromImageTest-1405516079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:42:07 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-90f1f673-4bc6-4db0-a099-e284b2ba2631 tempest-CreateVolumesFromImageTest-1405516079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:42:07 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-90f1f673-4bc6-4db0-a099-e284b2ba2631 tempest-CreateVolumesFromImageTest-1405516079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:42:07 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-90f1f673-4bc6-4db0-a099-e284b2ba2631 tempest-CreateVolumesFromImageTest-1405516079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:42:07 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-90f1f673-4bc6-4db0-a099-e284b2ba2631 tempest-CreateVolumesFromImageTest-1405516079 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:42:07 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-90f1f673-4bc6-4db0-a099-e284b2ba2631 tempest-CreateVolumesFromImageTest-1405516079 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:42:07 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-90f1f673-4bc6-4db0-a099-e284b2ba2631 tempest-CreateVolumesFromImageTest-1405516079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-69002b7c-381c-4181-a82b-ba244e4543ee 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:07 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-09f1532c-efce-4d62-9fee-4d874d5d5b29 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0c1276e-01c0-4429-bab5-2e3a688dcf20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-839c1e2a-1e7a-4ad6-a829-7624ecbe0348', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:07 devstack sudo[113798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-69002b7c-381c-4181-a82b-ba244e4543ee 1073741824 Aug 26 14:42:07 devstack sudo[113798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:07 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-09f1532c-efce-4d62-9fee-4d874d5d5b29 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e2b0bb9-074e-49ab-a73c-97042d88601c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:07 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-09f1532c-efce-4d62-9fee-4d874d5d5b29 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Volume volume-839c1e2a-1e7a-4ad6-a829-7624ecbe0348 (839c1e2a-1e7a-4ad6-a829-7624ecbe0348): created successfully Aug 26 14:42:07 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-09f1532c-efce-4d62-9fee-4d874d5d5b29 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e2b0bb9-074e-49ab-a73c-97042d88601c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:07 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-09f1532c-efce-4d62-9fee-4d874d5d5b29 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Flow 'volume_create_manager' (4310f0ff-4f86-4de2-822c-bad377f97389) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:42:07 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-09f1532c-efce-4d62-9fee-4d874d5d5b29 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Created volume successfully. Aug 26 14:42:07 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-625b80d1-d31a-421e-a3ff-42a1df8f3a6b tempest-VolumeAndVolumeTypeFromImageTest-876346826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:42:07 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-625b80d1-d31a-421e-a3ff-42a1df8f3a6b tempest-VolumeAndVolumeTypeFromImageTest-876346826 None] Flow 'volume_create_manager' (eb4e2d18-0ae0-43c1-8769-7bdafc2cf467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:42:07 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-625b80d1-d31a-421e-a3ff-42a1df8f3a6b tempest-VolumeAndVolumeTypeFromImageTest-876346826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7a46562-6d43-4411-b6d8-7d2fbc810a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:07 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-625b80d1-d31a-421e-a3ff-42a1df8f3a6b tempest-VolumeAndVolumeTypeFromImageTest-876346826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7a46562-6d43-4411-b6d8-7d2fbc810a53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:42:07Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02ec04f8-e1b7-4264-aa85-d20e56bc0582,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb7400886bc54470aefdeae7e5c6085a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:42:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:42:07Z,use_quota=True,user_id='07494e6890fc4c879dcad06f2f657168',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e8adf1e-ecb7-49d2-98da-5956312451cd),volume_type_id=1e8adf1e-ecb7-49d2-98da-5956312451cd)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:07 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-625b80d1-d31a-421e-a3ff-42a1df8f3a6b tempest-VolumeAndVolumeTypeFromImageTest-876346826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4654846f-96c6-4c4e-975c-2fcc4240f391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:07 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-625b80d1-d31a-421e-a3ff-42a1df8f3a6b tempest-VolumeAndVolumeTypeFromImageTest-876346826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4654846f-96c6-4c4e-975c-2fcc4240f391) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:07 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-625b80d1-d31a-421e-a3ff-42a1df8f3a6b tempest-VolumeAndVolumeTypeFromImageTest-876346826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09159f74-d0de-4c43-ade2-6433ceb407a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:07 devstack cinder-volume[94394]: DEBUG cinder.image.glance [None req-625b80d1-d31a-421e-a3ff-42a1df8f3a6b tempest-VolumeAndVolumeTypeFromImageTest-876346826 None] Creating Keystone auth plugin from conf {{(pid=94394) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 26 14:42:07 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a127eb7-0039-4a72-9297-d05d5f341ba1 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:42:07 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-9a127eb7-0039-4a72-9297-d05d5f341ba1 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Flow 'volume_create_manager' (2a69d048-aebc-4262-b833-cb1e6aa09b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:42:07 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-9a127eb7-0039-4a72-9297-d05d5f341ba1 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f818746-0db1-4e4c-99d2-a9db1ddcb392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:07 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-9a127eb7-0039-4a72-9297-d05d5f341ba1 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f818746-0db1-4e4c-99d2-a9db1ddcb392) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:42:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1297142204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4572efb-5cd7-43ed-b8e2-aa5ca127a265,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e20f015f2e54f39a25d8e4fb8bffa56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:42:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:42:07Z,use_quota=True,user_id='3b4abd77b9b346faa86977c51283196d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:07 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-9a127eb7-0039-4a72-9297-d05d5f341ba1 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2e25cf9-ef1c-4243-be0c-fa33223f4fc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:07 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-9a127eb7-0039-4a72-9297-d05d5f341ba1 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2e25cf9-ef1c-4243-be0c-fa33223f4fc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:07 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-9a127eb7-0039-4a72-9297-d05d5f341ba1 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f0ae3fa-51fc-4d66-810b-4769d9e22a26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:07 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-9a127eb7-0039-4a72-9297-d05d5f341ba1 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f0ae3fa-51fc-4d66-810b-4769d9e22a26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4572efb-5cd7-43ed-b8e2-aa5ca127a265', 'volume_name': 'volume-d4572efb-5cd7-43ed-b8e2-aa5ca127a265', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:07 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-9a127eb7-0039-4a72-9297-d05d5f341ba1 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80fd27d7-cd5a-49f5-aa2c-e1f87710b891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:07 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-9a127eb7-0039-4a72-9297-d05d5f341ba1 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80fd27d7-cd5a-49f5-aa2c-e1f87710b891) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:07 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-9a127eb7-0039-4a72-9297-d05d5f341ba1 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b67d0afb-eb97-48f0-8ccb-b297593499e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:07 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-9a127eb7-0039-4a72-9297-d05d5f341ba1 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Volume d4572efb-5cd7-43ed-b8e2-aa5ca127a265: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4572efb-5cd7-43ed-b8e2-aa5ca127a265', 'volume_size': 1} Aug 26 14:42:07 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-9a127eb7-0039-4a72-9297-d05d5f341ba1 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:42:07 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa2a3fdc-9e07-4945-ba55-07aeb23672b6 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:42:07 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-aa2a3fdc-9e07-4945-ba55-07aeb23672b6 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Flow 'volume_create_manager' (e4676bc0-a203-4d01-aaf3-eaab0c5b83e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:42:07 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-aa2a3fdc-9e07-4945-ba55-07aeb23672b6 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ee6911e-e579-40a8-9d4e-fed3a58240f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:07 devstack sudo[113798]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:07 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-aa2a3fdc-9e07-4945-ba55-07aeb23672b6 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ee6911e-e579-40a8-9d4e-fed3a58240f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:42:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-70448195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1939b004-95dc-4465-9fae-b7748cc142b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e20f015f2e54f39a25d8e4fb8bffa56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:42:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:42:08Z,use_quota=True,user_id='3b4abd77b9b346faa86977c51283196d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:07 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-aa2a3fdc-9e07-4945-ba55-07aeb23672b6 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6a0ca82-2dc5-4d77-b38d-ecd804f636b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:07 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-aa2a3fdc-9e07-4945-ba55-07aeb23672b6 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6a0ca82-2dc5-4d77-b38d-ecd804f636b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:07 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-aa2a3fdc-9e07-4945-ba55-07aeb23672b6 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74f2a74a-5918-4c26-8831-eac413f7320c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:07 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-aa2a3fdc-9e07-4945-ba55-07aeb23672b6 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74f2a74a-5918-4c26-8831-eac413f7320c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1939b004-95dc-4465-9fae-b7748cc142b7', 'volume_name': 'volume-1939b004-95dc-4465-9fae-b7748cc142b7', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:07 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-aa2a3fdc-9e07-4945-ba55-07aeb23672b6 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (858cb8e4-8672-4427-8625-bff38c14d97a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:07 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-aa2a3fdc-9e07-4945-ba55-07aeb23672b6 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (858cb8e4-8672-4427-8625-bff38c14d97a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:07 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-aa2a3fdc-9e07-4945-ba55-07aeb23672b6 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7256819-0bde-4148-99f6-8c2c20b22708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:07 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-aa2a3fdc-9e07-4945-ba55-07aeb23672b6 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Volume 1939b004-95dc-4465-9fae-b7748cc142b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1939b004-95dc-4465-9fae-b7748cc142b7', 'volume_size': 1} Aug 26 14:42:07 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-aa2a3fdc-9e07-4945-ba55-07aeb23672b6 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:42:07 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-90f1f673-4bc6-4db0-a099-e284b2ba2631 tempest-CreateVolumesFromImageTest-1405516079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-69002b7c-381c-4181-a82b-ba244e4543ee 1073741824" returned: 0 in 0.616s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:07 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-90f1f673-4bc6-4db0-a099-e284b2ba2631 tempest-CreateVolumesFromImageTest-1405516079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-69002b7c-381c-4181-a82b-ba244e4543ee {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:08 devstack sudo[113804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-69002b7c-381c-4181-a82b-ba244e4543ee Aug 26 14:42:08 devstack sudo[113804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:08 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-625b80d1-d31a-421e-a3ff-42a1df8f3a6b tempest-VolumeAndVolumeTypeFromImageTest-876346826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09159f74-d0de-4c43-ade2-6433ceb407a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '02ec04f8-e1b7-4264-aa85-d20e56bc0582', 'volume_name': 'volume-02ec04f8-e1b7-4264-aa85-d20e56bc0582', 'volume_size': 1, 'image_id': 'e0c61842-d9d9-4671-8dbb-7baaf946796e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e0c61842-d9d9-4671-8dbb-7baaf946796e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5a802481053f826d701e31b1fb3398e6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'bb7400886bc54470aefdeae7e5c6085a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd3571c7db7c394e0e2875353c3a177fe6215f3e13a314fc340d90946056e1356d4f84f2e830780f8270238d41bcb7f21d5379259c9fddf3e1beebbc7dfd8a12c', 'id': 'e0c61842-d9d9-4671-8dbb-7baaf946796e', 'created_at': datetime.datetime(2026, 8, 26, 12, 42, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 12, 42, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e0c61842-d9d9-4671-8dbb-7baaf946796e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:08 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-625b80d1-d31a-421e-a3ff-42a1df8f3a6b tempest-VolumeAndVolumeTypeFromImageTest-876346826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e5bba12-6d5b-472d-87a8-ca5bc67b8942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:08 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-625b80d1-d31a-421e-a3ff-42a1df8f3a6b tempest-VolumeAndVolumeTypeFromImageTest-876346826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e5bba12-6d5b-472d-87a8-ca5bc67b8942) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:08 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-625b80d1-d31a-421e-a3ff-42a1df8f3a6b tempest-VolumeAndVolumeTypeFromImageTest-876346826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (578379c3-6071-4942-bdb5-361261a3f3bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:08 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-625b80d1-d31a-421e-a3ff-42a1df8f3a6b tempest-VolumeAndVolumeTypeFromImageTest-876346826 None] Volume 02ec04f8-e1b7-4264-aa85-d20e56bc0582: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-02ec04f8-e1b7-4264-aa85-d20e56bc0582', 'volume_size': 1, 'image_id': 'e0c61842-d9d9-4671-8dbb-7baaf946796e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e0c61842-d9d9-4671-8dbb-7baaf946796e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5a802481053f826d701e31b1fb3398e6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'bb7400886bc54470aefdeae7e5c6085a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd3571c7db7c394e0e2875353c3a177fe6215f3e13a314fc340d90946056e1356d4f84f2e830780f8270238d41bcb7f21d5379259c9fddf3e1beebbc7dfd8a12c', 'id': 'e0c61842-d9d9-4671-8dbb-7baaf946796e', 'created_at': datetime.datetime(2026, 8, 26, 12, 42, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 12, 42, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e0c61842-d9d9-4671-8dbb-7baaf946796e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Aug 26 14:42:08 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-625b80d1-d31a-421e-a3ff-42a1df8f3a6b tempest-VolumeAndVolumeTypeFromImageTest-876346826 None] Trying to clone 02ec04f8-e1b7-4264-aa85-d20e56bc0582 from image e0c61842-d9d9-4671-8dbb-7baaf946796e at location (None, [{'url': 'file:///opt/stack/data/glance/images/e0c61842-d9d9-4671-8dbb-7baaf946796e', 'metadata': {}}]). {{(pid=94394) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 26 14:42:08 devstack cinder-volume[94394]: DEBUG cinder.image.image_utils [None req-625b80d1-d31a-421e-a3ff-42a1df8f3a6b tempest-VolumeAndVolumeTypeFromImageTest-876346826 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e0c61842-d9d9-4671-8dbb-7baaf946796e_4881wcbwdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=94394) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 26 14:42:08 devstack cinder-volume[94394]: INFO cinder.image.image_utils [None req-625b80d1-d31a-421e-a3ff-42a1df8f3a6b tempest-VolumeAndVolumeTypeFromImageTest-876346826 None] Image download 0.00 MB at 0.00 MB/s Aug 26 14:42:08 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-60e0c7d3-ae5c-45d7-8fa0-58e0e1a17f5d tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:42:08 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-60e0c7d3-ae5c-45d7-8fa0-58e0e1a17f5d tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Flow 'volume_create_manager' (6d7ae4f7-b0dd-4c12-854f-152110838bb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:42:08 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-60e0c7d3-ae5c-45d7-8fa0-58e0e1a17f5d tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37b0a067-8393-44c1-9456-039085cef187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:08 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-60e0c7d3-ae5c-45d7-8fa0-58e0e1a17f5d tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37b0a067-8393-44c1-9456-039085cef187) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:42:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1285889198',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6fbcef9-b510-4a37-a9fd-6e51ae5fca6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e20f015f2e54f39a25d8e4fb8bffa56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:42:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:42:08Z,use_quota=True,user_id='3b4abd77b9b346faa86977c51283196d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:08 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-60e0c7d3-ae5c-45d7-8fa0-58e0e1a17f5d tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dcb7641-2fa9-47e9-9289-0952ba95b100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:08 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-60e0c7d3-ae5c-45d7-8fa0-58e0e1a17f5d tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dcb7641-2fa9-47e9-9289-0952ba95b100) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:08 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-60e0c7d3-ae5c-45d7-8fa0-58e0e1a17f5d tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd0ef910-a897-4a3a-a58a-b1bdb0109e1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:08 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-60e0c7d3-ae5c-45d7-8fa0-58e0e1a17f5d tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd0ef910-a897-4a3a-a58a-b1bdb0109e1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6fbcef9-b510-4a37-a9fd-6e51ae5fca6d', 'volume_name': 'volume-b6fbcef9-b510-4a37-a9fd-6e51ae5fca6d', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:08 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-60e0c7d3-ae5c-45d7-8fa0-58e0e1a17f5d tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1253a0aa-765c-49b1-b9cd-3a8a4d143270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:08 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-60e0c7d3-ae5c-45d7-8fa0-58e0e1a17f5d tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1253a0aa-765c-49b1-b9cd-3a8a4d143270) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:08 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-60e0c7d3-ae5c-45d7-8fa0-58e0e1a17f5d tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff20d540-37ed-4b5d-97a0-8accca63192b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:08 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-60e0c7d3-ae5c-45d7-8fa0-58e0e1a17f5d tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Volume b6fbcef9-b510-4a37-a9fd-6e51ae5fca6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6fbcef9-b510-4a37-a9fd-6e51ae5fca6d', 'volume_size': 1} Aug 26 14:42:08 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-60e0c7d3-ae5c-45d7-8fa0-58e0e1a17f5d tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:42:08 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f4a25ca-67b2-4c81-a664-b24e1013b48c]: (4, 'raw') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:42:08 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-625b80d1-d31a-421e-a3ff-42a1df8f3a6b tempest-VolumeAndVolumeTypeFromImageTest-876346826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e0c61842-d9d9-4671-8dbb-7baaf946796e_4881wcbwdevstack@QuobyteHD {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:08 devstack sudo[113804]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:08 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-90f1f673-4bc6-4db0-a099-e284b2ba2631 tempest-CreateVolumesFromImageTest-1405516079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-69002b7c-381c-4181-a82b-ba244e4543ee" returned: 0 in 0.405s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:08 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-90f1f673-4bc6-4db0-a099-e284b2ba2631 tempest-CreateVolumesFromImageTest-1405516079 None] <== create_volume: return (1076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:42:08 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-90f1f673-4bc6-4db0-a099-e284b2ba2631 tempest-CreateVolumesFromImageTest-1405516079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.082s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:42:08 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-d0c974ec-8e52-4769-8fe7-b85fae4ebb1b tempest-CreateVolumesFromImageTest-1405516079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.370s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:42:08 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-d0c974ec-8e52-4769-8fe7-b85fae4ebb1b tempest-CreateVolumesFromImageTest-1405516079 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:42:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-947309944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8064a98c-8f08-4590-ac1b-944fe429895d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84c1d5c2e1b04c79bd7b29049e5b9c9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:42:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:42:05Z,use_quota=True,user_id='7417ff24c0484a9aab88464232ef552e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:42:08 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-d0c974ec-8e52-4769-8fe7-b85fae4ebb1b tempest-CreateVolumesFromImageTest-1405516079 None] Creating volume 8064a98c-8f08-4590-ac1b-944fe429895d {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:42:08 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-d0c974ec-8e52-4769-8fe7-b85fae4ebb1b tempest-CreateVolumesFromImageTest-1405516079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:42:08 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-d0c974ec-8e52-4769-8fe7-b85fae4ebb1b tempest-CreateVolumesFromImageTest-1405516079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:42:08 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-d0c974ec-8e52-4769-8fe7-b85fae4ebb1b tempest-CreateVolumesFromImageTest-1405516079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:42:08 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-d0c974ec-8e52-4769-8fe7-b85fae4ebb1b tempest-CreateVolumesFromImageTest-1405516079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:42:08 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-d0c974ec-8e52-4769-8fe7-b85fae4ebb1b tempest-CreateVolumesFromImageTest-1405516079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:42:08 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-d0c974ec-8e52-4769-8fe7-b85fae4ebb1b tempest-CreateVolumesFromImageTest-1405516079 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:42:08 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-d0c974ec-8e52-4769-8fe7-b85fae4ebb1b tempest-CreateVolumesFromImageTest-1405516079 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:42:08 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-d0c974ec-8e52-4769-8fe7-b85fae4ebb1b tempest-CreateVolumesFromImageTest-1405516079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-8064a98c-8f08-4590-ac1b-944fe429895d 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:08 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-90f1f673-4bc6-4db0-a099-e284b2ba2631 tempest-CreateVolumesFromImageTest-1405516079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b76c7335-164b-4189-8b68-090c1d622415) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69002b7c-381c-4181-a82b-ba244e4543ee', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:08 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-90f1f673-4bc6-4db0-a099-e284b2ba2631 tempest-CreateVolumesFromImageTest-1405516079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2086d884-13fa-421b-be55-8bdcfc7b0049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:08 devstack sudo[113808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-8064a98c-8f08-4590-ac1b-944fe429895d 1073741824 Aug 26 14:42:08 devstack sudo[113808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:08 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-90f1f673-4bc6-4db0-a099-e284b2ba2631 tempest-CreateVolumesFromImageTest-1405516079 None] Volume volume-69002b7c-381c-4181-a82b-ba244e4543ee (69002b7c-381c-4181-a82b-ba244e4543ee): created successfully Aug 26 14:42:08 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-90f1f673-4bc6-4db0-a099-e284b2ba2631 tempest-CreateVolumesFromImageTest-1405516079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2086d884-13fa-421b-be55-8bdcfc7b0049) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:08 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-90f1f673-4bc6-4db0-a099-e284b2ba2631 tempest-CreateVolumesFromImageTest-1405516079 None] Flow 'volume_create_manager' (6e4bd27e-b188-4b18-9c10-8bc919932b02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:42:08 devstack sudo[113807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e0c61842-d9d9-4671-8dbb-7baaf946796e_4881wcbwdevstack@QuobyteHD Aug 26 14:42:08 devstack sudo[113807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:08 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-90f1f673-4bc6-4db0-a099-e284b2ba2631 tempest-CreateVolumesFromImageTest-1405516079 None] Created volume successfully. Aug 26 14:42:08 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-720ad958-8df1-4e7e-8874-6abbb6dfc8fc tempest-CreateVolumesFromSnapshotTest-1806966364 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:42:08 devstack sudo[113807]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:08 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-625b80d1-d31a-421e-a3ff-42a1df8f3a6b tempest-VolumeAndVolumeTypeFromImageTest-876346826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e0c61842-d9d9-4671-8dbb-7baaf946796e_4881wcbwdevstack@QuobyteHD" returned: 0 in 0.486s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:08 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-625b80d1-d31a-421e-a3ff-42a1df8f3a6b tempest-VolumeAndVolumeTypeFromImageTest-876346826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e0c61842-d9d9-4671-8dbb-7baaf946796e_4881wcbwdevstack@QuobyteHD {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:08 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-935ddeec-ff30-4e76-9f63-4aa151e23898 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:42:08 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-935ddeec-ff30-4e76-9f63-4aa151e23898 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Flow 'volume_create_manager' (82bf3632-16cb-4fc6-9ca7-8eeac6e4a3d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:42:08 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-935ddeec-ff30-4e76-9f63-4aa151e23898 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24790d4a-5ffe-42b3-9061-d8173aff4ac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:08 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-935ddeec-ff30-4e76-9f63-4aa151e23898 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24790d4a-5ffe-42b3-9061-d8173aff4ac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:42:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2044543171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77b2975a-84db-4582-8906-46392d1c8022,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e20f015f2e54f39a25d8e4fb8bffa56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:42:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:42:09Z,use_quota=True,user_id='3b4abd77b9b346faa86977c51283196d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:08 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-935ddeec-ff30-4e76-9f63-4aa151e23898 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eac75f5b-4c49-4b36-81f3-3a0e8cc04a1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:08 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-935ddeec-ff30-4e76-9f63-4aa151e23898 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eac75f5b-4c49-4b36-81f3-3a0e8cc04a1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:08 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-935ddeec-ff30-4e76-9f63-4aa151e23898 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fd2d603-5486-4061-ad73-b5c271511aea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:08 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-935ddeec-ff30-4e76-9f63-4aa151e23898 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fd2d603-5486-4061-ad73-b5c271511aea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77b2975a-84db-4582-8906-46392d1c8022', 'volume_name': 'volume-77b2975a-84db-4582-8906-46392d1c8022', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:08 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-935ddeec-ff30-4e76-9f63-4aa151e23898 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1be96a66-a723-4d94-92ee-32acab486936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:08 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-935ddeec-ff30-4e76-9f63-4aa151e23898 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1be96a66-a723-4d94-92ee-32acab486936) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:09 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-935ddeec-ff30-4e76-9f63-4aa151e23898 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46453b96-3c26-4ff7-b493-9d1a51aa26c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:09 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-935ddeec-ff30-4e76-9f63-4aa151e23898 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Volume 77b2975a-84db-4582-8906-46392d1c8022: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77b2975a-84db-4582-8906-46392d1c8022', 'volume_size': 1} Aug 26 14:42:09 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-935ddeec-ff30-4e76-9f63-4aa151e23898 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:42:09 devstack sudo[113816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e0c61842-d9d9-4671-8dbb-7baaf946796e_4881wcbwdevstack@QuobyteHD Aug 26 14:42:09 devstack sudo[113816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:09 devstack sudo[113808]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:09 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-d0c974ec-8e52-4769-8fe7-b85fae4ebb1b tempest-CreateVolumesFromImageTest-1405516079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-8064a98c-8f08-4590-ac1b-944fe429895d 1073741824" returned: 0 in 0.661s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:09 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-826d8794-a37c-47fb-8473-e08f2dbb5769 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:42:09 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-826d8794-a37c-47fb-8473-e08f2dbb5769 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Flow 'volume_create_manager' (a76d500d-c65a-473c-a05b-3447ef59957d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:42:09 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-826d8794-a37c-47fb-8473-e08f2dbb5769 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45a6731d-399d-4e27-a6cd-9cf7035bacc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:09 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-826d8794-a37c-47fb-8473-e08f2dbb5769 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45a6731d-399d-4e27-a6cd-9cf7035bacc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:42:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-309368768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53d48e12-9d67-4952-b2a8-1a037efb1934,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e20f015f2e54f39a25d8e4fb8bffa56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:42:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:42:09Z,use_quota=True,user_id='3b4abd77b9b346faa86977c51283196d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:09 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-826d8794-a37c-47fb-8473-e08f2dbb5769 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a37fb1c4-1be6-4f6e-8cd0-9e0301f88f80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:09 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-826d8794-a37c-47fb-8473-e08f2dbb5769 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a37fb1c4-1be6-4f6e-8cd0-9e0301f88f80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:09 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-826d8794-a37c-47fb-8473-e08f2dbb5769 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33825c29-3b6b-4a25-a8a6-a3eac3a3b488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:09 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-826d8794-a37c-47fb-8473-e08f2dbb5769 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33825c29-3b6b-4a25-a8a6-a3eac3a3b488) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53d48e12-9d67-4952-b2a8-1a037efb1934', 'volume_name': 'volume-53d48e12-9d67-4952-b2a8-1a037efb1934', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:09 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-826d8794-a37c-47fb-8473-e08f2dbb5769 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6bfe14e-7899-4b6e-a5b0-1450db6f7beb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:09 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-826d8794-a37c-47fb-8473-e08f2dbb5769 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6bfe14e-7899-4b6e-a5b0-1450db6f7beb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:09 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-826d8794-a37c-47fb-8473-e08f2dbb5769 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06fdeb47-4941-421a-b362-7097dbbfee1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:09 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-826d8794-a37c-47fb-8473-e08f2dbb5769 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Volume 53d48e12-9d67-4952-b2a8-1a037efb1934: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53d48e12-9d67-4952-b2a8-1a037efb1934', 'volume_size': 1} Aug 26 14:42:09 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-826d8794-a37c-47fb-8473-e08f2dbb5769 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:42:09 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-d0c974ec-8e52-4769-8fe7-b85fae4ebb1b tempest-CreateVolumesFromImageTest-1405516079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-8064a98c-8f08-4590-ac1b-944fe429895d {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:09 devstack sudo[113818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-8064a98c-8f08-4590-ac1b-944fe429895d Aug 26 14:42:09 devstack sudo[113818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:09 devstack sudo[113816]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:09 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-625b80d1-d31a-421e-a3ff-42a1df8f3a6b tempest-VolumeAndVolumeTypeFromImageTest-876346826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e0c61842-d9d9-4671-8dbb-7baaf946796e_4881wcbwdevstack@QuobyteHD" returned: 1 in 0.434s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:09 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-625b80d1-d31a-421e-a3ff-42a1df8f3a6b tempest-VolumeAndVolumeTypeFromImageTest-876346826 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e0c61842-d9d9-4671-8dbb-7baaf946796e_4881wcbwdevstack@QuobyteHD' failed. Not Retrying. {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 14:42:09 devstack cinder-volume[94394]: DEBUG cinder.image.image_utils [None req-625b80d1-d31a-421e-a3ff-42a1df8f3a6b tempest-VolumeAndVolumeTypeFromImageTest-876346826 None] Temporary image e0c61842-d9d9-4671-8dbb-7baaf946796e is fetched for user 07494e6890fc4c879dcad06f2f657168. {{(pid=94394) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 26 14:42:09 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[02c01cfa-7e83-48e0-96dc-7f28edf940fd]: (4, 'raw') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:42:09 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-625b80d1-d31a-421e-a3ff-42a1df8f3a6b tempest-VolumeAndVolumeTypeFromImageTest-876346826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e0c61842-d9d9-4671-8dbb-7baaf946796e_4881wcbwdevstack@QuobyteHD {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:09 devstack sudo[113818]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:09 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-d0c974ec-8e52-4769-8fe7-b85fae4ebb1b tempest-CreateVolumesFromImageTest-1405516079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-8064a98c-8f08-4590-ac1b-944fe429895d" returned: 0 in 0.248s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:09 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-d0c974ec-8e52-4769-8fe7-b85fae4ebb1b tempest-CreateVolumesFromImageTest-1405516079 None] <== create_volume: return (1028ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:42:09 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-d0c974ec-8e52-4769-8fe7-b85fae4ebb1b tempest-CreateVolumesFromImageTest-1405516079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.032s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:42:09 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-6f7f79d7-e4cb-46dc-bf51-1d755fd26ee7 tempest-CreateVolumesFromImageTest-1405516079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.113s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:42:09 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-6f7f79d7-e4cb-46dc-bf51-1d755fd26ee7 tempest-CreateVolumesFromImageTest-1405516079 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:42:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-779568876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21ec32a7-9362-498c-9322-c94f9f2c566f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84c1d5c2e1b04c79bd7b29049e5b9c9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:42:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:42:05Z,use_quota=True,user_id='7417ff24c0484a9aab88464232ef552e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:42:09 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-6f7f79d7-e4cb-46dc-bf51-1d755fd26ee7 tempest-CreateVolumesFromImageTest-1405516079 None] Creating volume 21ec32a7-9362-498c-9322-c94f9f2c566f {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:42:09 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-6f7f79d7-e4cb-46dc-bf51-1d755fd26ee7 tempest-CreateVolumesFromImageTest-1405516079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:42:09 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-6f7f79d7-e4cb-46dc-bf51-1d755fd26ee7 tempest-CreateVolumesFromImageTest-1405516079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:42:09 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-6f7f79d7-e4cb-46dc-bf51-1d755fd26ee7 tempest-CreateVolumesFromImageTest-1405516079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:42:09 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-6f7f79d7-e4cb-46dc-bf51-1d755fd26ee7 tempest-CreateVolumesFromImageTest-1405516079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:42:09 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-6f7f79d7-e4cb-46dc-bf51-1d755fd26ee7 tempest-CreateVolumesFromImageTest-1405516079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:42:09 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-6f7f79d7-e4cb-46dc-bf51-1d755fd26ee7 tempest-CreateVolumesFromImageTest-1405516079 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:42:09 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-6f7f79d7-e4cb-46dc-bf51-1d755fd26ee7 tempest-CreateVolumesFromImageTest-1405516079 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:42:09 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-6f7f79d7-e4cb-46dc-bf51-1d755fd26ee7 tempest-CreateVolumesFromImageTest-1405516079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-21ec32a7-9362-498c-9322-c94f9f2c566f 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:09 devstack sudo[113823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e0c61842-d9d9-4671-8dbb-7baaf946796e_4881wcbwdevstack@QuobyteHD Aug 26 14:42:09 devstack sudo[113823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:09 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-d0c974ec-8e52-4769-8fe7-b85fae4ebb1b tempest-CreateVolumesFromImageTest-1405516079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bb98e81-df5a-4a5d-a27a-172e9912fa0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8064a98c-8f08-4590-ac1b-944fe429895d', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:09 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-d0c974ec-8e52-4769-8fe7-b85fae4ebb1b tempest-CreateVolumesFromImageTest-1405516079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4033fc61-b783-4bb2-9925-d86755c98001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:09 devstack sudo[113825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-21ec32a7-9362-498c-9322-c94f9f2c566f 1073741824 Aug 26 14:42:09 devstack sudo[113825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:09 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-d0c974ec-8e52-4769-8fe7-b85fae4ebb1b tempest-CreateVolumesFromImageTest-1405516079 None] Volume volume-8064a98c-8f08-4590-ac1b-944fe429895d (8064a98c-8f08-4590-ac1b-944fe429895d): created successfully Aug 26 14:42:09 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-d0c974ec-8e52-4769-8fe7-b85fae4ebb1b tempest-CreateVolumesFromImageTest-1405516079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4033fc61-b783-4bb2-9925-d86755c98001) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:09 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-d0c974ec-8e52-4769-8fe7-b85fae4ebb1b tempest-CreateVolumesFromImageTest-1405516079 None] Flow 'volume_create_manager' (fe19a3ae-9354-4abb-9b95-dc62203dc1d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:42:09 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-d0c974ec-8e52-4769-8fe7-b85fae4ebb1b tempest-CreateVolumesFromImageTest-1405516079 None] Created volume successfully. Aug 26 14:42:09 devstack sudo[113823]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:09 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-625b80d1-d31a-421e-a3ff-42a1df8f3a6b tempest-VolumeAndVolumeTypeFromImageTest-876346826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e0c61842-d9d9-4671-8dbb-7baaf946796e_4881wcbwdevstack@QuobyteHD" returned: 0 in 0.357s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:09 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-625b80d1-d31a-421e-a3ff-42a1df8f3a6b tempest-VolumeAndVolumeTypeFromImageTest-876346826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e0c61842-d9d9-4671-8dbb-7baaf946796e_4881wcbwdevstack@QuobyteHD {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:09 devstack sudo[113833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e0c61842-d9d9-4671-8dbb-7baaf946796e_4881wcbwdevstack@QuobyteHD Aug 26 14:42:09 devstack sudo[113833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:09 devstack sudo[113825]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:09 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-6f7f79d7-e4cb-46dc-bf51-1d755fd26ee7 tempest-CreateVolumesFromImageTest-1405516079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-21ec32a7-9362-498c-9322-c94f9f2c566f 1073741824" returned: 0 in 0.426s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:09 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-6f7f79d7-e4cb-46dc-bf51-1d755fd26ee7 tempest-CreateVolumesFromImageTest-1405516079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-21ec32a7-9362-498c-9322-c94f9f2c566f {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:09 devstack sudo[113835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-21ec32a7-9362-498c-9322-c94f9f2c566f Aug 26 14:42:09 devstack sudo[113835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:10 devstack sudo[113833]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:10 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-625b80d1-d31a-421e-a3ff-42a1df8f3a6b tempest-VolumeAndVolumeTypeFromImageTest-876346826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e0c61842-d9d9-4671-8dbb-7baaf946796e_4881wcbwdevstack@QuobyteHD" returned: 1 in 0.341s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:10 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-625b80d1-d31a-421e-a3ff-42a1df8f3a6b tempest-VolumeAndVolumeTypeFromImageTest-876346826 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e0c61842-d9d9-4671-8dbb-7baaf946796e_4881wcbwdevstack@QuobyteHD' failed. Not Retrying. {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 14:42:10 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-625b80d1-d31a-421e-a3ff-42a1df8f3a6b tempest-VolumeAndVolumeTypeFromImageTest-876346826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:42:10 devstack sudo[113835]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:10 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-6f7f79d7-e4cb-46dc-bf51-1d755fd26ee7 tempest-CreateVolumesFromImageTest-1405516079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-21ec32a7-9362-498c-9322-c94f9f2c566f" returned: 0 in 0.285s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:10 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-6f7f79d7-e4cb-46dc-bf51-1d755fd26ee7 tempest-CreateVolumesFromImageTest-1405516079 None] <== create_volume: return (757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:42:10 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-6f7f79d7-e4cb-46dc-bf51-1d755fd26ee7 tempest-CreateVolumesFromImageTest-1405516079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.764s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:42:10 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-9a127eb7-0039-4a72-9297-d05d5f341ba1 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.525s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:42:10 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-9a127eb7-0039-4a72-9297-d05d5f341ba1 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:42:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1297142204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4572efb-5cd7-43ed-b8e2-aa5ca127a265,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e20f015f2e54f39a25d8e4fb8bffa56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:42:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:42:07Z,use_quota=True,user_id='3b4abd77b9b346faa86977c51283196d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:42:10 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-9a127eb7-0039-4a72-9297-d05d5f341ba1 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Creating volume d4572efb-5cd7-43ed-b8e2-aa5ca127a265 {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:42:10 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-9a127eb7-0039-4a72-9297-d05d5f341ba1 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:42:10 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-9a127eb7-0039-4a72-9297-d05d5f341ba1 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:42:10 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-9a127eb7-0039-4a72-9297-d05d5f341ba1 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:42:10 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-9a127eb7-0039-4a72-9297-d05d5f341ba1 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:42:10 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-9a127eb7-0039-4a72-9297-d05d5f341ba1 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:42:10 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-9a127eb7-0039-4a72-9297-d05d5f341ba1 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:42:10 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-9a127eb7-0039-4a72-9297-d05d5f341ba1 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:42:10 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-9a127eb7-0039-4a72-9297-d05d5f341ba1 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d4572efb-5cd7-43ed-b8e2-aa5ca127a265 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:10 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-6f7f79d7-e4cb-46dc-bf51-1d755fd26ee7 tempest-CreateVolumesFromImageTest-1405516079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (196d894a-921f-42c9-a55e-f454b8d98abf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21ec32a7-9362-498c-9322-c94f9f2c566f', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:10 devstack sudo[113841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d4572efb-5cd7-43ed-b8e2-aa5ca127a265 1073741824 Aug 26 14:42:10 devstack sudo[113841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:10 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-6f7f79d7-e4cb-46dc-bf51-1d755fd26ee7 tempest-CreateVolumesFromImageTest-1405516079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fa08057-85ef-4556-8a13-10768f78cb28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:10 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-6f7f79d7-e4cb-46dc-bf51-1d755fd26ee7 tempest-CreateVolumesFromImageTest-1405516079 None] Volume volume-21ec32a7-9362-498c-9322-c94f9f2c566f (21ec32a7-9362-498c-9322-c94f9f2c566f): created successfully Aug 26 14:42:10 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-6f7f79d7-e4cb-46dc-bf51-1d755fd26ee7 tempest-CreateVolumesFromImageTest-1405516079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fa08057-85ef-4556-8a13-10768f78cb28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:10 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-6f7f79d7-e4cb-46dc-bf51-1d755fd26ee7 tempest-CreateVolumesFromImageTest-1405516079 None] Flow 'volume_create_manager' (14bd0bbf-6d6f-4b19-a855-10ebc2581647) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:42:10 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-6f7f79d7-e4cb-46dc-bf51-1d755fd26ee7 tempest-CreateVolumesFromImageTest-1405516079 None] Created volume successfully. Aug 26 14:42:10 devstack sudo[113841]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:10 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-9a127eb7-0039-4a72-9297-d05d5f341ba1 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d4572efb-5cd7-43ed-b8e2-aa5ca127a265 1073741824" returned: 0 in 0.406s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:10 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-9a127eb7-0039-4a72-9297-d05d5f341ba1 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d4572efb-5cd7-43ed-b8e2-aa5ca127a265 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:10 devstack sudo[113848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d4572efb-5cd7-43ed-b8e2-aa5ca127a265 Aug 26 14:42:10 devstack sudo[113848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:10 devstack sudo[113848]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:10 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-9a127eb7-0039-4a72-9297-d05d5f341ba1 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d4572efb-5cd7-43ed-b8e2-aa5ca127a265" returned: 0 in 0.248s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:10 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-9a127eb7-0039-4a72-9297-d05d5f341ba1 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] <== create_volume: return (695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:42:10 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-9a127eb7-0039-4a72-9297-d05d5f341ba1 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.698s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:42:10 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-aa2a3fdc-9e07-4945-ba55-07aeb23672b6 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.976s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:42:10 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-aa2a3fdc-9e07-4945-ba55-07aeb23672b6 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:42:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-70448195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1939b004-95dc-4465-9fae-b7748cc142b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e20f015f2e54f39a25d8e4fb8bffa56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:42:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:42:08Z,use_quota=True,user_id='3b4abd77b9b346faa86977c51283196d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:42:10 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-aa2a3fdc-9e07-4945-ba55-07aeb23672b6 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Creating volume 1939b004-95dc-4465-9fae-b7748cc142b7 {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:42:10 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-aa2a3fdc-9e07-4945-ba55-07aeb23672b6 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:42:10 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-aa2a3fdc-9e07-4945-ba55-07aeb23672b6 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:42:10 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-aa2a3fdc-9e07-4945-ba55-07aeb23672b6 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:42:10 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-aa2a3fdc-9e07-4945-ba55-07aeb23672b6 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:42:10 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-aa2a3fdc-9e07-4945-ba55-07aeb23672b6 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:42:10 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-aa2a3fdc-9e07-4945-ba55-07aeb23672b6 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:42:10 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-aa2a3fdc-9e07-4945-ba55-07aeb23672b6 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:42:10 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-aa2a3fdc-9e07-4945-ba55-07aeb23672b6 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-1939b004-95dc-4465-9fae-b7748cc142b7 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:10 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-a1d708f9-baec-45e1-935e-f3bf5dbde06c tempest-CreateVolumesFromImageTest-1405516079 None] Acquiring lock "cinder-21ec32a7-9362-498c-9322-c94f9f2c566f-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:42:10 devstack sudo[113851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-1939b004-95dc-4465-9fae-b7748cc142b7 1073741824 Aug 26 14:42:10 devstack sudo[113851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:10 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-9a127eb7-0039-4a72-9297-d05d5f341ba1 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b67d0afb-eb97-48f0-8ccb-b297593499e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4572efb-5cd7-43ed-b8e2-aa5ca127a265', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:10 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-9a127eb7-0039-4a72-9297-d05d5f341ba1 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49125d38-0cd8-4e58-bd44-457216371949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:10 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-9a127eb7-0039-4a72-9297-d05d5f341ba1 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Volume volume-d4572efb-5cd7-43ed-b8e2-aa5ca127a265 (d4572efb-5cd7-43ed-b8e2-aa5ca127a265): created successfully Aug 26 14:42:10 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-9a127eb7-0039-4a72-9297-d05d5f341ba1 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49125d38-0cd8-4e58-bd44-457216371949) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:10 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-9a127eb7-0039-4a72-9297-d05d5f341ba1 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Flow 'volume_create_manager' (2a69d048-aebc-4262-b833-cb1e6aa09b23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:42:10 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-a1d708f9-baec-45e1-935e-f3bf5dbde06c tempest-CreateVolumesFromImageTest-1405516079 None] Lock "cinder-21ec32a7-9362-498c-9322-c94f9f2c566f-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:42:11 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-9a127eb7-0039-4a72-9297-d05d5f341ba1 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Created volume successfully. Aug 26 14:42:11 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-a1d708f9-baec-45e1-935e-f3bf5dbde06c tempest-CreateVolumesFromImageTest-1405516079 None] Acquiring lock "cinder-quobyte-21ec32a7-9362-498c-9322-c94f9f2c566f" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:42:11 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-a1d708f9-baec-45e1-935e-f3bf5dbde06c tempest-CreateVolumesFromImageTest-1405516079 None] Lock "cinder-quobyte-21ec32a7-9362-498c-9322-c94f9f2c566f" acquired by "delete_volume" :: waited 0.017s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:42:11 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[d03b8e07-434c-48bf-bbdf-36eb62d05416]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:42:11 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-a1d708f9-baec-45e1-935e-f3bf5dbde06c tempest-CreateVolumesFromImageTest-1405516079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-21ec32a7-9362-498c-9322-c94f9f2c566f {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:11 devstack sudo[113853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-21ec32a7-9362-498c-9322-c94f9f2c566f Aug 26 14:42:11 devstack sudo[113853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:11 devstack sudo[113851]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:11 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-aa2a3fdc-9e07-4945-ba55-07aeb23672b6 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-1939b004-95dc-4465-9fae-b7748cc142b7 1073741824" returned: 0 in 0.470s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:11 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-aa2a3fdc-9e07-4945-ba55-07aeb23672b6 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-1939b004-95dc-4465-9fae-b7748cc142b7 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:11 devstack sudo[113853]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:11 devstack sudo[113862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-1939b004-95dc-4465-9fae-b7748cc142b7 Aug 26 14:42:11 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-a1d708f9-baec-45e1-935e-f3bf5dbde06c tempest-CreateVolumesFromImageTest-1405516079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-21ec32a7-9362-498c-9322-c94f9f2c566f" returned: 0 in 0.396s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:11 devstack sudo[113862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:11 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-a1d708f9-baec-45e1-935e-f3bf5dbde06c tempest-CreateVolumesFromImageTest-1405516079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-21ec32a7-9362-498c-9322-c94f9f2c566f {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:11 devstack sudo[113864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-21ec32a7-9362-498c-9322-c94f9f2c566f Aug 26 14:42:11 devstack sudo[113864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:11 devstack sudo[113862]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:11 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-aa2a3fdc-9e07-4945-ba55-07aeb23672b6 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-1939b004-95dc-4465-9fae-b7748cc142b7" returned: 0 in 0.239s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:11 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-aa2a3fdc-9e07-4945-ba55-07aeb23672b6 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] <== create_volume: return (780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:42:11 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-aa2a3fdc-9e07-4945-ba55-07aeb23672b6 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.784s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:42:11 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-60e0c7d3-ae5c-45d7-8fa0-58e0e1a17f5d tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.333s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:42:11 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-60e0c7d3-ae5c-45d7-8fa0-58e0e1a17f5d tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:42:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1285889198',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6fbcef9-b510-4a37-a9fd-6e51ae5fca6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e20f015f2e54f39a25d8e4fb8bffa56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:42:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:42:08Z,use_quota=True,user_id='3b4abd77b9b346faa86977c51283196d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:42:11 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-60e0c7d3-ae5c-45d7-8fa0-58e0e1a17f5d tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Creating volume b6fbcef9-b510-4a37-a9fd-6e51ae5fca6d {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:42:11 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-60e0c7d3-ae5c-45d7-8fa0-58e0e1a17f5d tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:42:11 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-60e0c7d3-ae5c-45d7-8fa0-58e0e1a17f5d tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:42:11 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-60e0c7d3-ae5c-45d7-8fa0-58e0e1a17f5d tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:42:11 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-60e0c7d3-ae5c-45d7-8fa0-58e0e1a17f5d tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:42:11 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-60e0c7d3-ae5c-45d7-8fa0-58e0e1a17f5d tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:42:11 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-60e0c7d3-ae5c-45d7-8fa0-58e0e1a17f5d tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:42:11 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-60e0c7d3-ae5c-45d7-8fa0-58e0e1a17f5d tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:42:11 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-60e0c7d3-ae5c-45d7-8fa0-58e0e1a17f5d tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b6fbcef9-b510-4a37-a9fd-6e51ae5fca6d 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:11 devstack sudo[113864]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:11 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-a1d708f9-baec-45e1-935e-f3bf5dbde06c tempest-CreateVolumesFromImageTest-1405516079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-21ec32a7-9362-498c-9322-c94f9f2c566f" returned: 0 in 0.254s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:11 devstack sudo[113868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b6fbcef9-b510-4a37-a9fd-6e51ae5fca6d 1073741824 Aug 26 14:42:11 devstack sudo[113868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:11 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-aa2a3fdc-9e07-4945-ba55-07aeb23672b6 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7256819-0bde-4148-99f6-8c2c20b22708) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1939b004-95dc-4465-9fae-b7748cc142b7', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:11 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-aa2a3fdc-9e07-4945-ba55-07aeb23672b6 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb448a6e-783d-4a5d-b4a8-1ca976fe74c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:11 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-a1d708f9-baec-45e1-935e-f3bf5dbde06c tempest-CreateVolumesFromImageTest-1405516079 None] Lock "cinder-quobyte-21ec32a7-9362-498c-9322-c94f9f2c566f" released by "delete_volume" :: held 0.710s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:42:11 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-aa2a3fdc-9e07-4945-ba55-07aeb23672b6 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Volume volume-1939b004-95dc-4465-9fae-b7748cc142b7 (1939b004-95dc-4465-9fae-b7748cc142b7): created successfully Aug 26 14:42:11 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-aa2a3fdc-9e07-4945-ba55-07aeb23672b6 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb448a6e-783d-4a5d-b4a8-1ca976fe74c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:11 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-aa2a3fdc-9e07-4945-ba55-07aeb23672b6 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Flow 'volume_create_manager' (e4676bc0-a203-4d01-aaf3-eaab0c5b83e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:42:11 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-aa2a3fdc-9e07-4945-ba55-07aeb23672b6 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Created volume successfully. Aug 26 14:42:11 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-a1d708f9-baec-45e1-935e-f3bf5dbde06c tempest-CreateVolumesFromImageTest-1405516079 None] Created reservations ['3085ea75-f300-4ae7-8204-f926c136566c', 'ab08c6ca-363a-460e-ae33-416063677a45', '25608a45-2809-4e5c-8b12-a3dd58f6477d', '7af61cbb-cb05-490f-afb3-76e65948d26d'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:42:11 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-a1d708f9-baec-45e1-935e-f3bf5dbde06c tempest-CreateVolumesFromImageTest-1405516079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:42:11 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-a1d708f9-baec-45e1-935e-f3bf5dbde06c tempest-CreateVolumesFromImageTest-1405516079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:42:11 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-a1d708f9-baec-45e1-935e-f3bf5dbde06c tempest-CreateVolumesFromImageTest-1405516079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:42:11 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-a1d708f9-baec-45e1-935e-f3bf5dbde06c tempest-CreateVolumesFromImageTest-1405516079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:42:11 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-a1d708f9-baec-45e1-935e-f3bf5dbde06c tempest-CreateVolumesFromImageTest-1405516079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:42:11 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-a1d708f9-baec-45e1-935e-f3bf5dbde06c tempest-CreateVolumesFromImageTest-1405516079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:11 devstack sudo[113870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:42:11 devstack sudo[113870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:12 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-c0949813-9b61-4a1a-b78c-d5269b7ac00d tempest-CreateVolumesFromImageTest-1405516079 None] Acquiring lock "cinder-8064a98c-8f08-4590-ac1b-944fe429895d-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:42:12 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-c0949813-9b61-4a1a-b78c-d5269b7ac00d tempest-CreateVolumesFromImageTest-1405516079 None] Lock "cinder-8064a98c-8f08-4590-ac1b-944fe429895d-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:42:12 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-c0949813-9b61-4a1a-b78c-d5269b7ac00d tempest-CreateVolumesFromImageTest-1405516079 None] Acquiring lock "cinder-quobyte-8064a98c-8f08-4590-ac1b-944fe429895d" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:42:12 devstack sudo[113868]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:12 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-60e0c7d3-ae5c-45d7-8fa0-58e0e1a17f5d tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b6fbcef9-b510-4a37-a9fd-6e51ae5fca6d 1073741824" returned: 0 in 0.471s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:12 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-c0949813-9b61-4a1a-b78c-d5269b7ac00d tempest-CreateVolumesFromImageTest-1405516079 None] Lock "cinder-quobyte-8064a98c-8f08-4590-ac1b-944fe429895d" acquired by "delete_volume" :: waited 0.023s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:42:12 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a8cc9a6-7455-42b0-ab59-b4fd9a52faec]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:42:12 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-c0949813-9b61-4a1a-b78c-d5269b7ac00d tempest-CreateVolumesFromImageTest-1405516079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-8064a98c-8f08-4590-ac1b-944fe429895d {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:12 devstack sudo[113870]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:12 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-a1d708f9-baec-45e1-935e-f3bf5dbde06c tempest-CreateVolumesFromImageTest-1405516079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.336s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:12 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-a1d708f9-baec-45e1-935e-f3bf5dbde06c tempest-CreateVolumesFromImageTest-1405516079 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:42:12 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-60e0c7d3-ae5c-45d7-8fa0-58e0e1a17f5d tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b6fbcef9-b510-4a37-a9fd-6e51ae5fca6d {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:12 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-a1d708f9-baec-45e1-935e-f3bf5dbde06c tempest-CreateVolumesFromImageTest-1405516079 None] Deleted volume successfully. Aug 26 14:42:12 devstack sudo[113877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b6fbcef9-b510-4a37-a9fd-6e51ae5fca6d Aug 26 14:42:12 devstack sudo[113877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:12 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-a1d708f9-baec-45e1-935e-f3bf5dbde06c tempest-CreateVolumesFromImageTest-1405516079 None] Lock "cinder-21ec32a7-9362-498c-9322-c94f9f2c566f-delete_volume" released by "delete_volume" :: held 1.305s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:42:12 devstack sudo[113876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-8064a98c-8f08-4590-ac1b-944fe429895d Aug 26 14:42:12 devstack sudo[113876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:12 devstack sudo[113877]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:12 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-60e0c7d3-ae5c-45d7-8fa0-58e0e1a17f5d tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b6fbcef9-b510-4a37-a9fd-6e51ae5fca6d" returned: 0 in 0.274s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:12 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-60e0c7d3-ae5c-45d7-8fa0-58e0e1a17f5d tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] <== create_volume: return (820ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:42:12 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-60e0c7d3-ae5c-45d7-8fa0-58e0e1a17f5d tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.824s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:42:12 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-720ad958-8df1-4e7e-8874-6abbb6dfc8fc tempest-CreateVolumesFromSnapshotTest-1806966364 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.839s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:42:12 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-720ad958-8df1-4e7e-8874-6abbb6dfc8fc tempest-CreateVolumesFromSnapshotTest-1806966364 None] Creating offline snapshot e305f68b-1993-4de1-9908-a5a4983d8dc3 of volume 839c1e2a-1e7a-4ad6-a829-7624ecbe0348 {{(pid=94394) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 14:42:12 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-60e0c7d3-ae5c-45d7-8fa0-58e0e1a17f5d tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff20d540-37ed-4b5d-97a0-8accca63192b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6fbcef9-b510-4a37-a9fd-6e51ae5fca6d', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:12 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-60e0c7d3-ae5c-45d7-8fa0-58e0e1a17f5d tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5732e6c9-9ada-4679-9512-5ea7cf42bccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:12 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[3da59cfc-1406-475c-b727-b84c52dc5572]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:42:12 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-720ad958-8df1-4e7e-8874-6abbb6dfc8fc tempest-CreateVolumesFromSnapshotTest-1806966364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-839c1e2a-1e7a-4ad6-a829-7624ecbe0348 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:12 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-60e0c7d3-ae5c-45d7-8fa0-58e0e1a17f5d tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Volume volume-b6fbcef9-b510-4a37-a9fd-6e51ae5fca6d (b6fbcef9-b510-4a37-a9fd-6e51ae5fca6d): created successfully Aug 26 14:42:12 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-60e0c7d3-ae5c-45d7-8fa0-58e0e1a17f5d tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5732e6c9-9ada-4679-9512-5ea7cf42bccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:12 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-60e0c7d3-ae5c-45d7-8fa0-58e0e1a17f5d tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Flow 'volume_create_manager' (6d7ae4f7-b0dd-4c12-854f-152110838bb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:42:12 devstack sudo[113876]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:12 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-c0949813-9b61-4a1a-b78c-d5269b7ac00d tempest-CreateVolumesFromImageTest-1405516079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-8064a98c-8f08-4590-ac1b-944fe429895d" returned: 0 in 0.391s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:12 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-c0949813-9b61-4a1a-b78c-d5269b7ac00d tempest-CreateVolumesFromImageTest-1405516079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-8064a98c-8f08-4590-ac1b-944fe429895d {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:12 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-60e0c7d3-ae5c-45d7-8fa0-58e0e1a17f5d tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Created volume successfully. Aug 26 14:42:12 devstack sudo[113885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-8064a98c-8f08-4590-ac1b-944fe429895d Aug 26 14:42:12 devstack sudo[113885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:12 devstack sudo[113884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-839c1e2a-1e7a-4ad6-a829-7624ecbe0348 Aug 26 14:42:12 devstack sudo[113884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:12 devstack sudo[113885]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:12 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-c0949813-9b61-4a1a-b78c-d5269b7ac00d tempest-CreateVolumesFromImageTest-1405516079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-8064a98c-8f08-4590-ac1b-944fe429895d" returned: 0 in 0.271s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:12 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-c0949813-9b61-4a1a-b78c-d5269b7ac00d tempest-CreateVolumesFromImageTest-1405516079 None] Lock "cinder-quobyte-8064a98c-8f08-4590-ac1b-944fe429895d" released by "delete_volume" :: held 0.714s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:42:12 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-c0949813-9b61-4a1a-b78c-d5269b7ac00d tempest-CreateVolumesFromImageTest-1405516079 None] Created reservations ['9161114e-2a36-4403-925e-6203b85c9998', '976d3a33-766b-4bc1-9b50-2a4dbe13f532', '2365c3d4-d869-4eef-b3b7-4f592ad33e8a', 'c9aa6f13-68a5-43c5-8b1c-de40d3e37a95'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:42:12 devstack sudo[113884]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:12 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-720ad958-8df1-4e7e-8874-6abbb6dfc8fc tempest-CreateVolumesFromSnapshotTest-1806966364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-839c1e2a-1e7a-4ad6-a829-7624ecbe0348" returned: 0 in 0.388s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:12 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-720ad958-8df1-4e7e-8874-6abbb6dfc8fc tempest-CreateVolumesFromSnapshotTest-1806966364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-839c1e2a-1e7a-4ad6-a829-7624ecbe0348,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-839c1e2a-1e7a-4ad6-a829-7624ecbe0348.e305f68b-1993-4de1-9908-a5a4983d8dc3 1G {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:12 devstack sudo[113892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-839c1e2a-1e7a-4ad6-a829-7624ecbe0348,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-839c1e2a-1e7a-4ad6-a829-7624ecbe0348.e305f68b-1993-4de1-9908-a5a4983d8dc3 1G Aug 26 14:42:12 devstack sudo[113892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:13 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-c0949813-9b61-4a1a-b78c-d5269b7ac00d tempest-CreateVolumesFromImageTest-1405516079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:42:13 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-c0949813-9b61-4a1a-b78c-d5269b7ac00d tempest-CreateVolumesFromImageTest-1405516079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:42:13 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-c0949813-9b61-4a1a-b78c-d5269b7ac00d tempest-CreateVolumesFromImageTest-1405516079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:42:13 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-c0949813-9b61-4a1a-b78c-d5269b7ac00d tempest-CreateVolumesFromImageTest-1405516079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:42:13 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-c0949813-9b61-4a1a-b78c-d5269b7ac00d tempest-CreateVolumesFromImageTest-1405516079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:42:13 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-c0949813-9b61-4a1a-b78c-d5269b7ac00d tempest-CreateVolumesFromImageTest-1405516079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:13 devstack sudo[113894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:42:13 devstack sudo[113894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:13 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-66aa0873-defe-43a9-8d01-35cf5cfb5e5b tempest-CreateVolumesFromImageTest-1405516079 None] Acquiring lock "cinder-69002b7c-381c-4181-a82b-ba244e4543ee-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:42:13 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-66aa0873-defe-43a9-8d01-35cf5cfb5e5b tempest-CreateVolumesFromImageTest-1405516079 None] Lock "cinder-69002b7c-381c-4181-a82b-ba244e4543ee-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:42:13 devstack sudo[113894]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:13 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-c0949813-9b61-4a1a-b78c-d5269b7ac00d tempest-CreateVolumesFromImageTest-1405516079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.306s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:13 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-c0949813-9b61-4a1a-b78c-d5269b7ac00d tempest-CreateVolumesFromImageTest-1405516079 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:42:13 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-c0949813-9b61-4a1a-b78c-d5269b7ac00d tempest-CreateVolumesFromImageTest-1405516079 None] Deleted volume successfully. Aug 26 14:42:13 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-66aa0873-defe-43a9-8d01-35cf5cfb5e5b tempest-CreateVolumesFromImageTest-1405516079 None] Acquiring lock "cinder-quobyte-69002b7c-381c-4181-a82b-ba244e4543ee" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:42:13 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-c0949813-9b61-4a1a-b78c-d5269b7ac00d tempest-CreateVolumesFromImageTest-1405516079 None] Lock "cinder-8064a98c-8f08-4590-ac1b-944fe429895d-delete_volume" released by "delete_volume" :: held 1.271s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:42:13 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-66aa0873-defe-43a9-8d01-35cf5cfb5e5b tempest-CreateVolumesFromImageTest-1405516079 None] Lock "cinder-quobyte-69002b7c-381c-4181-a82b-ba244e4543ee" acquired by "delete_volume" :: waited 0.022s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:42:13 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[a27acb52-bc21-4b5e-a06f-1a4b356a1777]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:42:13 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-66aa0873-defe-43a9-8d01-35cf5cfb5e5b tempest-CreateVolumesFromImageTest-1405516079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-69002b7c-381c-4181-a82b-ba244e4543ee {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:13 devstack sudo[113892]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:13 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-720ad958-8df1-4e7e-8874-6abbb6dfc8fc tempest-CreateVolumesFromSnapshotTest-1806966364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-839c1e2a-1e7a-4ad6-a829-7624ecbe0348,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-839c1e2a-1e7a-4ad6-a829-7624ecbe0348.e305f68b-1993-4de1-9908-a5a4983d8dc3 1G" returned: 0 in 0.532s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:13 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-720ad958-8df1-4e7e-8874-6abbb6dfc8fc tempest-CreateVolumesFromSnapshotTest-1806966364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-839c1e2a-1e7a-4ad6-a829-7624ecbe0348 -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-839c1e2a-1e7a-4ad6-a829-7624ecbe0348.e305f68b-1993-4de1-9908-a5a4983d8dc3 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:13 devstack sudo[113901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-839c1e2a-1e7a-4ad6-a829-7624ecbe0348 -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-839c1e2a-1e7a-4ad6-a829-7624ecbe0348.e305f68b-1993-4de1-9908-a5a4983d8dc3 Aug 26 14:42:13 devstack sudo[113901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:13 devstack sudo[113900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-69002b7c-381c-4181-a82b-ba244e4543ee Aug 26 14:42:13 devstack sudo[113900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:13 devstack sudo[113901]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:13 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-720ad958-8df1-4e7e-8874-6abbb6dfc8fc tempest-CreateVolumesFromSnapshotTest-1806966364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-839c1e2a-1e7a-4ad6-a829-7624ecbe0348 -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-839c1e2a-1e7a-4ad6-a829-7624ecbe0348.e305f68b-1993-4de1-9908-a5a4983d8dc3" returned: 0 in 0.304s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:13 devstack cinder-volume[94394]: WARNING cinder.volume.drivers.remotefs [None req-720ad958-8df1-4e7e-8874-6abbb6dfc8fc tempest-CreateVolumesFromSnapshotTest-1806966364 None] /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-839c1e2a-1e7a-4ad6-a829-7624ecbe0348.e305f68b-1993-4de1-9908-a5a4983d8dc3 is being set with open permissions: ugo+rw Aug 26 14:42:13 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-720ad958-8df1-4e7e-8874-6abbb6dfc8fc tempest-CreateVolumesFromSnapshotTest-1806966364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-839c1e2a-1e7a-4ad6-a829-7624ecbe0348.e305f68b-1993-4de1-9908-a5a4983d8dc3 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:13 devstack sudo[113900]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:13 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-66aa0873-defe-43a9-8d01-35cf5cfb5e5b tempest-CreateVolumesFromImageTest-1405516079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-69002b7c-381c-4181-a82b-ba244e4543ee" returned: 0 in 0.403s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:13 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-66aa0873-defe-43a9-8d01-35cf5cfb5e5b tempest-CreateVolumesFromImageTest-1405516079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-69002b7c-381c-4181-a82b-ba244e4543ee {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:13 devstack sudo[113910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-839c1e2a-1e7a-4ad6-a829-7624ecbe0348.e305f68b-1993-4de1-9908-a5a4983d8dc3 Aug 26 14:42:13 devstack sudo[113910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:13 devstack sudo[113912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-69002b7c-381c-4181-a82b-ba244e4543ee Aug 26 14:42:13 devstack sudo[113912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:14 devstack sudo[113910]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:14 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-720ad958-8df1-4e7e-8874-6abbb6dfc8fc tempest-CreateVolumesFromSnapshotTest-1806966364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-839c1e2a-1e7a-4ad6-a829-7624ecbe0348.e305f68b-1993-4de1-9908-a5a4983d8dc3" returned: 0 in 0.247s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:14 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-720ad958-8df1-4e7e-8874-6abbb6dfc8fc tempest-CreateVolumesFromSnapshotTest-1806966364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-839c1e2a-1e7a-4ad6-a829-7624ecbe0348.info {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:14 devstack sudo[113912]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:14 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-66aa0873-defe-43a9-8d01-35cf5cfb5e5b tempest-CreateVolumesFromImageTest-1405516079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-69002b7c-381c-4181-a82b-ba244e4543ee" returned: 0 in 0.269s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:14 devstack sudo[113916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-839c1e2a-1e7a-4ad6-a829-7624ecbe0348.info Aug 26 14:42:14 devstack sudo[113916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:14 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-66aa0873-defe-43a9-8d01-35cf5cfb5e5b tempest-CreateVolumesFromImageTest-1405516079 None] Lock "cinder-quobyte-69002b7c-381c-4181-a82b-ba244e4543ee" released by "delete_volume" :: held 0.716s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:42:14 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-66aa0873-defe-43a9-8d01-35cf5cfb5e5b tempest-CreateVolumesFromImageTest-1405516079 None] Created reservations ['4c717701-7e36-4ffe-b0d7-4b1dc16c448e', '1afd7d05-b778-4c70-861f-f82e9a7de14a', 'a4c409a5-e9b3-4771-a525-b571d883b1f9', '90a07e5e-25ef-43af-97c7-b1ecbc1a16a3'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:42:14 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-66aa0873-defe-43a9-8d01-35cf5cfb5e5b tempest-CreateVolumesFromImageTest-1405516079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:42:14 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-66aa0873-defe-43a9-8d01-35cf5cfb5e5b tempest-CreateVolumesFromImageTest-1405516079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:42:14 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-66aa0873-defe-43a9-8d01-35cf5cfb5e5b tempest-CreateVolumesFromImageTest-1405516079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:42:14 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-66aa0873-defe-43a9-8d01-35cf5cfb5e5b tempest-CreateVolumesFromImageTest-1405516079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:42:14 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-66aa0873-defe-43a9-8d01-35cf5cfb5e5b tempest-CreateVolumesFromImageTest-1405516079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:42:14 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-66aa0873-defe-43a9-8d01-35cf5cfb5e5b tempest-CreateVolumesFromImageTest-1405516079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:14 devstack sudo[113918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:42:14 devstack sudo[113918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:14 devstack sudo[113916]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:14 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-720ad958-8df1-4e7e-8874-6abbb6dfc8fc tempest-CreateVolumesFromSnapshotTest-1806966364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-839c1e2a-1e7a-4ad6-a829-7624ecbe0348.info" returned: 0 in 0.273s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:14 devstack cinder-volume[94394]: WARNING cinder.volume.drivers.remotefs [None req-720ad958-8df1-4e7e-8874-6abbb6dfc8fc tempest-CreateVolumesFromSnapshotTest-1806966364 None] /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-839c1e2a-1e7a-4ad6-a829-7624ecbe0348.info is being set with open permissions: ugo+rw Aug 26 14:42:14 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-720ad958-8df1-4e7e-8874-6abbb6dfc8fc tempest-CreateVolumesFromSnapshotTest-1806966364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-839c1e2a-1e7a-4ad6-a829-7624ecbe0348.info {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:14 devstack sudo[113921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-839c1e2a-1e7a-4ad6-a829-7624ecbe0348.info Aug 26 14:42:14 devstack sudo[113921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:14 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-0d34cab7-f6b8-4e6d-a404-e7a6c00316ef tempest-CreateVolumesFromImageTest-1405516079 None] Acquiring lock "cinder-0a1948b7-da6a-488a-8405-e08629bb613e-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:42:14 devstack sudo[113918]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:14 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-66aa0873-defe-43a9-8d01-35cf5cfb5e5b tempest-CreateVolumesFromImageTest-1405516079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.270s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:14 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-66aa0873-defe-43a9-8d01-35cf5cfb5e5b tempest-CreateVolumesFromImageTest-1405516079 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:42:14 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-0d34cab7-f6b8-4e6d-a404-e7a6c00316ef tempest-CreateVolumesFromImageTest-1405516079 None] Lock "cinder-0a1948b7-da6a-488a-8405-e08629bb613e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:42:14 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-66aa0873-defe-43a9-8d01-35cf5cfb5e5b tempest-CreateVolumesFromImageTest-1405516079 None] Deleted volume successfully. Aug 26 14:42:14 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-66aa0873-defe-43a9-8d01-35cf5cfb5e5b tempest-CreateVolumesFromImageTest-1405516079 None] Lock "cinder-69002b7c-381c-4181-a82b-ba244e4543ee-delete_volume" released by "delete_volume" :: held 1.229s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:42:14 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-0d34cab7-f6b8-4e6d-a404-e7a6c00316ef tempest-CreateVolumesFromImageTest-1405516079 None] Acquiring lock "cinder-quobyte-0a1948b7-da6a-488a-8405-e08629bb613e" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:42:14 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-0d34cab7-f6b8-4e6d-a404-e7a6c00316ef tempest-CreateVolumesFromImageTest-1405516079 None] Lock "cinder-quobyte-0a1948b7-da6a-488a-8405-e08629bb613e" acquired by "delete_volume" :: waited 0.016s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:42:14 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[edb46971-0fd2-4f3c-83d9-f327ceb1a24f]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:42:14 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-0d34cab7-f6b8-4e6d-a404-e7a6c00316ef tempest-CreateVolumesFromImageTest-1405516079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0a1948b7-da6a-488a-8405-e08629bb613e {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:14 devstack sudo[113921]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:14 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-720ad958-8df1-4e7e-8874-6abbb6dfc8fc tempest-CreateVolumesFromSnapshotTest-1806966364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-839c1e2a-1e7a-4ad6-a829-7624ecbe0348.info" returned: 0 in 0.322s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:14 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-720ad958-8df1-4e7e-8874-6abbb6dfc8fc tempest-CreateVolumesFromSnapshotTest-1806966364 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.168s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:42:14 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-935ddeec-ff30-4e76-9f63-4aa151e23898 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.685s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:42:14 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-935ddeec-ff30-4e76-9f63-4aa151e23898 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:42:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2044543171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77b2975a-84db-4582-8906-46392d1c8022,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e20f015f2e54f39a25d8e4fb8bffa56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:42:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:42:09Z,use_quota=True,user_id='3b4abd77b9b346faa86977c51283196d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:42:14 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-935ddeec-ff30-4e76-9f63-4aa151e23898 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Creating volume 77b2975a-84db-4582-8906-46392d1c8022 {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:42:14 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-935ddeec-ff30-4e76-9f63-4aa151e23898 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:42:14 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-935ddeec-ff30-4e76-9f63-4aa151e23898 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:42:14 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-935ddeec-ff30-4e76-9f63-4aa151e23898 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:42:14 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-935ddeec-ff30-4e76-9f63-4aa151e23898 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:42:14 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-935ddeec-ff30-4e76-9f63-4aa151e23898 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:42:14 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-935ddeec-ff30-4e76-9f63-4aa151e23898 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:42:14 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-935ddeec-ff30-4e76-9f63-4aa151e23898 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:42:14 devstack sudo[113924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0a1948b7-da6a-488a-8405-e08629bb613e Aug 26 14:42:14 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-935ddeec-ff30-4e76-9f63-4aa151e23898 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-77b2975a-84db-4582-8906-46392d1c8022 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:14 devstack sudo[113924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:14 devstack sudo[113927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-77b2975a-84db-4582-8906-46392d1c8022 1073741824 Aug 26 14:42:14 devstack sudo[113927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:14 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-720ad958-8df1-4e7e-8874-6abbb6dfc8fc tempest-CreateVolumesFromSnapshotTest-1806966364 None] Create snapshot completed successfully Aug 26 14:42:14 devstack sudo[113924]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:14 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-0d34cab7-f6b8-4e6d-a404-e7a6c00316ef tempest-CreateVolumesFromImageTest-1405516079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0a1948b7-da6a-488a-8405-e08629bb613e" returned: 0 in 0.396s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:14 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-0d34cab7-f6b8-4e6d-a404-e7a6c00316ef tempest-CreateVolumesFromImageTest-1405516079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0a1948b7-da6a-488a-8405-e08629bb613e {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:15 devstack sudo[113935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0a1948b7-da6a-488a-8405-e08629bb613e Aug 26 14:42:15 devstack sudo[113935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:15 devstack sudo[113927]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:15 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-935ddeec-ff30-4e76-9f63-4aa151e23898 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-77b2975a-84db-4582-8906-46392d1c8022 1073741824" returned: 0 in 0.442s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:15 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-935ddeec-ff30-4e76-9f63-4aa151e23898 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-77b2975a-84db-4582-8906-46392d1c8022 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:15 devstack sudo[113938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-77b2975a-84db-4582-8906-46392d1c8022 Aug 26 14:42:15 devstack sudo[113938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:15 devstack sudo[113935]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:15 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-0d34cab7-f6b8-4e6d-a404-e7a6c00316ef tempest-CreateVolumesFromImageTest-1405516079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-0a1948b7-da6a-488a-8405-e08629bb613e" returned: 0 in 0.266s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:15 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-0d34cab7-f6b8-4e6d-a404-e7a6c00316ef tempest-CreateVolumesFromImageTest-1405516079 None] Lock "cinder-quobyte-0a1948b7-da6a-488a-8405-e08629bb613e" released by "delete_volume" :: held 0.710s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:42:15 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-0d34cab7-f6b8-4e6d-a404-e7a6c00316ef tempest-CreateVolumesFromImageTest-1405516079 None] Created reservations ['5ba22074-49e7-4de6-b6d6-28f006fe38c6', '3a959688-f4f6-4896-bda7-cefa1be2eb84', 'a0639b32-b73a-49c9-b607-ab93fa42c703', 'ff0181d2-eb91-4a90-b0d3-2d68d00f7f22'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:42:15 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-0d34cab7-f6b8-4e6d-a404-e7a6c00316ef tempest-CreateVolumesFromImageTest-1405516079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:42:15 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-0d34cab7-f6b8-4e6d-a404-e7a6c00316ef tempest-CreateVolumesFromImageTest-1405516079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:42:15 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-0d34cab7-f6b8-4e6d-a404-e7a6c00316ef tempest-CreateVolumesFromImageTest-1405516079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:42:15 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-0d34cab7-f6b8-4e6d-a404-e7a6c00316ef tempest-CreateVolumesFromImageTest-1405516079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:42:15 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-0d34cab7-f6b8-4e6d-a404-e7a6c00316ef tempest-CreateVolumesFromImageTest-1405516079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:42:15 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-0d34cab7-f6b8-4e6d-a404-e7a6c00316ef tempest-CreateVolumesFromImageTest-1405516079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:15 devstack sudo[113942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:42:15 devstack sudo[113942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:15 devstack sudo[113938]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:15 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-935ddeec-ff30-4e76-9f63-4aa151e23898 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-77b2975a-84db-4582-8906-46392d1c8022" returned: 0 in 0.253s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:15 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-935ddeec-ff30-4e76-9f63-4aa151e23898 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] <== create_volume: return (739ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:42:15 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-935ddeec-ff30-4e76-9f63-4aa151e23898 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.743s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:42:15 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-826d8794-a37c-47fb-8473-e08f2dbb5769 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.273s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:42:15 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-826d8794-a37c-47fb-8473-e08f2dbb5769 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:42:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-309368768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53d48e12-9d67-4952-b2a8-1a037efb1934,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e20f015f2e54f39a25d8e4fb8bffa56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:42:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:42:09Z,use_quota=True,user_id='3b4abd77b9b346faa86977c51283196d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:42:15 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-826d8794-a37c-47fb-8473-e08f2dbb5769 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Creating volume 53d48e12-9d67-4952-b2a8-1a037efb1934 {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:42:15 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-826d8794-a37c-47fb-8473-e08f2dbb5769 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:42:15 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-826d8794-a37c-47fb-8473-e08f2dbb5769 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:42:15 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-826d8794-a37c-47fb-8473-e08f2dbb5769 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:42:15 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-826d8794-a37c-47fb-8473-e08f2dbb5769 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:42:15 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-826d8794-a37c-47fb-8473-e08f2dbb5769 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:42:15 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-826d8794-a37c-47fb-8473-e08f2dbb5769 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:42:15 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-826d8794-a37c-47fb-8473-e08f2dbb5769 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:42:15 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-826d8794-a37c-47fb-8473-e08f2dbb5769 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-53d48e12-9d67-4952-b2a8-1a037efb1934 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:15 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-935ddeec-ff30-4e76-9f63-4aa151e23898 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46453b96-3c26-4ff7-b493-9d1a51aa26c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77b2975a-84db-4582-8906-46392d1c8022', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:15 devstack sudo[113944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-53d48e12-9d67-4952-b2a8-1a037efb1934 1073741824 Aug 26 14:42:15 devstack sudo[113944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:15 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-935ddeec-ff30-4e76-9f63-4aa151e23898 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b9210ac-2b79-4f0d-84ba-cd90c753dad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:15 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-935ddeec-ff30-4e76-9f63-4aa151e23898 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Volume volume-77b2975a-84db-4582-8906-46392d1c8022 (77b2975a-84db-4582-8906-46392d1c8022): created successfully Aug 26 14:42:15 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-935ddeec-ff30-4e76-9f63-4aa151e23898 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b9210ac-2b79-4f0d-84ba-cd90c753dad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:15 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-935ddeec-ff30-4e76-9f63-4aa151e23898 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Flow 'volume_create_manager' (82bf3632-16cb-4fc6-9ca7-8eeac6e4a3d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:42:15 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-935ddeec-ff30-4e76-9f63-4aa151e23898 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Created volume successfully. Aug 26 14:42:15 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-5bd837af-59e3-4992-a821-cf27e82f8020 tempest-CreateVolumesFromImageTest-1405516079 None] Acquiring lock "cinder-3daa48c1-76cf-43ab-8870-e61fd1500853-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:42:15 devstack sudo[113942]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:15 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-0d34cab7-f6b8-4e6d-a404-e7a6c00316ef tempest-CreateVolumesFromImageTest-1405516079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.282s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:15 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-0d34cab7-f6b8-4e6d-a404-e7a6c00316ef tempest-CreateVolumesFromImageTest-1405516079 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:42:15 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-0d34cab7-f6b8-4e6d-a404-e7a6c00316ef tempest-CreateVolumesFromImageTest-1405516079 None] Deleted volume successfully. Aug 26 14:42:15 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-5bd837af-59e3-4992-a821-cf27e82f8020 tempest-CreateVolumesFromImageTest-1405516079 None] Lock "cinder-3daa48c1-76cf-43ab-8870-e61fd1500853-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:42:15 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-0d34cab7-f6b8-4e6d-a404-e7a6c00316ef tempest-CreateVolumesFromImageTest-1405516079 None] Lock "cinder-0a1948b7-da6a-488a-8405-e08629bb613e-delete_volume" released by "delete_volume" :: held 1.249s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:42:15 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-5bd837af-59e3-4992-a821-cf27e82f8020 tempest-CreateVolumesFromImageTest-1405516079 None] Acquiring lock "cinder-quobyte-3daa48c1-76cf-43ab-8870-e61fd1500853" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:42:15 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-5bd837af-59e3-4992-a821-cf27e82f8020 tempest-CreateVolumesFromImageTest-1405516079 None] Lock "cinder-quobyte-3daa48c1-76cf-43ab-8870-e61fd1500853" acquired by "delete_volume" :: waited 0.028s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:42:15 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e79f36f-b7cf-44bf-b226-64dabad3da84]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:42:15 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-5bd837af-59e3-4992-a821-cf27e82f8020 tempest-CreateVolumesFromImageTest-1405516079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3daa48c1-76cf-43ab-8870-e61fd1500853 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:15 devstack sudo[113950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3daa48c1-76cf-43ab-8870-e61fd1500853 Aug 26 14:42:15 devstack sudo[113950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:15 devstack sudo[113944]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:15 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-826d8794-a37c-47fb-8473-e08f2dbb5769 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-53d48e12-9d67-4952-b2a8-1a037efb1934 1073741824" returned: 0 in 0.517s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:16 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-826d8794-a37c-47fb-8473-e08f2dbb5769 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-53d48e12-9d67-4952-b2a8-1a037efb1934 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:16 devstack sudo[113952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-53d48e12-9d67-4952-b2a8-1a037efb1934 Aug 26 14:42:16 devstack sudo[113952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:16 devstack sudo[113950]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:16 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-5bd837af-59e3-4992-a821-cf27e82f8020 tempest-CreateVolumesFromImageTest-1405516079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3daa48c1-76cf-43ab-8870-e61fd1500853" returned: 0 in 0.404s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:16 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-5bd837af-59e3-4992-a821-cf27e82f8020 tempest-CreateVolumesFromImageTest-1405516079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3daa48c1-76cf-43ab-8870-e61fd1500853 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:16 devstack sudo[113957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3daa48c1-76cf-43ab-8870-e61fd1500853 Aug 26 14:42:16 devstack sudo[113957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:16 devstack sudo[113952]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:16 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-826d8794-a37c-47fb-8473-e08f2dbb5769 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-53d48e12-9d67-4952-b2a8-1a037efb1934" returned: 0 in 0.297s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:16 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-826d8794-a37c-47fb-8473-e08f2dbb5769 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] <== create_volume: return (863ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:42:16 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-826d8794-a37c-47fb-8473-e08f2dbb5769 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.866s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:42:16 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-625b80d1-d31a-421e-a3ff-42a1df8f3a6b tempest-VolumeAndVolumeTypeFromImageTest-876346826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.254s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:42:16 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-625b80d1-d31a-421e-a3ff-42a1df8f3a6b tempest-VolumeAndVolumeTypeFromImageTest-876346826 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:42:07Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02ec04f8-e1b7-4264-aa85-d20e56bc0582,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb7400886bc54470aefdeae7e5c6085a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:42:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:42:07Z,use_quota=True,user_id='07494e6890fc4c879dcad06f2f657168',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e8adf1e-ecb7-49d2-98da-5956312451cd),volume_type_id=1e8adf1e-ecb7-49d2-98da-5956312451cd)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:42:16 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-625b80d1-d31a-421e-a3ff-42a1df8f3a6b tempest-VolumeAndVolumeTypeFromImageTest-876346826 None] Creating volume 02ec04f8-e1b7-4264-aa85-d20e56bc0582 {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:42:16 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-625b80d1-d31a-421e-a3ff-42a1df8f3a6b tempest-VolumeAndVolumeTypeFromImageTest-876346826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:42:16 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-625b80d1-d31a-421e-a3ff-42a1df8f3a6b tempest-VolumeAndVolumeTypeFromImageTest-876346826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:42:16 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-625b80d1-d31a-421e-a3ff-42a1df8f3a6b tempest-VolumeAndVolumeTypeFromImageTest-876346826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:42:16 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-625b80d1-d31a-421e-a3ff-42a1df8f3a6b tempest-VolumeAndVolumeTypeFromImageTest-876346826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:42:16 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-625b80d1-d31a-421e-a3ff-42a1df8f3a6b tempest-VolumeAndVolumeTypeFromImageTest-876346826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:42:16 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-625b80d1-d31a-421e-a3ff-42a1df8f3a6b tempest-VolumeAndVolumeTypeFromImageTest-876346826 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:42:16 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-625b80d1-d31a-421e-a3ff-42a1df8f3a6b tempest-VolumeAndVolumeTypeFromImageTest-876346826 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:42:16 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-625b80d1-d31a-421e-a3ff-42a1df8f3a6b tempest-VolumeAndVolumeTypeFromImageTest-876346826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-02ec04f8-e1b7-4264-aa85-d20e56bc0582 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:16 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-826d8794-a37c-47fb-8473-e08f2dbb5769 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06fdeb47-4941-421a-b362-7097dbbfee1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53d48e12-9d67-4952-b2a8-1a037efb1934', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:16 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-826d8794-a37c-47fb-8473-e08f2dbb5769 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6e7a2c3-9d79-421d-bf09-7bd91b0bedcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:16 devstack sudo[113960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-02ec04f8-e1b7-4264-aa85-d20e56bc0582 1073741824 Aug 26 14:42:16 devstack sudo[113960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:16 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-826d8794-a37c-47fb-8473-e08f2dbb5769 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Volume volume-53d48e12-9d67-4952-b2a8-1a037efb1934 (53d48e12-9d67-4952-b2a8-1a037efb1934): created successfully Aug 26 14:42:16 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-826d8794-a37c-47fb-8473-e08f2dbb5769 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6e7a2c3-9d79-421d-bf09-7bd91b0bedcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:16 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-826d8794-a37c-47fb-8473-e08f2dbb5769 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Flow 'volume_create_manager' (a76d500d-c65a-473c-a05b-3447ef59957d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:42:16 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a055dbe-3c86-4c8d-bc2f-c8e4c99730be tempest-CreateVolumesFromSnapshotTest-1806966364 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:42:16 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-9a055dbe-3c86-4c8d-bc2f-c8e4c99730be tempest-CreateVolumesFromSnapshotTest-1806966364 None] Flow 'volume_create_manager' (28b36f57-1bb4-46e1-8857-fab4e6bddd2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:42:16 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-9a055dbe-3c86-4c8d-bc2f-c8e4c99730be tempest-CreateVolumesFromSnapshotTest-1806966364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93f5b3b1-6079-45a2-be09-87c4e501a1d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:16 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-9a055dbe-3c86-4c8d-bc2f-c8e4c99730be tempest-CreateVolumesFromSnapshotTest-1806966364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93f5b3b1-6079-45a2-be09-87c4e501a1d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:42:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1850096238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2828911c-4fbd-4677-be7e-a8069766c95d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec8f26288b124661a14ab7719680c9d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:42:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:42:16Z,use_quota=True,user_id='aeeb1907462d4a7c9669bb590fc4a260',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:16 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-9a055dbe-3c86-4c8d-bc2f-c8e4c99730be tempest-CreateVolumesFromSnapshotTest-1806966364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (966b4f65-a2c9-466f-a379-895e8b6a3a66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:16 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-9a055dbe-3c86-4c8d-bc2f-c8e4c99730be tempest-CreateVolumesFromSnapshotTest-1806966364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (966b4f65-a2c9-466f-a379-895e8b6a3a66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:16 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-9a055dbe-3c86-4c8d-bc2f-c8e4c99730be tempest-CreateVolumesFromSnapshotTest-1806966364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a39dff41-8340-448a-b657-8459fc1a2a95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:16 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-9a055dbe-3c86-4c8d-bc2f-c8e4c99730be tempest-CreateVolumesFromSnapshotTest-1806966364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a39dff41-8340-448a-b657-8459fc1a2a95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2828911c-4fbd-4677-be7e-a8069766c95d', 'volume_name': 'volume-2828911c-4fbd-4677-be7e-a8069766c95d', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:16 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-9a055dbe-3c86-4c8d-bc2f-c8e4c99730be tempest-CreateVolumesFromSnapshotTest-1806966364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45a932c3-bcfe-42f2-a085-9ca2acecae72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:16 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-9a055dbe-3c86-4c8d-bc2f-c8e4c99730be tempest-CreateVolumesFromSnapshotTest-1806966364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45a932c3-bcfe-42f2-a085-9ca2acecae72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:16 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-9a055dbe-3c86-4c8d-bc2f-c8e4c99730be tempest-CreateVolumesFromSnapshotTest-1806966364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbc66191-3ca4-4085-afd1-41c684000c70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:16 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-9a055dbe-3c86-4c8d-bc2f-c8e4c99730be tempest-CreateVolumesFromSnapshotTest-1806966364 None] Volume 2828911c-4fbd-4677-be7e-a8069766c95d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2828911c-4fbd-4677-be7e-a8069766c95d', 'volume_size': 1} Aug 26 14:42:16 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-9a055dbe-3c86-4c8d-bc2f-c8e4c99730be tempest-CreateVolumesFromSnapshotTest-1806966364 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:42:16 devstack sudo[113957]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:16 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-826d8794-a37c-47fb-8473-e08f2dbb5769 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Created volume successfully. Aug 26 14:42:16 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-5bd837af-59e3-4992-a821-cf27e82f8020 tempest-CreateVolumesFromImageTest-1405516079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3daa48c1-76cf-43ab-8870-e61fd1500853" returned: 0 in 0.374s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:16 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-5bd837af-59e3-4992-a821-cf27e82f8020 tempest-CreateVolumesFromImageTest-1405516079 None] Lock "cinder-quobyte-3daa48c1-76cf-43ab-8870-e61fd1500853" released by "delete_volume" :: held 0.822s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:42:16 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-5bd837af-59e3-4992-a821-cf27e82f8020 tempest-CreateVolumesFromImageTest-1405516079 None] Created reservations ['1fda3672-fa7d-464f-8d57-9adc5de83678', 'c3cfc70f-a2e4-4de3-bf95-ed0c3e542b0a', 'f16a8800-39de-4f2d-9ee7-6883319c0baf', '11ed88a1-d4bc-404b-a953-809e716586fa'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:42:16 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-5bd837af-59e3-4992-a821-cf27e82f8020 tempest-CreateVolumesFromImageTest-1405516079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:42:16 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-5bd837af-59e3-4992-a821-cf27e82f8020 tempest-CreateVolumesFromImageTest-1405516079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:42:16 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-5bd837af-59e3-4992-a821-cf27e82f8020 tempest-CreateVolumesFromImageTest-1405516079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:42:16 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-5bd837af-59e3-4992-a821-cf27e82f8020 tempest-CreateVolumesFromImageTest-1405516079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:42:16 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-5bd837af-59e3-4992-a821-cf27e82f8020 tempest-CreateVolumesFromImageTest-1405516079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:42:16 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-5bd837af-59e3-4992-a821-cf27e82f8020 tempest-CreateVolumesFromImageTest-1405516079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:16 devstack sudo[113967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:42:16 devstack sudo[113967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:16 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-30ca17ec-ee17-449f-b77b-89c82f3e9691 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:42:16 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-30ca17ec-ee17-449f-b77b-89c82f3e9691 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Flow 'volume_create_manager' (894fc62f-82aa-438a-a8d2-f7fe717d9217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:42:16 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-30ca17ec-ee17-449f-b77b-89c82f3e9691 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21e2b81e-4ed8-4ea3-8cc8-a41ca8ce0873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:16 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-30ca17ec-ee17-449f-b77b-89c82f3e9691 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21e2b81e-4ed8-4ea3-8cc8-a41ca8ce0873) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:42:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-567282885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5955fec-2901-4a15-b53d-a4cba7d81562,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec8f26288b124661a14ab7719680c9d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:42:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:42:17Z,use_quota=True,user_id='aeeb1907462d4a7c9669bb590fc4a260',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:16 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-30ca17ec-ee17-449f-b77b-89c82f3e9691 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c525e2a7-22cf-4c20-9475-dfb2551660b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:16 devstack sudo[113960]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:16 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-30ca17ec-ee17-449f-b77b-89c82f3e9691 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c525e2a7-22cf-4c20-9475-dfb2551660b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:17 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-30ca17ec-ee17-449f-b77b-89c82f3e9691 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c23525bd-64c1-4a0f-a5fa-773883727783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:17 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-30ca17ec-ee17-449f-b77b-89c82f3e9691 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c23525bd-64c1-4a0f-a5fa-773883727783) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5955fec-2901-4a15-b53d-a4cba7d81562', 'volume_name': 'volume-b5955fec-2901-4a15-b53d-a4cba7d81562', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:17 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-30ca17ec-ee17-449f-b77b-89c82f3e9691 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ecf9dbf-a84a-4443-86dd-184e3c3d0c11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:17 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-30ca17ec-ee17-449f-b77b-89c82f3e9691 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ecf9dbf-a84a-4443-86dd-184e3c3d0c11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:17 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-30ca17ec-ee17-449f-b77b-89c82f3e9691 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80e82cea-75ad-4739-87b3-d292daea4bbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:17 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-30ca17ec-ee17-449f-b77b-89c82f3e9691 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Volume b5955fec-2901-4a15-b53d-a4cba7d81562: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5955fec-2901-4a15-b53d-a4cba7d81562', 'volume_size': 1} Aug 26 14:42:17 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-30ca17ec-ee17-449f-b77b-89c82f3e9691 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:42:17 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-625b80d1-d31a-421e-a3ff-42a1df8f3a6b tempest-VolumeAndVolumeTypeFromImageTest-876346826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-02ec04f8-e1b7-4264-aa85-d20e56bc0582 1073741824" returned: 0 in 0.715s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:17 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-32e0cff2-c795-4cd5-be86-224cea316335 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Acquiring lock "cinder-53d48e12-9d67-4952-b2a8-1a037efb1934-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:42:17 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-625b80d1-d31a-421e-a3ff-42a1df8f3a6b tempest-VolumeAndVolumeTypeFromImageTest-876346826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-02ec04f8-e1b7-4264-aa85-d20e56bc0582 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:17 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-32e0cff2-c795-4cd5-be86-224cea316335 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Lock "cinder-53d48e12-9d67-4952-b2a8-1a037efb1934-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:42:17 devstack sudo[113972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-02ec04f8-e1b7-4264-aa85-d20e56bc0582 Aug 26 14:42:17 devstack sudo[113972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:17 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-32e0cff2-c795-4cd5-be86-224cea316335 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Acquiring lock "cinder-quobyte-53d48e12-9d67-4952-b2a8-1a037efb1934" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:42:17 devstack sudo[113967]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:17 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-5bd837af-59e3-4992-a821-cf27e82f8020 tempest-CreateVolumesFromImageTest-1405516079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.506s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:17 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-5bd837af-59e3-4992-a821-cf27e82f8020 tempest-CreateVolumesFromImageTest-1405516079 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:42:17 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-5bd837af-59e3-4992-a821-cf27e82f8020 tempest-CreateVolumesFromImageTest-1405516079 None] Deleted volume successfully. Aug 26 14:42:17 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-32e0cff2-c795-4cd5-be86-224cea316335 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Lock "cinder-quobyte-53d48e12-9d67-4952-b2a8-1a037efb1934" acquired by "delete_volume" :: waited 0.060s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:42:17 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d9345ab-15d5-4f4c-8c2a-3d5045fe3ceb]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:42:17 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-32e0cff2-c795-4cd5-be86-224cea316335 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-53d48e12-9d67-4952-b2a8-1a037efb1934 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:17 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-5bd837af-59e3-4992-a821-cf27e82f8020 tempest-CreateVolumesFromImageTest-1405516079 None] Lock "cinder-3daa48c1-76cf-43ab-8870-e61fd1500853-delete_volume" released by "delete_volume" :: held 1.705s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:42:17 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd502cf7-8e52-45d3-a879-36a3bbb215ec tempest-CreateVolumesFromSnapshotTest-1806966364 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:42:17 devstack sudo[113972]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:17 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-dd502cf7-8e52-45d3-a879-36a3bbb215ec tempest-CreateVolumesFromSnapshotTest-1806966364 None] Flow 'volume_create_manager' (8804ea97-6492-429e-8da8-48eab4d63aca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:42:17 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-dd502cf7-8e52-45d3-a879-36a3bbb215ec tempest-CreateVolumesFromSnapshotTest-1806966364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee4c90fd-bd57-48fd-99c8-8a2b0660cd65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:17 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-625b80d1-d31a-421e-a3ff-42a1df8f3a6b tempest-VolumeAndVolumeTypeFromImageTest-876346826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-02ec04f8-e1b7-4264-aa85-d20e56bc0582" returned: 0 in 0.415s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:17 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-625b80d1-d31a-421e-a3ff-42a1df8f3a6b tempest-VolumeAndVolumeTypeFromImageTest-876346826 None] <== create_volume: return (1228ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:42:17 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-625b80d1-d31a-421e-a3ff-42a1df8f3a6b tempest-VolumeAndVolumeTypeFromImageTest-876346826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.232s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:42:17 devstack sudo[113974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-53d48e12-9d67-4952-b2a8-1a037efb1934 Aug 26 14:42:17 devstack sudo[113974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:17 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-9a055dbe-3c86-4c8d-bc2f-c8e4c99730be tempest-CreateVolumesFromSnapshotTest-1806966364 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.009s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:42:17 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-9a055dbe-3c86-4c8d-bc2f-c8e4c99730be tempest-CreateVolumesFromSnapshotTest-1806966364 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:42:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1850096238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2828911c-4fbd-4677-be7e-a8069766c95d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec8f26288b124661a14ab7719680c9d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:42:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:42:16Z,use_quota=True,user_id='aeeb1907462d4a7c9669bb590fc4a260',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:42:17 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-9a055dbe-3c86-4c8d-bc2f-c8e4c99730be tempest-CreateVolumesFromSnapshotTest-1806966364 None] Creating volume 2828911c-4fbd-4677-be7e-a8069766c95d {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:42:17 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-9a055dbe-3c86-4c8d-bc2f-c8e4c99730be tempest-CreateVolumesFromSnapshotTest-1806966364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:42:17 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-9a055dbe-3c86-4c8d-bc2f-c8e4c99730be tempest-CreateVolumesFromSnapshotTest-1806966364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:42:17 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-9a055dbe-3c86-4c8d-bc2f-c8e4c99730be tempest-CreateVolumesFromSnapshotTest-1806966364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:42:17 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-9a055dbe-3c86-4c8d-bc2f-c8e4c99730be tempest-CreateVolumesFromSnapshotTest-1806966364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:42:17 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-9a055dbe-3c86-4c8d-bc2f-c8e4c99730be tempest-CreateVolumesFromSnapshotTest-1806966364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:42:17 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-9a055dbe-3c86-4c8d-bc2f-c8e4c99730be tempest-CreateVolumesFromSnapshotTest-1806966364 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:42:17 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-9a055dbe-3c86-4c8d-bc2f-c8e4c99730be tempest-CreateVolumesFromSnapshotTest-1806966364 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:42:17 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-9a055dbe-3c86-4c8d-bc2f-c8e4c99730be tempest-CreateVolumesFromSnapshotTest-1806966364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2828911c-4fbd-4677-be7e-a8069766c95d 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:17 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-dd502cf7-8e52-45d3-a879-36a3bbb215ec tempest-CreateVolumesFromSnapshotTest-1806966364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee4c90fd-bd57-48fd-99c8-8a2b0660cd65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:42:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-665136284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d977d131-dac7-45c8-b5e7-215ffa36391a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec8f26288b124661a14ab7719680c9d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:42:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:42:17Z,use_quota=True,user_id='aeeb1907462d4a7c9669bb590fc4a260',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:17 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-dd502cf7-8e52-45d3-a879-36a3bbb215ec tempest-CreateVolumesFromSnapshotTest-1806966364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30fcae0b-19a1-4efe-b243-9261b7158c0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:17 devstack sudo[113977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2828911c-4fbd-4677-be7e-a8069766c95d 1073741824 Aug 26 14:42:17 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-dd502cf7-8e52-45d3-a879-36a3bbb215ec tempest-CreateVolumesFromSnapshotTest-1806966364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30fcae0b-19a1-4efe-b243-9261b7158c0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:17 devstack sudo[113977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:17 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-dd502cf7-8e52-45d3-a879-36a3bbb215ec tempest-CreateVolumesFromSnapshotTest-1806966364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2f226f1-4f08-4f7a-981a-30c086b5e80d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:17 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-dd502cf7-8e52-45d3-a879-36a3bbb215ec tempest-CreateVolumesFromSnapshotTest-1806966364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2f226f1-4f08-4f7a-981a-30c086b5e80d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd977d131-dac7-45c8-b5e7-215ffa36391a', 'volume_name': 'volume-d977d131-dac7-45c8-b5e7-215ffa36391a', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:17 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-dd502cf7-8e52-45d3-a879-36a3bbb215ec tempest-CreateVolumesFromSnapshotTest-1806966364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b0c4ecb-8eba-4f0b-bd41-8533d50cbe2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:17 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-dd502cf7-8e52-45d3-a879-36a3bbb215ec tempest-CreateVolumesFromSnapshotTest-1806966364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b0c4ecb-8eba-4f0b-bd41-8533d50cbe2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:17 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-dd502cf7-8e52-45d3-a879-36a3bbb215ec tempest-CreateVolumesFromSnapshotTest-1806966364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e4e2d76-3649-4fc8-b578-02c081769042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:17 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-dd502cf7-8e52-45d3-a879-36a3bbb215ec tempest-CreateVolumesFromSnapshotTest-1806966364 None] Volume d977d131-dac7-45c8-b5e7-215ffa36391a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d977d131-dac7-45c8-b5e7-215ffa36391a', 'volume_size': 1} Aug 26 14:42:17 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-dd502cf7-8e52-45d3-a879-36a3bbb215ec tempest-CreateVolumesFromSnapshotTest-1806966364 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:42:17 devstack cinder-volume[94394]: DEBUG cinder.volume.volume_utils [None req-625b80d1-d31a-421e-a3ff-42a1df8f3a6b tempest-VolumeAndVolumeTypeFromImageTest-876346826 None] Attempting download of e0c61842-d9d9-4671-8dbb-7baaf946796e ((None, [{'url': 'file:///opt/stack/data/glance/images/e0c61842-d9d9-4671-8dbb-7baaf946796e', 'metadata': {}}])) to volume 02ec04f8-e1b7-4264-aa85-d20e56bc0582. {{(pid=94394) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 26 14:42:17 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[17961b04-b596-4b83-94e8-5bb526e23ac8]: (4, 'raw') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:42:17 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-625b80d1-d31a-421e-a3ff-42a1df8f3a6b tempest-VolumeAndVolumeTypeFromImageTest-876346826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e0c61842-d9d9-4671-8dbb-7baaf946796e_bomclpkb {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:17 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b4abca5-ad97-476f-a700-0ff00e14860f tempest-CreateVolumesFromSnapshotTest-1806966364 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:42:17 devstack sudo[113974]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:18 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-3b4abca5-ad97-476f-a700-0ff00e14860f tempest-CreateVolumesFromSnapshotTest-1806966364 None] Flow 'volume_create_manager' (1a1f9969-074a-4073-bea4-cb62ecc7d484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:42:18 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-3b4abca5-ad97-476f-a700-0ff00e14860f tempest-CreateVolumesFromSnapshotTest-1806966364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8e87527-30f6-49c8-ac62-89fa41bafaeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:18 devstack sudo[113979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e0c61842-d9d9-4671-8dbb-7baaf946796e_bomclpkb Aug 26 14:42:18 devstack sudo[113979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:18 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-32e0cff2-c795-4cd5-be86-224cea316335 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-53d48e12-9d67-4952-b2a8-1a037efb1934" returned: 0 in 0.658s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:18 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-32e0cff2-c795-4cd5-be86-224cea316335 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-53d48e12-9d67-4952-b2a8-1a037efb1934 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:18 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-3b4abca5-ad97-476f-a700-0ff00e14860f tempest-CreateVolumesFromSnapshotTest-1806966364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8e87527-30f6-49c8-ac62-89fa41bafaeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:42:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1684812803',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24dcecb2-7e7e-4d51-ba8d-b3fb574d60ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec8f26288b124661a14ab7719680c9d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:42:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:42:18Z,use_quota=True,user_id='aeeb1907462d4a7c9669bb590fc4a260',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:18 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-3b4abca5-ad97-476f-a700-0ff00e14860f tempest-CreateVolumesFromSnapshotTest-1806966364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0dd601a-7304-47eb-8067-fc2bedf41dc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:18 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-3b4abca5-ad97-476f-a700-0ff00e14860f tempest-CreateVolumesFromSnapshotTest-1806966364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0dd601a-7304-47eb-8067-fc2bedf41dc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:18 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-3b4abca5-ad97-476f-a700-0ff00e14860f tempest-CreateVolumesFromSnapshotTest-1806966364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c7c641b-a7b2-4646-b404-4e18610ecb37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:18 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-3b4abca5-ad97-476f-a700-0ff00e14860f tempest-CreateVolumesFromSnapshotTest-1806966364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c7c641b-a7b2-4646-b404-4e18610ecb37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24dcecb2-7e7e-4d51-ba8d-b3fb574d60ed', 'volume_name': 'volume-24dcecb2-7e7e-4d51-ba8d-b3fb574d60ed', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:18 devstack sudo[113986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-53d48e12-9d67-4952-b2a8-1a037efb1934 Aug 26 14:42:18 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-3b4abca5-ad97-476f-a700-0ff00e14860f tempest-CreateVolumesFromSnapshotTest-1806966364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb832c33-c900-47bb-af95-d882de89069a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:18 devstack sudo[113986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:18 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-3b4abca5-ad97-476f-a700-0ff00e14860f tempest-CreateVolumesFromSnapshotTest-1806966364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb832c33-c900-47bb-af95-d882de89069a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:18 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-3b4abca5-ad97-476f-a700-0ff00e14860f tempest-CreateVolumesFromSnapshotTest-1806966364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e26edf56-a069-47fa-8d83-86f0f65dfd79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:18 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-3b4abca5-ad97-476f-a700-0ff00e14860f tempest-CreateVolumesFromSnapshotTest-1806966364 None] Volume 24dcecb2-7e7e-4d51-ba8d-b3fb574d60ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24dcecb2-7e7e-4d51-ba8d-b3fb574d60ed', 'volume_size': 1} Aug 26 14:42:18 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-3b4abca5-ad97-476f-a700-0ff00e14860f tempest-CreateVolumesFromSnapshotTest-1806966364 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:42:18 devstack sudo[113979]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:18 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-625b80d1-d31a-421e-a3ff-42a1df8f3a6b tempest-VolumeAndVolumeTypeFromImageTest-876346826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e0c61842-d9d9-4671-8dbb-7baaf946796e_bomclpkb" returned: 0 in 0.541s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:18 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-625b80d1-d31a-421e-a3ff-42a1df8f3a6b tempest-VolumeAndVolumeTypeFromImageTest-876346826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e0c61842-d9d9-4671-8dbb-7baaf946796e_bomclpkb {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:18 devstack sudo[113977]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:18 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-9a055dbe-3c86-4c8d-bc2f-c8e4c99730be tempest-CreateVolumesFromSnapshotTest-1806966364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2828911c-4fbd-4677-be7e-a8069766c95d 1073741824" returned: 0 in 0.817s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:18 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-9a055dbe-3c86-4c8d-bc2f-c8e4c99730be tempest-CreateVolumesFromSnapshotTest-1806966364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2828911c-4fbd-4677-be7e-a8069766c95d {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:18 devstack sudo[113986]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:18 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-32e0cff2-c795-4cd5-be86-224cea316335 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-53d48e12-9d67-4952-b2a8-1a037efb1934" returned: 0 in 0.436s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:18 devstack sudo[113995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2828911c-4fbd-4677-be7e-a8069766c95d Aug 26 14:42:18 devstack sudo[113995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:18 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-32e0cff2-c795-4cd5-be86-224cea316335 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Lock "cinder-quobyte-53d48e12-9d67-4952-b2a8-1a037efb1934" released by "delete_volume" :: held 1.197s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:42:18 devstack sudo[113993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e0c61842-d9d9-4671-8dbb-7baaf946796e_bomclpkb Aug 26 14:42:18 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4511bf1-b09b-40ea-92f6-ae00495b1bb4 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:42:18 devstack sudo[113993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:18 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-f4511bf1-b09b-40ea-92f6-ae00495b1bb4 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Flow 'volume_create_manager' (04167281-fa44-4d20-946f-086342b115b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:42:18 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-f4511bf1-b09b-40ea-92f6-ae00495b1bb4 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41f555a0-39e5-4709-a2fc-207d43e84f7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:18 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-f4511bf1-b09b-40ea-92f6-ae00495b1bb4 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41f555a0-39e5-4709-a2fc-207d43e84f7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:42:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1917768735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3871c91d-8fb2-466b-ad1f-f4a3db95a1f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec8f26288b124661a14ab7719680c9d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:42:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:42:18Z,use_quota=True,user_id='aeeb1907462d4a7c9669bb590fc4a260',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:18 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-f4511bf1-b09b-40ea-92f6-ae00495b1bb4 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62264bf6-0eab-484f-8aff-2cf6ce53d701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:18 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-f4511bf1-b09b-40ea-92f6-ae00495b1bb4 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62264bf6-0eab-484f-8aff-2cf6ce53d701) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:18 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-f4511bf1-b09b-40ea-92f6-ae00495b1bb4 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87953aac-66e6-48a8-b198-770de00b6e7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:18 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-f4511bf1-b09b-40ea-92f6-ae00495b1bb4 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87953aac-66e6-48a8-b198-770de00b6e7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3871c91d-8fb2-466b-ad1f-f4a3db95a1f2', 'volume_name': 'volume-3871c91d-8fb2-466b-ad1f-f4a3db95a1f2', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:18 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-f4511bf1-b09b-40ea-92f6-ae00495b1bb4 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (794bd253-a311-450e-9576-db30c9be8b9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:18 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-f4511bf1-b09b-40ea-92f6-ae00495b1bb4 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (794bd253-a311-450e-9576-db30c9be8b9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:18 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-f4511bf1-b09b-40ea-92f6-ae00495b1bb4 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21535697-55fb-4d0b-8c2c-351e43145efb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:18 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-f4511bf1-b09b-40ea-92f6-ae00495b1bb4 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Volume 3871c91d-8fb2-466b-ad1f-f4a3db95a1f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3871c91d-8fb2-466b-ad1f-f4a3db95a1f2', 'volume_size': 1} Aug 26 14:42:18 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-f4511bf1-b09b-40ea-92f6-ae00495b1bb4 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:42:18 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-32e0cff2-c795-4cd5-be86-224cea316335 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Created reservations ['74913dd4-831f-4a34-b3ea-678d6f196750', '5077483b-e476-475f-ac22-e0b7685046dc', 'b8a963f7-e3da-487b-9bd1-43a41fce7039', '8b31a285-e109-426c-bebc-8614f9b089c2'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:42:18 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-32e0cff2-c795-4cd5-be86-224cea316335 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:42:18 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-32e0cff2-c795-4cd5-be86-224cea316335 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:42:18 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-32e0cff2-c795-4cd5-be86-224cea316335 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:42:18 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-32e0cff2-c795-4cd5-be86-224cea316335 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:42:18 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-32e0cff2-c795-4cd5-be86-224cea316335 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:42:18 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-32e0cff2-c795-4cd5-be86-224cea316335 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:18 devstack sudo[113995]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:18 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-9a055dbe-3c86-4c8d-bc2f-c8e4c99730be tempest-CreateVolumesFromSnapshotTest-1806966364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2828911c-4fbd-4677-be7e-a8069766c95d" returned: 0 in 0.325s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:18 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-9a055dbe-3c86-4c8d-bc2f-c8e4c99730be tempest-CreateVolumesFromSnapshotTest-1806966364 None] <== create_volume: return (1209ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:42:18 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-9a055dbe-3c86-4c8d-bc2f-c8e4c99730be tempest-CreateVolumesFromSnapshotTest-1806966364 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.213s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:42:18 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-30ca17ec-ee17-449f-b77b-89c82f3e9691 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.730s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:42:18 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-30ca17ec-ee17-449f-b77b-89c82f3e9691 tempest-CreateVolumesFromSnapshotTest-1806966364 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:42:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-567282885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5955fec-2901-4a15-b53d-a4cba7d81562,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec8f26288b124661a14ab7719680c9d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:42:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:42:17Z,use_quota=True,user_id='aeeb1907462d4a7c9669bb590fc4a260',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:42:18 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-30ca17ec-ee17-449f-b77b-89c82f3e9691 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Creating volume b5955fec-2901-4a15-b53d-a4cba7d81562 {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:42:18 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-30ca17ec-ee17-449f-b77b-89c82f3e9691 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:42:18 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-30ca17ec-ee17-449f-b77b-89c82f3e9691 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:42:18 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-30ca17ec-ee17-449f-b77b-89c82f3e9691 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:42:18 devstack sudo[113999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:42:18 devstack sudo[113999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:18 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-30ca17ec-ee17-449f-b77b-89c82f3e9691 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:42:18 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-30ca17ec-ee17-449f-b77b-89c82f3e9691 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:42:18 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-30ca17ec-ee17-449f-b77b-89c82f3e9691 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:42:18 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-30ca17ec-ee17-449f-b77b-89c82f3e9691 tempest-CreateVolumesFromSnapshotTest-1806966364 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:42:18 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-30ca17ec-ee17-449f-b77b-89c82f3e9691 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b5955fec-2901-4a15-b53d-a4cba7d81562 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:18 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-9a055dbe-3c86-4c8d-bc2f-c8e4c99730be tempest-CreateVolumesFromSnapshotTest-1806966364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbc66191-3ca4-4085-afd1-41c684000c70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2828911c-4fbd-4677-be7e-a8069766c95d', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:18 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-9a055dbe-3c86-4c8d-bc2f-c8e4c99730be tempest-CreateVolumesFromSnapshotTest-1806966364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51a670d9-703d-48b1-88a1-cd98b3e4ff57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:18 devstack sudo[114002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b5955fec-2901-4a15-b53d-a4cba7d81562 1073741824 Aug 26 14:42:18 devstack sudo[114002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:18 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-9a055dbe-3c86-4c8d-bc2f-c8e4c99730be tempest-CreateVolumesFromSnapshotTest-1806966364 None] Volume volume-2828911c-4fbd-4677-be7e-a8069766c95d (2828911c-4fbd-4677-be7e-a8069766c95d): created successfully Aug 26 14:42:18 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-9a055dbe-3c86-4c8d-bc2f-c8e4c99730be tempest-CreateVolumesFromSnapshotTest-1806966364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51a670d9-703d-48b1-88a1-cd98b3e4ff57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:18 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-9a055dbe-3c86-4c8d-bc2f-c8e4c99730be tempest-CreateVolumesFromSnapshotTest-1806966364 None] Flow 'volume_create_manager' (28b36f57-1bb4-46e1-8857-fab4e6bddd2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:42:18 devstack sudo[113993]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:18 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-625b80d1-d31a-421e-a3ff-42a1df8f3a6b tempest-VolumeAndVolumeTypeFromImageTest-876346826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e0c61842-d9d9-4671-8dbb-7baaf946796e_bomclpkb" returned: 1 in 0.520s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:18 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-625b80d1-d31a-421e-a3ff-42a1df8f3a6b tempest-VolumeAndVolumeTypeFromImageTest-876346826 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e0c61842-d9d9-4671-8dbb-7baaf946796e_bomclpkb' failed. Not Retrying. {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 14:42:18 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2dab865-6842-478d-8efb-109576b9a3ed]: (4, 'raw') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:42:18 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-625b80d1-d31a-421e-a3ff-42a1df8f3a6b tempest-VolumeAndVolumeTypeFromImageTest-876346826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e0c61842-d9d9-4671-8dbb-7baaf946796e_4881wcbwdevstack@QuobyteHD {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:18 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-9a055dbe-3c86-4c8d-bc2f-c8e4c99730be tempest-CreateVolumesFromSnapshotTest-1806966364 None] Created volume successfully. Aug 26 14:42:19 devstack sudo[114005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e0c61842-d9d9-4671-8dbb-7baaf946796e_4881wcbwdevstack@QuobyteHD Aug 26 14:42:19 devstack sudo[114005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:19 devstack sudo[113999]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:19 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-32e0cff2-c795-4cd5-be86-224cea316335 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.308s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:19 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-32e0cff2-c795-4cd5-be86-224cea316335 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:42:19 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-32e0cff2-c795-4cd5-be86-224cea316335 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Deleted volume successfully. Aug 26 14:42:19 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-32e0cff2-c795-4cd5-be86-224cea316335 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Lock "cinder-53d48e12-9d67-4952-b2a8-1a037efb1934-delete_volume" released by "delete_volume" :: held 1.935s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:42:19 devstack sudo[114005]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:19 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-625b80d1-d31a-421e-a3ff-42a1df8f3a6b tempest-VolumeAndVolumeTypeFromImageTest-876346826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e0c61842-d9d9-4671-8dbb-7baaf946796e_4881wcbwdevstack@QuobyteHD" returned: 0 in 0.468s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:19 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-625b80d1-d31a-421e-a3ff-42a1df8f3a6b tempest-VolumeAndVolumeTypeFromImageTest-876346826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e0c61842-d9d9-4671-8dbb-7baaf946796e_4881wcbwdevstack@QuobyteHD {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:19 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-d9d091d1-16b9-4b23-90a1-5556afa9a9cb tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Acquiring lock "cinder-77b2975a-84db-4582-8906-46392d1c8022-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:42:19 devstack sudo[114016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e0c61842-d9d9-4671-8dbb-7baaf946796e_4881wcbwdevstack@QuobyteHD Aug 26 14:42:19 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-d9d091d1-16b9-4b23-90a1-5556afa9a9cb tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Lock "cinder-77b2975a-84db-4582-8906-46392d1c8022-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:42:19 devstack sudo[114016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:19 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-d9d091d1-16b9-4b23-90a1-5556afa9a9cb tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Acquiring lock "cinder-quobyte-77b2975a-84db-4582-8906-46392d1c8022" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:42:19 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-d9d091d1-16b9-4b23-90a1-5556afa9a9cb tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Lock "cinder-quobyte-77b2975a-84db-4582-8906-46392d1c8022" acquired by "delete_volume" :: waited 0.020s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:42:19 devstack sudo[114002]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:19 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-30ca17ec-ee17-449f-b77b-89c82f3e9691 tempest-CreateVolumesFromSnapshotTest-1806966364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b5955fec-2901-4a15-b53d-a4cba7d81562 1073741824" returned: 0 in 0.797s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:19 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[62dd44e5-bb91-4525-a010-706fd7180264]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:42:19 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-d9d091d1-16b9-4b23-90a1-5556afa9a9cb tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-77b2975a-84db-4582-8906-46392d1c8022 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:19 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-30ca17ec-ee17-449f-b77b-89c82f3e9691 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b5955fec-2901-4a15-b53d-a4cba7d81562 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:19 devstack sudo[114019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b5955fec-2901-4a15-b53d-a4cba7d81562 Aug 26 14:42:19 devstack sudo[114019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:19 devstack sudo[114018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-77b2975a-84db-4582-8906-46392d1c8022 Aug 26 14:42:19 devstack sudo[114018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:19 devstack sudo[114016]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:19 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-625b80d1-d31a-421e-a3ff-42a1df8f3a6b tempest-VolumeAndVolumeTypeFromImageTest-876346826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e0c61842-d9d9-4671-8dbb-7baaf946796e_4881wcbwdevstack@QuobyteHD" returned: 1 in 0.398s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:19 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-625b80d1-d31a-421e-a3ff-42a1df8f3a6b tempest-VolumeAndVolumeTypeFromImageTest-876346826 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e0c61842-d9d9-4671-8dbb-7baaf946796e_4881wcbwdevstack@QuobyteHD' failed. Not Retrying. {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 14:42:19 devstack cinder-volume[94394]: DEBUG cinder.image.image_utils [None req-625b80d1-d31a-421e-a3ff-42a1df8f3a6b tempest-VolumeAndVolumeTypeFromImageTest-876346826 None] e0c61842-d9d9-4671-8dbb-7baaf946796e was raw, converting to qcow2 {{(pid=94394) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 26 14:42:19 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-625b80d1-d31a-421e-a3ff-42a1df8f3a6b tempest-VolumeAndVolumeTypeFromImageTest-876346826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e0c61842-d9d9-4671-8dbb-7baaf946796e_4881wcbwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-02ec04f8-e1b7-4264-aa85-d20e56bc0582 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:19 devstack sudo[114025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e0c61842-d9d9-4671-8dbb-7baaf946796e_4881wcbwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-02ec04f8-e1b7-4264-aa85-d20e56bc0582 Aug 26 14:42:19 devstack sudo[114025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:19 devstack sudo[114019]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:19 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-30ca17ec-ee17-449f-b77b-89c82f3e9691 tempest-CreateVolumesFromSnapshotTest-1806966364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b5955fec-2901-4a15-b53d-a4cba7d81562" returned: 0 in 0.289s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:19 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-30ca17ec-ee17-449f-b77b-89c82f3e9691 tempest-CreateVolumesFromSnapshotTest-1806966364 None] <== create_volume: return (1151ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:42:19 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-30ca17ec-ee17-449f-b77b-89c82f3e9691 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.155s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:42:19 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-dd502cf7-8e52-45d3-a879-36a3bbb215ec tempest-CreateVolumesFromSnapshotTest-1806966364 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.241s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:42:19 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-dd502cf7-8e52-45d3-a879-36a3bbb215ec tempest-CreateVolumesFromSnapshotTest-1806966364 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:42:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-665136284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d977d131-dac7-45c8-b5e7-215ffa36391a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec8f26288b124661a14ab7719680c9d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:42:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:42:17Z,use_quota=True,user_id='aeeb1907462d4a7c9669bb590fc4a260',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:42:19 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-dd502cf7-8e52-45d3-a879-36a3bbb215ec tempest-CreateVolumesFromSnapshotTest-1806966364 None] Creating volume d977d131-dac7-45c8-b5e7-215ffa36391a {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:42:19 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-dd502cf7-8e52-45d3-a879-36a3bbb215ec tempest-CreateVolumesFromSnapshotTest-1806966364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:42:19 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-dd502cf7-8e52-45d3-a879-36a3bbb215ec tempest-CreateVolumesFromSnapshotTest-1806966364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:42:19 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-dd502cf7-8e52-45d3-a879-36a3bbb215ec tempest-CreateVolumesFromSnapshotTest-1806966364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:42:19 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-dd502cf7-8e52-45d3-a879-36a3bbb215ec tempest-CreateVolumesFromSnapshotTest-1806966364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:42:19 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-dd502cf7-8e52-45d3-a879-36a3bbb215ec tempest-CreateVolumesFromSnapshotTest-1806966364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:42:19 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-dd502cf7-8e52-45d3-a879-36a3bbb215ec tempest-CreateVolumesFromSnapshotTest-1806966364 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:42:19 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-dd502cf7-8e52-45d3-a879-36a3bbb215ec tempest-CreateVolumesFromSnapshotTest-1806966364 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:42:19 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-dd502cf7-8e52-45d3-a879-36a3bbb215ec tempest-CreateVolumesFromSnapshotTest-1806966364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d977d131-dac7-45c8-b5e7-215ffa36391a 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:19 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-30ca17ec-ee17-449f-b77b-89c82f3e9691 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80e82cea-75ad-4739-87b3-d292daea4bbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5955fec-2901-4a15-b53d-a4cba7d81562', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:19 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-30ca17ec-ee17-449f-b77b-89c82f3e9691 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9bc3003-8ea6-4df7-9831-5468972e9a6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:19 devstack sudo[114030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d977d131-dac7-45c8-b5e7-215ffa36391a 1073741824 Aug 26 14:42:19 devstack sudo[114030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:19 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-30ca17ec-ee17-449f-b77b-89c82f3e9691 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Volume volume-b5955fec-2901-4a15-b53d-a4cba7d81562 (b5955fec-2901-4a15-b53d-a4cba7d81562): created successfully Aug 26 14:42:20 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-30ca17ec-ee17-449f-b77b-89c82f3e9691 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9bc3003-8ea6-4df7-9831-5468972e9a6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:20 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-30ca17ec-ee17-449f-b77b-89c82f3e9691 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Flow 'volume_create_manager' (894fc62f-82aa-438a-a8d2-f7fe717d9217) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:42:20 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-30ca17ec-ee17-449f-b77b-89c82f3e9691 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Created volume successfully. Aug 26 14:42:20 devstack sudo[114018]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:20 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-d9d091d1-16b9-4b23-90a1-5556afa9a9cb tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-77b2975a-84db-4582-8906-46392d1c8022" returned: 0 in 0.474s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:20 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-d9d091d1-16b9-4b23-90a1-5556afa9a9cb tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-77b2975a-84db-4582-8906-46392d1c8022 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:20 devstack sudo[114036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-77b2975a-84db-4582-8906-46392d1c8022 Aug 26 14:42:20 devstack sudo[114036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:20 devstack sudo[114025]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:20 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-625b80d1-d31a-421e-a3ff-42a1df8f3a6b tempest-VolumeAndVolumeTypeFromImageTest-876346826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e0c61842-d9d9-4671-8dbb-7baaf946796e_4881wcbwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-02ec04f8-e1b7-4264-aa85-d20e56bc0582" returned: 0 in 0.566s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:20 devstack cinder-volume[94394]: DEBUG cinder.image.image_utils [None req-625b80d1-d31a-421e-a3ff-42a1df8f3a6b tempest-VolumeAndVolumeTypeFromImageTest-876346826 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e0c61842-d9d9-4671-8dbb-7baaf946796e_4881wcbwdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-02ec04f8-e1b7-4264-aa85-d20e56bc0582 {{(pid=94394) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 14:42:20 devstack cinder-volume[94394]: INFO cinder.image.image_utils [None req-625b80d1-d31a-421e-a3ff-42a1df8f3a6b tempest-VolumeAndVolumeTypeFromImageTest-876346826 None] Converted 0.00 MB image at 0.00 MB/s Aug 26 14:42:20 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-625b80d1-d31a-421e-a3ff-42a1df8f3a6b tempest-VolumeAndVolumeTypeFromImageTest-876346826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-02ec04f8-e1b7-4264-aa85-d20e56bc0582 1G {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:20 devstack sudo[114042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-02ec04f8-e1b7-4264-aa85-d20e56bc0582 1G Aug 26 14:42:20 devstack sudo[114042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:20 devstack sudo[114036]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:20 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-d9d091d1-16b9-4b23-90a1-5556afa9a9cb tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-77b2975a-84db-4582-8906-46392d1c8022" returned: 0 in 0.368s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:20 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-d9d091d1-16b9-4b23-90a1-5556afa9a9cb tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Lock "cinder-quobyte-77b2975a-84db-4582-8906-46392d1c8022" released by "delete_volume" :: held 0.890s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:42:20 devstack sudo[114030]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:20 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-dd502cf7-8e52-45d3-a879-36a3bbb215ec tempest-CreateVolumesFromSnapshotTest-1806966364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d977d131-dac7-45c8-b5e7-215ffa36391a 1073741824" returned: 0 in 0.544s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:20 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-d9d091d1-16b9-4b23-90a1-5556afa9a9cb tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Created reservations ['41c48d22-3f49-4867-83eb-79aa20ea025b', '55cdabe5-8e90-482f-a753-bfb4991b1c6b', '2eba9b20-5b02-4c51-b6fd-4965541d24fa', '65d9a9da-e552-432a-b714-dfac48dbf0dc'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:42:20 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-dd502cf7-8e52-45d3-a879-36a3bbb215ec tempest-CreateVolumesFromSnapshotTest-1806966364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d977d131-dac7-45c8-b5e7-215ffa36391a {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:20 devstack sudo[114048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d977d131-dac7-45c8-b5e7-215ffa36391a Aug 26 14:42:20 devstack sudo[114048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:20 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-d9d091d1-16b9-4b23-90a1-5556afa9a9cb tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:42:20 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-d9d091d1-16b9-4b23-90a1-5556afa9a9cb tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:42:20 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-d9d091d1-16b9-4b23-90a1-5556afa9a9cb tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:42:20 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-d9d091d1-16b9-4b23-90a1-5556afa9a9cb tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:42:20 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-d9d091d1-16b9-4b23-90a1-5556afa9a9cb tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:42:20 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-d9d091d1-16b9-4b23-90a1-5556afa9a9cb tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:20 devstack sudo[114053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:42:20 devstack sudo[114053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:20 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-32bac5f6-1739-4303-9f5f-a7b0f0adfd35 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Acquiring lock "cinder-b6fbcef9-b510-4a37-a9fd-6e51ae5fca6d-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:42:20 devstack sudo[114042]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:20 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-625b80d1-d31a-421e-a3ff-42a1df8f3a6b tempest-VolumeAndVolumeTypeFromImageTest-876346826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-02ec04f8-e1b7-4264-aa85-d20e56bc0582 1G" returned: 0 in 0.478s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:20 devstack cinder-volume[94394]: DEBUG cinder.volume.volume_utils [None req-625b80d1-d31a-421e-a3ff-42a1df8f3a6b tempest-VolumeAndVolumeTypeFromImageTest-876346826 None] Downloaded image e0c61842-d9d9-4671-8dbb-7baaf946796e ((None, [{'url': 'file:///opt/stack/data/glance/images/e0c61842-d9d9-4671-8dbb-7baaf946796e', 'metadata': {}}])) to volume 02ec04f8-e1b7-4264-aa85-d20e56bc0582 successfully. {{(pid=94394) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 26 14:42:20 devstack cinder-volume[94394]: DEBUG cinder.image.image_utils [None req-625b80d1-d31a-421e-a3ff-42a1df8f3a6b tempest-VolumeAndVolumeTypeFromImageTest-876346826 None] Temporary image e0c61842-d9d9-4671-8dbb-7baaf946796e for user 07494e6890fc4c879dcad06f2f657168 is deleted. {{(pid=94394) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 26 14:42:20 devstack cinder-volume[94394]: DEBUG cinder.volume.volume_utils [None req-625b80d1-d31a-421e-a3ff-42a1df8f3a6b tempest-VolumeAndVolumeTypeFromImageTest-876346826 None] Marking volume 02ec04f8-e1b7-4264-aa85-d20e56bc0582 as bootable. {{(pid=94394) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 26 14:42:20 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-32bac5f6-1739-4303-9f5f-a7b0f0adfd35 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Lock "cinder-b6fbcef9-b510-4a37-a9fd-6e51ae5fca6d-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:42:20 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-625b80d1-d31a-421e-a3ff-42a1df8f3a6b tempest-VolumeAndVolumeTypeFromImageTest-876346826 None] Copying metadata from image e0c61842-d9d9-4671-8dbb-7baaf946796e to 02ec04f8-e1b7-4264-aa85-d20e56bc0582. {{(pid=94394) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 26 14:42:20 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-625b80d1-d31a-421e-a3ff-42a1df8f3a6b tempest-VolumeAndVolumeTypeFromImageTest-876346826 None] Creating volume glance metadata for volume 02ec04f8-e1b7-4264-aa85-d20e56bc0582 backed by image e0c61842-d9d9-4671-8dbb-7baaf946796e with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'e0c61842-d9d9-4671-8dbb-7baaf946796e', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '5a802481053f826d701e31b1fb3398e6', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=94394) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 26 14:42:20 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-32bac5f6-1739-4303-9f5f-a7b0f0adfd35 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Acquiring lock "cinder-quobyte-b6fbcef9-b510-4a37-a9fd-6e51ae5fca6d" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:42:20 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-32bac5f6-1739-4303-9f5f-a7b0f0adfd35 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Lock "cinder-quobyte-b6fbcef9-b510-4a37-a9fd-6e51ae5fca6d" acquired by "delete_volume" :: waited 0.026s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:42:20 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[333b5980-f75e-4699-8b81-ed8360dc3359]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:42:20 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-32bac5f6-1739-4303-9f5f-a7b0f0adfd35 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b6fbcef9-b510-4a37-a9fd-6e51ae5fca6d {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:20 devstack sudo[114048]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:20 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-dd502cf7-8e52-45d3-a879-36a3bbb215ec tempest-CreateVolumesFromSnapshotTest-1806966364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d977d131-dac7-45c8-b5e7-215ffa36391a" returned: 0 in 0.419s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:20 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-dd502cf7-8e52-45d3-a879-36a3bbb215ec tempest-CreateVolumesFromSnapshotTest-1806966364 None] <== create_volume: return (1030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:42:20 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-dd502cf7-8e52-45d3-a879-36a3bbb215ec tempest-CreateVolumesFromSnapshotTest-1806966364 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:42:20 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-3b4abca5-ad97-476f-a700-0ff00e14860f tempest-CreateVolumesFromSnapshotTest-1806966364 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.863s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:42:20 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-3b4abca5-ad97-476f-a700-0ff00e14860f tempest-CreateVolumesFromSnapshotTest-1806966364 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:42:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1684812803',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24dcecb2-7e7e-4d51-ba8d-b3fb574d60ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec8f26288b124661a14ab7719680c9d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:42:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:42:18Z,use_quota=True,user_id='aeeb1907462d4a7c9669bb590fc4a260',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:42:20 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-3b4abca5-ad97-476f-a700-0ff00e14860f tempest-CreateVolumesFromSnapshotTest-1806966364 None] Creating volume 24dcecb2-7e7e-4d51-ba8d-b3fb574d60ed {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:42:20 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-3b4abca5-ad97-476f-a700-0ff00e14860f tempest-CreateVolumesFromSnapshotTest-1806966364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:42:20 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-3b4abca5-ad97-476f-a700-0ff00e14860f tempest-CreateVolumesFromSnapshotTest-1806966364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:42:20 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-3b4abca5-ad97-476f-a700-0ff00e14860f tempest-CreateVolumesFromSnapshotTest-1806966364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:42:20 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-3b4abca5-ad97-476f-a700-0ff00e14860f tempest-CreateVolumesFromSnapshotTest-1806966364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:42:20 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-3b4abca5-ad97-476f-a700-0ff00e14860f tempest-CreateVolumesFromSnapshotTest-1806966364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:42:20 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-3b4abca5-ad97-476f-a700-0ff00e14860f tempest-CreateVolumesFromSnapshotTest-1806966364 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:42:20 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-3b4abca5-ad97-476f-a700-0ff00e14860f tempest-CreateVolumesFromSnapshotTest-1806966364 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:42:20 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-3b4abca5-ad97-476f-a700-0ff00e14860f tempest-CreateVolumesFromSnapshotTest-1806966364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-24dcecb2-7e7e-4d51-ba8d-b3fb574d60ed 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:21 devstack sudo[114053]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:21 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-dd502cf7-8e52-45d3-a879-36a3bbb215ec tempest-CreateVolumesFromSnapshotTest-1806966364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e4e2d76-3649-4fc8-b578-02c081769042) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d977d131-dac7-45c8-b5e7-215ffa36391a', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:21 devstack sudo[114059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-24dcecb2-7e7e-4d51-ba8d-b3fb574d60ed 1073741824 Aug 26 14:42:21 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-dd502cf7-8e52-45d3-a879-36a3bbb215ec tempest-CreateVolumesFromSnapshotTest-1806966364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d743f666-3883-49de-94fa-6736dcf63643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:21 devstack sudo[114059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:21 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-625b80d1-d31a-421e-a3ff-42a1df8f3a6b tempest-VolumeAndVolumeTypeFromImageTest-876346826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (578379c3-6071-4942-bdb5-361261a3f3bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02ec04f8-e1b7-4264-aa85-d20e56bc0582', 'volume_size': 1, 'image_id': 'e0c61842-d9d9-4671-8dbb-7baaf946796e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e0c61842-d9d9-4671-8dbb-7baaf946796e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5a802481053f826d701e31b1fb3398e6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'bb7400886bc54470aefdeae7e5c6085a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd3571c7db7c394e0e2875353c3a177fe6215f3e13a314fc340d90946056e1356d4f84f2e830780f8270238d41bcb7f21d5379259c9fddf3e1beebbc7dfd8a12c', 'id': 'e0c61842-d9d9-4671-8dbb-7baaf946796e', 'created_at': datetime.datetime(2026, 8, 26, 12, 42, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 12, 42, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e0c61842-d9d9-4671-8dbb-7baaf946796e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:21 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-625b80d1-d31a-421e-a3ff-42a1df8f3a6b tempest-VolumeAndVolumeTypeFromImageTest-876346826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a64630f3-3120-4c8f-b309-fee039da6e08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:21 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-d9d091d1-16b9-4b23-90a1-5556afa9a9cb tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.378s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:21 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-d9d091d1-16b9-4b23-90a1-5556afa9a9cb tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:42:21 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-d9d091d1-16b9-4b23-90a1-5556afa9a9cb tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Deleted volume successfully. Aug 26 14:42:21 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-625b80d1-d31a-421e-a3ff-42a1df8f3a6b tempest-VolumeAndVolumeTypeFromImageTest-876346826 None] Volume volume-02ec04f8-e1b7-4264-aa85-d20e56bc0582 (02ec04f8-e1b7-4264-aa85-d20e56bc0582): created successfully Aug 26 14:42:21 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-625b80d1-d31a-421e-a3ff-42a1df8f3a6b tempest-VolumeAndVolumeTypeFromImageTest-876346826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a64630f3-3120-4c8f-b309-fee039da6e08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:21 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-625b80d1-d31a-421e-a3ff-42a1df8f3a6b tempest-VolumeAndVolumeTypeFromImageTest-876346826 None] Flow 'volume_create_manager' (eb4e2d18-0ae0-43c1-8769-7bdafc2cf467) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:42:21 devstack sudo[114057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b6fbcef9-b510-4a37-a9fd-6e51ae5fca6d Aug 26 14:42:21 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-dd502cf7-8e52-45d3-a879-36a3bbb215ec tempest-CreateVolumesFromSnapshotTest-1806966364 None] Volume volume-d977d131-dac7-45c8-b5e7-215ffa36391a (d977d131-dac7-45c8-b5e7-215ffa36391a): created successfully Aug 26 14:42:21 devstack sudo[114057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:21 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-dd502cf7-8e52-45d3-a879-36a3bbb215ec tempest-CreateVolumesFromSnapshotTest-1806966364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d743f666-3883-49de-94fa-6736dcf63643) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:21 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-dd502cf7-8e52-45d3-a879-36a3bbb215ec tempest-CreateVolumesFromSnapshotTest-1806966364 None] Flow 'volume_create_manager' (8804ea97-6492-429e-8da8-48eab4d63aca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:42:21 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-625b80d1-d31a-421e-a3ff-42a1df8f3a6b tempest-VolumeAndVolumeTypeFromImageTest-876346826 None] Created volume successfully. Aug 26 14:42:21 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-d9d091d1-16b9-4b23-90a1-5556afa9a9cb tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Lock "cinder-77b2975a-84db-4582-8906-46392d1c8022-delete_volume" released by "delete_volume" :: held 1.663s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:42:21 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-dd502cf7-8e52-45d3-a879-36a3bbb215ec tempest-CreateVolumesFromSnapshotTest-1806966364 None] Created volume successfully. Aug 26 14:42:21 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-9589da6d-34b4-4366-8cd6-de6e591123e4 tempest-VolumeAndVolumeTypeFromImageTest-876346826 None] Acquiring lock "cinder-02ec04f8-e1b7-4264-aa85-d20e56bc0582-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:42:21 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-9589da6d-34b4-4366-8cd6-de6e591123e4 tempest-VolumeAndVolumeTypeFromImageTest-876346826 None] Lock "cinder-02ec04f8-e1b7-4264-aa85-d20e56bc0582-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:42:21 devstack sudo[114057]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:21 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-32bac5f6-1739-4303-9f5f-a7b0f0adfd35 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b6fbcef9-b510-4a37-a9fd-6e51ae5fca6d" returned: 0 in 0.502s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:21 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-32bac5f6-1739-4303-9f5f-a7b0f0adfd35 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b6fbcef9-b510-4a37-a9fd-6e51ae5fca6d {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:21 devstack sudo[114070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b6fbcef9-b510-4a37-a9fd-6e51ae5fca6d Aug 26 14:42:21 devstack sudo[114070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:21 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-9589da6d-34b4-4366-8cd6-de6e591123e4 tempest-VolumeAndVolumeTypeFromImageTest-876346826 None] Acquiring lock "cinder-quobyte-02ec04f8-e1b7-4264-aa85-d20e56bc0582" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:42:21 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-9589da6d-34b4-4366-8cd6-de6e591123e4 tempest-VolumeAndVolumeTypeFromImageTest-876346826 None] Lock "cinder-quobyte-02ec04f8-e1b7-4264-aa85-d20e56bc0582" acquired by "delete_volume" :: waited 0.026s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:42:21 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dd03629-6be4-47ec-9a24-8b176c4d53b5]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:42:21 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-9589da6d-34b4-4366-8cd6-de6e591123e4 tempest-VolumeAndVolumeTypeFromImageTest-876346826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-02ec04f8-e1b7-4264-aa85-d20e56bc0582 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:21 devstack sudo[114059]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:21 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-3b4abca5-ad97-476f-a700-0ff00e14860f tempest-CreateVolumesFromSnapshotTest-1806966364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-24dcecb2-7e7e-4d51-ba8d-b3fb574d60ed 1073741824" returned: 0 in 0.616s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:21 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-3b4abca5-ad97-476f-a700-0ff00e14860f tempest-CreateVolumesFromSnapshotTest-1806966364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-24dcecb2-7e7e-4d51-ba8d-b3fb574d60ed {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:21 devstack sudo[114073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-24dcecb2-7e7e-4d51-ba8d-b3fb574d60ed Aug 26 14:42:21 devstack sudo[114073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:21 devstack sudo[114072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-02ec04f8-e1b7-4264-aa85-d20e56bc0582 Aug 26 14:42:21 devstack sudo[114072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:21 devstack sudo[114070]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:21 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-32bac5f6-1739-4303-9f5f-a7b0f0adfd35 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b6fbcef9-b510-4a37-a9fd-6e51ae5fca6d" returned: 0 in 0.310s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:21 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-32bac5f6-1739-4303-9f5f-a7b0f0adfd35 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Lock "cinder-quobyte-b6fbcef9-b510-4a37-a9fd-6e51ae5fca6d" released by "delete_volume" :: held 0.874s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:42:21 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-32bac5f6-1739-4303-9f5f-a7b0f0adfd35 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Created reservations ['a4f8c4b5-506e-4c93-b203-8e9bce31eead', '5a89a91b-924b-4d94-b79f-03f0ba8f45ed', '106d35b5-ee50-43f7-aa89-04ea89327979', 'c1fa5926-5a28-4836-b723-4d4e00735af9'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:42:21 devstack sudo[114073]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:21 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-3b4abca5-ad97-476f-a700-0ff00e14860f tempest-CreateVolumesFromSnapshotTest-1806966364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-24dcecb2-7e7e-4d51-ba8d-b3fb574d60ed" returned: 0 in 0.307s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:21 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-3b4abca5-ad97-476f-a700-0ff00e14860f tempest-CreateVolumesFromSnapshotTest-1806966364 None] <== create_volume: return (973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:42:21 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-3b4abca5-ad97-476f-a700-0ff00e14860f tempest-CreateVolumesFromSnapshotTest-1806966364 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.977s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:42:21 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-f4511bf1-b09b-40ea-92f6-ae00495b1bb4 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.332s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:42:21 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-f4511bf1-b09b-40ea-92f6-ae00495b1bb4 tempest-CreateVolumesFromSnapshotTest-1806966364 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:42:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1917768735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3871c91d-8fb2-466b-ad1f-f4a3db95a1f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec8f26288b124661a14ab7719680c9d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:42:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:42:18Z,use_quota=True,user_id='aeeb1907462d4a7c9669bb590fc4a260',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:42:21 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-f4511bf1-b09b-40ea-92f6-ae00495b1bb4 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Creating volume 3871c91d-8fb2-466b-ad1f-f4a3db95a1f2 {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:42:21 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-f4511bf1-b09b-40ea-92f6-ae00495b1bb4 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:42:21 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-f4511bf1-b09b-40ea-92f6-ae00495b1bb4 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:42:21 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-f4511bf1-b09b-40ea-92f6-ae00495b1bb4 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:42:21 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-f4511bf1-b09b-40ea-92f6-ae00495b1bb4 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:42:21 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-f4511bf1-b09b-40ea-92f6-ae00495b1bb4 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:42:21 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-f4511bf1-b09b-40ea-92f6-ae00495b1bb4 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:42:21 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-f4511bf1-b09b-40ea-92f6-ae00495b1bb4 tempest-CreateVolumesFromSnapshotTest-1806966364 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:42:21 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-f4511bf1-b09b-40ea-92f6-ae00495b1bb4 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3871c91d-8fb2-466b-ad1f-f4a3db95a1f2 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:22 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-3b4abca5-ad97-476f-a700-0ff00e14860f tempest-CreateVolumesFromSnapshotTest-1806966364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e26edf56-a069-47fa-8d83-86f0f65dfd79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24dcecb2-7e7e-4d51-ba8d-b3fb574d60ed', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:22 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-3b4abca5-ad97-476f-a700-0ff00e14860f tempest-CreateVolumesFromSnapshotTest-1806966364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3020a89-0afa-4d2e-8e3a-6d4536ea9b28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:22 devstack sudo[114078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3871c91d-8fb2-466b-ad1f-f4a3db95a1f2 1073741824 Aug 26 14:42:22 devstack sudo[114078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:22 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-3b4abca5-ad97-476f-a700-0ff00e14860f tempest-CreateVolumesFromSnapshotTest-1806966364 None] Volume volume-24dcecb2-7e7e-4d51-ba8d-b3fb574d60ed (24dcecb2-7e7e-4d51-ba8d-b3fb574d60ed): created successfully Aug 26 14:42:22 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-3b4abca5-ad97-476f-a700-0ff00e14860f tempest-CreateVolumesFromSnapshotTest-1806966364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3020a89-0afa-4d2e-8e3a-6d4536ea9b28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:22 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-3b4abca5-ad97-476f-a700-0ff00e14860f tempest-CreateVolumesFromSnapshotTest-1806966364 None] Flow 'volume_create_manager' (1a1f9969-074a-4073-bea4-cb62ecc7d484) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:42:22 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-32bac5f6-1739-4303-9f5f-a7b0f0adfd35 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:42:22 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-32bac5f6-1739-4303-9f5f-a7b0f0adfd35 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:42:22 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-32bac5f6-1739-4303-9f5f-a7b0f0adfd35 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:42:22 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-32bac5f6-1739-4303-9f5f-a7b0f0adfd35 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:42:22 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-32bac5f6-1739-4303-9f5f-a7b0f0adfd35 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:42:22 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-32bac5f6-1739-4303-9f5f-a7b0f0adfd35 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:22 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-4a59b12d-bc91-4d6e-808e-eef18f103bc0 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Acquiring lock "cinder-1939b004-95dc-4465-9fae-b7748cc142b7-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:42:22 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-3b4abca5-ad97-476f-a700-0ff00e14860f tempest-CreateVolumesFromSnapshotTest-1806966364 None] Created volume successfully. Aug 26 14:42:22 devstack sudo[114083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:42:22 devstack sudo[114083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:22 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-4a59b12d-bc91-4d6e-808e-eef18f103bc0 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Lock "cinder-1939b004-95dc-4465-9fae-b7748cc142b7-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:42:22 devstack sudo[114072]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:22 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-9589da6d-34b4-4366-8cd6-de6e591123e4 tempest-VolumeAndVolumeTypeFromImageTest-876346826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-02ec04f8-e1b7-4264-aa85-d20e56bc0582" returned: 0 in 0.588s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:22 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-9589da6d-34b4-4366-8cd6-de6e591123e4 tempest-VolumeAndVolumeTypeFromImageTest-876346826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-02ec04f8-e1b7-4264-aa85-d20e56bc0582 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:22 devstack sudo[114085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-02ec04f8-e1b7-4264-aa85-d20e56bc0582 Aug 26 14:42:22 devstack sudo[114085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:22 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-4a59b12d-bc91-4d6e-808e-eef18f103bc0 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Acquiring lock "cinder-quobyte-1939b004-95dc-4465-9fae-b7748cc142b7" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:42:22 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-4a59b12d-bc91-4d6e-808e-eef18f103bc0 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Lock "cinder-quobyte-1939b004-95dc-4465-9fae-b7748cc142b7" acquired by "delete_volume" :: waited 0.023s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:42:22 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fd90e84-a2c5-481c-b533-24df6a740be0]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:42:22 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4a59b12d-bc91-4d6e-808e-eef18f103bc0 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-1939b004-95dc-4465-9fae-b7748cc142b7 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:22 devstack sudo[114087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-1939b004-95dc-4465-9fae-b7748cc142b7 Aug 26 14:42:22 devstack sudo[114087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:22 devstack sudo[114085]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:22 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-9589da6d-34b4-4366-8cd6-de6e591123e4 tempest-VolumeAndVolumeTypeFromImageTest-876346826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-02ec04f8-e1b7-4264-aa85-d20e56bc0582" returned: 0 in 0.325s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:22 devstack sudo[114083]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:22 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-32bac5f6-1739-4303-9f5f-a7b0f0adfd35 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.423s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:22 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-32bac5f6-1739-4303-9f5f-a7b0f0adfd35 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:42:22 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-9589da6d-34b4-4366-8cd6-de6e591123e4 tempest-VolumeAndVolumeTypeFromImageTest-876346826 None] Lock "cinder-quobyte-02ec04f8-e1b7-4264-aa85-d20e56bc0582" released by "delete_volume" :: held 0.971s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:42:22 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-32bac5f6-1739-4303-9f5f-a7b0f0adfd35 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Deleted volume successfully. Aug 26 14:42:22 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-32bac5f6-1739-4303-9f5f-a7b0f0adfd35 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Lock "cinder-b6fbcef9-b510-4a37-a9fd-6e51ae5fca6d-delete_volume" released by "delete_volume" :: held 1.729s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:42:22 devstack sudo[114078]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:22 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-f4511bf1-b09b-40ea-92f6-ae00495b1bb4 tempest-CreateVolumesFromSnapshotTest-1806966364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3871c91d-8fb2-466b-ad1f-f4a3db95a1f2 1073741824" returned: 0 in 0.627s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:22 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-9589da6d-34b4-4366-8cd6-de6e591123e4 tempest-VolumeAndVolumeTypeFromImageTest-876346826 None] Created reservations ['be8e8919-7163-4082-b847-448c2257d838', '8db14769-401c-4f13-bad5-eb98c3d6aa55', '0acbec27-a8c9-427a-aff4-bf70d18e95ff', '502bdbf7-aef9-4112-b053-b82b48161494'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:42:22 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-f4511bf1-b09b-40ea-92f6-ae00495b1bb4 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3871c91d-8fb2-466b-ad1f-f4a3db95a1f2 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:22 devstack sudo[114098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3871c91d-8fb2-466b-ad1f-f4a3db95a1f2 Aug 26 14:42:22 devstack sudo[114098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:22 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-9589da6d-34b4-4366-8cd6-de6e591123e4 tempest-VolumeAndVolumeTypeFromImageTest-876346826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:42:22 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-9589da6d-34b4-4366-8cd6-de6e591123e4 tempest-VolumeAndVolumeTypeFromImageTest-876346826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:42:22 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-9589da6d-34b4-4366-8cd6-de6e591123e4 tempest-VolumeAndVolumeTypeFromImageTest-876346826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:42:22 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-9589da6d-34b4-4366-8cd6-de6e591123e4 tempest-VolumeAndVolumeTypeFromImageTest-876346826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:42:22 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-9589da6d-34b4-4366-8cd6-de6e591123e4 tempest-VolumeAndVolumeTypeFromImageTest-876346826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:42:22 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-9589da6d-34b4-4366-8cd6-de6e591123e4 tempest-VolumeAndVolumeTypeFromImageTest-876346826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:22 devstack sudo[114087]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:22 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4a59b12d-bc91-4d6e-808e-eef18f103bc0 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-1939b004-95dc-4465-9fae-b7748cc142b7" returned: 0 in 0.468s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:22 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4a59b12d-bc91-4d6e-808e-eef18f103bc0 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-1939b004-95dc-4465-9fae-b7748cc142b7 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:22 devstack sudo[114100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:42:22 devstack sudo[114100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:22 devstack sudo[114102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-1939b004-95dc-4465-9fae-b7748cc142b7 Aug 26 14:42:22 devstack sudo[114102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:22 devstack sudo[114098]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:22 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-f4511bf1-b09b-40ea-92f6-ae00495b1bb4 tempest-CreateVolumesFromSnapshotTest-1806966364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3871c91d-8fb2-466b-ad1f-f4a3db95a1f2" returned: 0 in 0.292s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:22 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-f4511bf1-b09b-40ea-92f6-ae00495b1bb4 tempest-CreateVolumesFromSnapshotTest-1806966364 None] <== create_volume: return (988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:42:22 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-f4511bf1-b09b-40ea-92f6-ae00495b1bb4 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.994s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:42:22 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-f4511bf1-b09b-40ea-92f6-ae00495b1bb4 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21535697-55fb-4d0b-8c2c-351e43145efb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3871c91d-8fb2-466b-ad1f-f4a3db95a1f2', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:22 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-f4511bf1-b09b-40ea-92f6-ae00495b1bb4 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00a74595-cb8f-4832-8342-970a033a88f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:22 devstack sudo[114100]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:22 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-f4511bf1-b09b-40ea-92f6-ae00495b1bb4 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Volume volume-3871c91d-8fb2-466b-ad1f-f4a3db95a1f2 (3871c91d-8fb2-466b-ad1f-f4a3db95a1f2): created successfully Aug 26 14:42:23 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-f4511bf1-b09b-40ea-92f6-ae00495b1bb4 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00a74595-cb8f-4832-8342-970a033a88f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:23 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-f4511bf1-b09b-40ea-92f6-ae00495b1bb4 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Flow 'volume_create_manager' (04167281-fa44-4d20-946f-086342b115b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:42:23 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-9589da6d-34b4-4366-8cd6-de6e591123e4 tempest-VolumeAndVolumeTypeFromImageTest-876346826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.308s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:23 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-9589da6d-34b4-4366-8cd6-de6e591123e4 tempest-VolumeAndVolumeTypeFromImageTest-876346826 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:42:23 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-9589da6d-34b4-4366-8cd6-de6e591123e4 tempest-VolumeAndVolumeTypeFromImageTest-876346826 None] Deleted volume successfully. Aug 26 14:42:23 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-f4511bf1-b09b-40ea-92f6-ae00495b1bb4 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Created volume successfully. Aug 26 14:42:23 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-9589da6d-34b4-4366-8cd6-de6e591123e4 tempest-VolumeAndVolumeTypeFromImageTest-876346826 None] Lock "cinder-02ec04f8-e1b7-4264-aa85-d20e56bc0582-delete_volume" released by "delete_volume" :: held 1.642s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:42:23 devstack sudo[114102]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:23 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4a59b12d-bc91-4d6e-808e-eef18f103bc0 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-1939b004-95dc-4465-9fae-b7748cc142b7" returned: 0 in 0.389s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:23 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-4a59b12d-bc91-4d6e-808e-eef18f103bc0 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Lock "cinder-quobyte-1939b004-95dc-4465-9fae-b7748cc142b7" released by "delete_volume" :: held 0.922s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:42:23 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-18ba75e9-383b-4e05-bf7e-0756c4d66ce6 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Acquiring lock "cinder-3871c91d-8fb2-466b-ad1f-f4a3db95a1f2-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:42:23 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-18ba75e9-383b-4e05-bf7e-0756c4d66ce6 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Lock "cinder-3871c91d-8fb2-466b-ad1f-f4a3db95a1f2-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:42:23 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-4a59b12d-bc91-4d6e-808e-eef18f103bc0 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Created reservations ['1abf1f4b-a75e-4ded-9d34-1d811344ce24', 'fdbd2602-165f-4ef2-b942-18dab56c522e', '937f00a6-d516-4509-8be4-0c862c972c29', '6b5ff79e-e221-49f6-b967-61a713c3b5d5'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:42:23 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-18ba75e9-383b-4e05-bf7e-0756c4d66ce6 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Acquiring lock "cinder-quobyte-3871c91d-8fb2-466b-ad1f-f4a3db95a1f2" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:42:23 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-18ba75e9-383b-4e05-bf7e-0756c4d66ce6 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Lock "cinder-quobyte-3871c91d-8fb2-466b-ad1f-f4a3db95a1f2" acquired by "delete_volume" :: waited 0.024s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:42:23 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[e918eab5-358a-4348-b84b-d7fa52855819]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:42:23 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-18ba75e9-383b-4e05-bf7e-0756c4d66ce6 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3871c91d-8fb2-466b-ad1f-f4a3db95a1f2 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:23 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-4a59b12d-bc91-4d6e-808e-eef18f103bc0 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:42:23 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-4a59b12d-bc91-4d6e-808e-eef18f103bc0 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:42:23 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-4a59b12d-bc91-4d6e-808e-eef18f103bc0 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:42:23 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-4a59b12d-bc91-4d6e-808e-eef18f103bc0 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:42:23 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-4a59b12d-bc91-4d6e-808e-eef18f103bc0 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:42:23 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4a59b12d-bc91-4d6e-808e-eef18f103bc0 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:23 devstack sudo[114108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:42:23 devstack sudo[114108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:23 devstack sudo[114107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3871c91d-8fb2-466b-ad1f-f4a3db95a1f2 Aug 26 14:42:23 devstack sudo[114107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:23 devstack sudo[114108]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:23 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4a59b12d-bc91-4d6e-808e-eef18f103bc0 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.269s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:23 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-4a59b12d-bc91-4d6e-808e-eef18f103bc0 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:42:23 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-4a59b12d-bc91-4d6e-808e-eef18f103bc0 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Deleted volume successfully. Aug 26 14:42:23 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-4a59b12d-bc91-4d6e-808e-eef18f103bc0 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Lock "cinder-1939b004-95dc-4465-9fae-b7748cc142b7-delete_volume" released by "delete_volume" :: held 1.538s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:42:23 devstack sudo[114107]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:23 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-18ba75e9-383b-4e05-bf7e-0756c4d66ce6 tempest-CreateVolumesFromSnapshotTest-1806966364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3871c91d-8fb2-466b-ad1f-f4a3db95a1f2" returned: 0 in 0.424s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:23 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-18ba75e9-383b-4e05-bf7e-0756c4d66ce6 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3871c91d-8fb2-466b-ad1f-f4a3db95a1f2 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:23 devstack sudo[114115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3871c91d-8fb2-466b-ad1f-f4a3db95a1f2 Aug 26 14:42:23 devstack sudo[114115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:23 devstack sudo[114115]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:23 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-18ba75e9-383b-4e05-bf7e-0756c4d66ce6 tempest-CreateVolumesFromSnapshotTest-1806966364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3871c91d-8fb2-466b-ad1f-f4a3db95a1f2" returned: 0 in 0.265s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:24 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-18ba75e9-383b-4e05-bf7e-0756c4d66ce6 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Lock "cinder-quobyte-3871c91d-8fb2-466b-ad1f-f4a3db95a1f2" released by "delete_volume" :: held 0.743s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:42:24 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-18ba75e9-383b-4e05-bf7e-0756c4d66ce6 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Created reservations ['4bb0d712-ef50-4356-b009-28ec70f22781', 'dc50ced1-e3c8-4f45-9a4e-f660d2eca5df', '6342bfc9-f4b3-4c0a-8a6b-89ada5ab1ecd', '407abb2c-cb9e-4491-9f00-efd25a53437e'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:42:24 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-18ba75e9-383b-4e05-bf7e-0756c4d66ce6 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:42:24 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-18ba75e9-383b-4e05-bf7e-0756c4d66ce6 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:42:24 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-18ba75e9-383b-4e05-bf7e-0756c4d66ce6 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:42:24 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-18ba75e9-383b-4e05-bf7e-0756c4d66ce6 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:42:24 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-18ba75e9-383b-4e05-bf7e-0756c4d66ce6 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:42:24 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-18ba75e9-383b-4e05-bf7e-0756c4d66ce6 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:24 devstack sudo[114118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:42:24 devstack sudo[114118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:24 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-16c4e232-23e0-4bb5-9a42-6dcd899efec5 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Acquiring lock "cinder-24dcecb2-7e7e-4d51-ba8d-b3fb574d60ed-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:42:24 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-16c4e232-23e0-4bb5-9a42-6dcd899efec5 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Lock "cinder-24dcecb2-7e7e-4d51-ba8d-b3fb574d60ed-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:42:24 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-16c4e232-23e0-4bb5-9a42-6dcd899efec5 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Acquiring lock "cinder-quobyte-24dcecb2-7e7e-4d51-ba8d-b3fb574d60ed" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:42:24 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-16c4e232-23e0-4bb5-9a42-6dcd899efec5 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Lock "cinder-quobyte-24dcecb2-7e7e-4d51-ba8d-b3fb574d60ed" acquired by "delete_volume" :: waited 0.025s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:42:24 devstack sudo[114118]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:24 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ba8b353-b57c-4743-801d-cd7f876b4f86]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:42:24 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-16c4e232-23e0-4bb5-9a42-6dcd899efec5 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-24dcecb2-7e7e-4d51-ba8d-b3fb574d60ed {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:24 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-18ba75e9-383b-4e05-bf7e-0756c4d66ce6 tempest-CreateVolumesFromSnapshotTest-1806966364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.373s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:24 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-18ba75e9-383b-4e05-bf7e-0756c4d66ce6 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:42:24 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-18ba75e9-383b-4e05-bf7e-0756c4d66ce6 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Deleted volume successfully. Aug 26 14:42:24 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-8facfe29-4660-4367-be50-39841e7a6983 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Acquiring lock "cinder-d4572efb-5cd7-43ed-b8e2-aa5ca127a265-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:42:24 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-18ba75e9-383b-4e05-bf7e-0756c4d66ce6 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Lock "cinder-3871c91d-8fb2-466b-ad1f-f4a3db95a1f2-delete_volume" released by "delete_volume" :: held 1.396s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:42:24 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-8facfe29-4660-4367-be50-39841e7a6983 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Lock "cinder-d4572efb-5cd7-43ed-b8e2-aa5ca127a265-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:42:24 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-8facfe29-4660-4367-be50-39841e7a6983 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Acquiring lock "cinder-quobyte-d4572efb-5cd7-43ed-b8e2-aa5ca127a265" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:42:24 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-8facfe29-4660-4367-be50-39841e7a6983 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Lock "cinder-quobyte-d4572efb-5cd7-43ed-b8e2-aa5ca127a265" acquired by "delete_volume" :: waited 0.022s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:42:24 devstack sudo[114121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-24dcecb2-7e7e-4d51-ba8d-b3fb574d60ed Aug 26 14:42:24 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5dbab88-5fb7-40b2-a203-7aebb1f782e2]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:42:24 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-8facfe29-4660-4367-be50-39841e7a6983 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d4572efb-5cd7-43ed-b8e2-aa5ca127a265 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:24 devstack sudo[114121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:24 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ea7eeea-64e8-47fd-b939-b72989f21843 tempest-VolumeImageDependencyTests-1641410403 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:42:24 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-9ea7eeea-64e8-47fd-b939-b72989f21843 tempest-VolumeImageDependencyTests-1641410403 None] Flow 'volume_create_manager' (4496e400-caf9-47b4-91d1-0cdf17578e03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:42:24 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-9ea7eeea-64e8-47fd-b939-b72989f21843 tempest-VolumeImageDependencyTests-1641410403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65884744-74be-49ba-ba84-36f815e36f42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:24 devstack sudo[114123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d4572efb-5cd7-43ed-b8e2-aa5ca127a265 Aug 26 14:42:24 devstack sudo[114123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:24 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-9ea7eeea-64e8-47fd-b939-b72989f21843 tempest-VolumeImageDependencyTests-1641410403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65884744-74be-49ba-ba84-36f815e36f42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:42:24Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de6963f1-5faa-4d92-a06c-6919a00bfe5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f76efe5cca9401eb4dc074601679fed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:42:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:42:25Z,use_quota=True,user_id='a5ba5599184e4b268e85c44015e21c7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:24 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-9ea7eeea-64e8-47fd-b939-b72989f21843 tempest-VolumeImageDependencyTests-1641410403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (928215f4-cdba-4cf9-8788-4ec92df43d06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:24 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-9ea7eeea-64e8-47fd-b939-b72989f21843 tempest-VolumeImageDependencyTests-1641410403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (928215f4-cdba-4cf9-8788-4ec92df43d06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:24 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-9ea7eeea-64e8-47fd-b939-b72989f21843 tempest-VolumeImageDependencyTests-1641410403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b912e4a2-b6f4-41f1-8c68-fc90771a7566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:24 devstack cinder-volume[94394]: DEBUG cinder.image.glance [None req-9ea7eeea-64e8-47fd-b939-b72989f21843 tempest-VolumeImageDependencyTests-1641410403 None] Creating Keystone auth plugin from conf {{(pid=94394) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 26 14:42:25 devstack sudo[114121]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:25 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-16c4e232-23e0-4bb5-9a42-6dcd899efec5 tempest-CreateVolumesFromSnapshotTest-1806966364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-24dcecb2-7e7e-4d51-ba8d-b3fb574d60ed" returned: 0 in 0.490s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:25 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-16c4e232-23e0-4bb5-9a42-6dcd899efec5 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-24dcecb2-7e7e-4d51-ba8d-b3fb574d60ed {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:25 devstack sudo[114129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-24dcecb2-7e7e-4d51-ba8d-b3fb574d60ed Aug 26 14:42:25 devstack sudo[114129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:25 devstack sudo[114123]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:25 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-8facfe29-4660-4367-be50-39841e7a6983 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d4572efb-5cd7-43ed-b8e2-aa5ca127a265" returned: 0 in 0.441s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:25 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-8facfe29-4660-4367-be50-39841e7a6983 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d4572efb-5cd7-43ed-b8e2-aa5ca127a265 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:25 devstack sudo[114134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d4572efb-5cd7-43ed-b8e2-aa5ca127a265 Aug 26 14:42:25 devstack sudo[114134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:25 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-9ea7eeea-64e8-47fd-b939-b72989f21843 tempest-VolumeImageDependencyTests-1641410403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b912e4a2-b6f4-41f1-8c68-fc90771a7566) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'de6963f1-5faa-4d92-a06c-6919a00bfe5d', 'volume_name': 'volume-de6963f1-5faa-4d92-a06c-6919a00bfe5d', 'volume_size': 1, 'image_id': '0c8829b9-052a-47c4-bdf3-386889b1a1b1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0c8829b9-052a-47c4-bdf3-386889b1a1b1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3a9c162de5ee98b9caff5f5c89bb445f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3f76efe5cca9401eb4dc074601679fed', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f4dca8f937783fcc94008b8a529ed2e1d76d239415f65b9574b3b2200f90960976a5c7afa62e0d785abed5ca58424b449053af74341647a0a883b1339f383272', 'id': '0c8829b9-052a-47c4-bdf3-386889b1a1b1', 'created_at': datetime.datetime(2026, 8, 26, 12, 42, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 12, 42, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0c8829b9-052a-47c4-bdf3-386889b1a1b1/file', 'properties': {}}, 'image_service': }' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:25 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-9ea7eeea-64e8-47fd-b939-b72989f21843 tempest-VolumeImageDependencyTests-1641410403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2828dd8f-de0d-4eec-ae89-1cd4a8862161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:25 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-9ea7eeea-64e8-47fd-b939-b72989f21843 tempest-VolumeImageDependencyTests-1641410403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2828dd8f-de0d-4eec-ae89-1cd4a8862161) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:25 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-9ea7eeea-64e8-47fd-b939-b72989f21843 tempest-VolumeImageDependencyTests-1641410403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f67e172f-83f8-452f-80c4-7300affaa9f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:25 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-9ea7eeea-64e8-47fd-b939-b72989f21843 tempest-VolumeImageDependencyTests-1641410403 None] Volume de6963f1-5faa-4d92-a06c-6919a00bfe5d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-de6963f1-5faa-4d92-a06c-6919a00bfe5d', 'volume_size': 1, 'image_id': '0c8829b9-052a-47c4-bdf3-386889b1a1b1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0c8829b9-052a-47c4-bdf3-386889b1a1b1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3a9c162de5ee98b9caff5f5c89bb445f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3f76efe5cca9401eb4dc074601679fed', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f4dca8f937783fcc94008b8a529ed2e1d76d239415f65b9574b3b2200f90960976a5c7afa62e0d785abed5ca58424b449053af74341647a0a883b1339f383272', 'id': '0c8829b9-052a-47c4-bdf3-386889b1a1b1', 'created_at': datetime.datetime(2026, 8, 26, 12, 42, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 12, 42, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0c8829b9-052a-47c4-bdf3-386889b1a1b1/file', 'properties': {}}, 'image_service': } Aug 26 14:42:25 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ea7eeea-64e8-47fd-b939-b72989f21843 tempest-VolumeImageDependencyTests-1641410403 None] Trying to clone de6963f1-5faa-4d92-a06c-6919a00bfe5d from image 0c8829b9-052a-47c4-bdf3-386889b1a1b1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/0c8829b9-052a-47c4-bdf3-386889b1a1b1', 'metadata': {}}]). {{(pid=94394) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 26 14:42:25 devstack sudo[114129]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:25 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-16c4e232-23e0-4bb5-9a42-6dcd899efec5 tempest-CreateVolumesFromSnapshotTest-1806966364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-24dcecb2-7e7e-4d51-ba8d-b3fb574d60ed" returned: 0 in 0.321s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:25 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-16c4e232-23e0-4bb5-9a42-6dcd899efec5 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Lock "cinder-quobyte-24dcecb2-7e7e-4d51-ba8d-b3fb574d60ed" released by "delete_volume" :: held 0.884s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:42:25 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-16c4e232-23e0-4bb5-9a42-6dcd899efec5 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Created reservations ['aa88a3da-1d1a-47ce-bd55-1a99e8b76e32', '1f9301f5-1ad0-4edc-a73a-90adf593ac12', 'fcc6ce73-4bfd-4d66-a4a0-69c9852ffeac', '35b004db-9d44-42ff-a6d1-cd3278cd16b7'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:42:25 devstack cinder-volume[94394]: DEBUG cinder.image.image_utils [None req-9ea7eeea-64e8-47fd-b939-b72989f21843 tempest-VolumeImageDependencyTests-1641410403 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0c8829b9-052a-47c4-bdf3-386889b1a1b1_mt2j0ahwdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=94394) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 26 14:42:25 devstack cinder-volume[94394]: INFO cinder.image.image_utils [None req-9ea7eeea-64e8-47fd-b939-b72989f21843 tempest-VolumeImageDependencyTests-1641410403 None] Image download 0.00 MB at 0.00 MB/s Aug 26 14:42:25 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[8361edf9-2c02-49bf-be01-ff72b1c35706]: (4, 'raw') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:42:25 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-9ea7eeea-64e8-47fd-b939-b72989f21843 tempest-VolumeImageDependencyTests-1641410403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0c8829b9-052a-47c4-bdf3-386889b1a1b1_mt2j0ahwdevstack@QuobyteHD {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:25 devstack sudo[114134]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:25 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-8facfe29-4660-4367-be50-39841e7a6983 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d4572efb-5cd7-43ed-b8e2-aa5ca127a265" returned: 0 in 0.380s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:25 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-16c4e232-23e0-4bb5-9a42-6dcd899efec5 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:42:25 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-16c4e232-23e0-4bb5-9a42-6dcd899efec5 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:42:25 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-16c4e232-23e0-4bb5-9a42-6dcd899efec5 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:42:25 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-16c4e232-23e0-4bb5-9a42-6dcd899efec5 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:42:25 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-16c4e232-23e0-4bb5-9a42-6dcd899efec5 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:42:25 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-16c4e232-23e0-4bb5-9a42-6dcd899efec5 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:25 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-8facfe29-4660-4367-be50-39841e7a6983 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Lock "cinder-quobyte-d4572efb-5cd7-43ed-b8e2-aa5ca127a265" released by "delete_volume" :: held 0.912s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:42:25 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-bd88e136-0225-4e15-912c-5158211fb94f tempest-CreateVolumesFromSnapshotTest-1806966364 None] Acquiring lock "cinder-d977d131-dac7-45c8-b5e7-215ffa36391a-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:42:25 devstack sudo[114139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:42:25 devstack sudo[114139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:25 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-bd88e136-0225-4e15-912c-5158211fb94f tempest-CreateVolumesFromSnapshotTest-1806966364 None] Lock "cinder-d977d131-dac7-45c8-b5e7-215ffa36391a-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:42:25 devstack sudo[114138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0c8829b9-052a-47c4-bdf3-386889b1a1b1_mt2j0ahwdevstack@QuobyteHD Aug 26 14:42:25 devstack sudo[114138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:25 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-8facfe29-4660-4367-be50-39841e7a6983 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Created reservations ['ac07d5d8-6582-4dfa-8e52-7b017b37824d', '32ba6ae8-4563-445f-a611-26df456bd5a7', '8e22b137-bb39-4351-a378-9abe47807083', '586cf3cd-f8cb-4163-a13b-0f8f139a99f0'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:42:25 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-bd88e136-0225-4e15-912c-5158211fb94f tempest-CreateVolumesFromSnapshotTest-1806966364 None] Acquiring lock "cinder-quobyte-d977d131-dac7-45c8-b5e7-215ffa36391a" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:42:25 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-bd88e136-0225-4e15-912c-5158211fb94f tempest-CreateVolumesFromSnapshotTest-1806966364 None] Lock "cinder-quobyte-d977d131-dac7-45c8-b5e7-215ffa36391a" acquired by "delete_volume" :: waited 0.037s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:42:25 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0f6faf5-5338-4587-afce-b2434ef246a0]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:42:25 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-bd88e136-0225-4e15-912c-5158211fb94f tempest-CreateVolumesFromSnapshotTest-1806966364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d977d131-dac7-45c8-b5e7-215ffa36391a {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:25 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-8facfe29-4660-4367-be50-39841e7a6983 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:42:25 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-8facfe29-4660-4367-be50-39841e7a6983 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:42:25 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-8facfe29-4660-4367-be50-39841e7a6983 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:42:25 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-8facfe29-4660-4367-be50-39841e7a6983 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:42:25 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-8facfe29-4660-4367-be50-39841e7a6983 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:42:25 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-8facfe29-4660-4367-be50-39841e7a6983 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:25 devstack sudo[114139]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:25 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-16c4e232-23e0-4bb5-9a42-6dcd899efec5 tempest-CreateVolumesFromSnapshotTest-1806966364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.399s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:25 devstack sudo[114144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:42:25 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-16c4e232-23e0-4bb5-9a42-6dcd899efec5 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:42:25 devstack sudo[114144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:25 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-16c4e232-23e0-4bb5-9a42-6dcd899efec5 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Deleted volume successfully. Aug 26 14:42:25 devstack sudo[114138]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:25 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-9ea7eeea-64e8-47fd-b939-b72989f21843 tempest-VolumeImageDependencyTests-1641410403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0c8829b9-052a-47c4-bdf3-386889b1a1b1_mt2j0ahwdevstack@QuobyteHD" returned: 0 in 0.467s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:25 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-9ea7eeea-64e8-47fd-b939-b72989f21843 tempest-VolumeImageDependencyTests-1641410403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0c8829b9-052a-47c4-bdf3-386889b1a1b1_mt2j0ahwdevstack@QuobyteHD {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:26 devstack sudo[114142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d977d131-dac7-45c8-b5e7-215ffa36391a Aug 26 14:42:26 devstack sudo[114142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:26 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-16c4e232-23e0-4bb5-9a42-6dcd899efec5 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Lock "cinder-24dcecb2-7e7e-4d51-ba8d-b3fb574d60ed-delete_volume" released by "delete_volume" :: held 1.651s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:42:26 devstack sudo[114149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0c8829b9-052a-47c4-bdf3-386889b1a1b1_mt2j0ahwdevstack@QuobyteHD Aug 26 14:42:26 devstack sudo[114149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:26 devstack sudo[114144]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:26 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-8facfe29-4660-4367-be50-39841e7a6983 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.407s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:26 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-8facfe29-4660-4367-be50-39841e7a6983 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:42:26 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-8facfe29-4660-4367-be50-39841e7a6983 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Deleted volume successfully. Aug 26 14:42:26 devstack sudo[114142]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:26 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-bd88e136-0225-4e15-912c-5158211fb94f tempest-CreateVolumesFromSnapshotTest-1806966364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d977d131-dac7-45c8-b5e7-215ffa36391a" returned: 0 in 0.502s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:26 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-bd88e136-0225-4e15-912c-5158211fb94f tempest-CreateVolumesFromSnapshotTest-1806966364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d977d131-dac7-45c8-b5e7-215ffa36391a {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:26 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-8facfe29-4660-4367-be50-39841e7a6983 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Lock "cinder-d4572efb-5cd7-43ed-b8e2-aa5ca127a265-delete_volume" released by "delete_volume" :: held 1.753s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:42:26 devstack sudo[114155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d977d131-dac7-45c8-b5e7-215ffa36391a Aug 26 14:42:26 devstack sudo[114155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:26 devstack sudo[114149]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:26 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-9ea7eeea-64e8-47fd-b939-b72989f21843 tempest-VolumeImageDependencyTests-1641410403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0c8829b9-052a-47c4-bdf3-386889b1a1b1_mt2j0ahwdevstack@QuobyteHD" returned: 1 in 0.429s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:26 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-9ea7eeea-64e8-47fd-b939-b72989f21843 tempest-VolumeImageDependencyTests-1641410403 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0c8829b9-052a-47c4-bdf3-386889b1a1b1_mt2j0ahwdevstack@QuobyteHD' failed. Not Retrying. {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 14:42:26 devstack cinder-volume[94394]: DEBUG cinder.image.image_utils [None req-9ea7eeea-64e8-47fd-b939-b72989f21843 tempest-VolumeImageDependencyTests-1641410403 None] Temporary image 0c8829b9-052a-47c4-bdf3-386889b1a1b1 is fetched for user a5ba5599184e4b268e85c44015e21c7d. {{(pid=94394) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 26 14:42:26 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[326c8849-9a6f-4ebe-900e-4b6d936fa34f]: (4, 'raw') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:42:26 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-9ea7eeea-64e8-47fd-b939-b72989f21843 tempest-VolumeImageDependencyTests-1641410403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0c8829b9-052a-47c4-bdf3-386889b1a1b1_mt2j0ahwdevstack@QuobyteHD {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:26 devstack sudo[114155]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:26 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-bd88e136-0225-4e15-912c-5158211fb94f tempest-CreateVolumesFromSnapshotTest-1806966364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d977d131-dac7-45c8-b5e7-215ffa36391a" returned: 0 in 0.274s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:26 devstack sudo[114160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0c8829b9-052a-47c4-bdf3-386889b1a1b1_mt2j0ahwdevstack@QuobyteHD Aug 26 14:42:26 devstack sudo[114160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:26 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-bd88e136-0225-4e15-912c-5158211fb94f tempest-CreateVolumesFromSnapshotTest-1806966364 None] Lock "cinder-quobyte-d977d131-dac7-45c8-b5e7-215ffa36391a" released by "delete_volume" :: held 0.848s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:42:26 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-bd88e136-0225-4e15-912c-5158211fb94f tempest-CreateVolumesFromSnapshotTest-1806966364 None] Created reservations ['fccf036c-abe6-49ce-8e45-c963696f8fe2', 'adcbf23e-11d2-43cd-91a3-dd1d406635e3', '7be3bab2-727e-4e98-b357-e684a4d3de35', 'eeb212d9-23d5-408c-8e84-10d50d9a3aef'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:42:26 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-bd88e136-0225-4e15-912c-5158211fb94f tempest-CreateVolumesFromSnapshotTest-1806966364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:42:26 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-bd88e136-0225-4e15-912c-5158211fb94f tempest-CreateVolumesFromSnapshotTest-1806966364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:42:26 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-bd88e136-0225-4e15-912c-5158211fb94f tempest-CreateVolumesFromSnapshotTest-1806966364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:42:26 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-bd88e136-0225-4e15-912c-5158211fb94f tempest-CreateVolumesFromSnapshotTest-1806966364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:42:26 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-bd88e136-0225-4e15-912c-5158211fb94f tempest-CreateVolumesFromSnapshotTest-1806966364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:42:26 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-bd88e136-0225-4e15-912c-5158211fb94f tempest-CreateVolumesFromSnapshotTest-1806966364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:26 devstack sudo[114163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:42:26 devstack sudo[114163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:26 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-39358f25-ec25-46d7-b499-4de9048b24d7 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Acquiring lock "cinder-555f8b55-e1d3-47eb-9a2b-64d108f0b06a-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:42:26 devstack sudo[114160]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:26 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-9ea7eeea-64e8-47fd-b939-b72989f21843 tempest-VolumeImageDependencyTests-1641410403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0c8829b9-052a-47c4-bdf3-386889b1a1b1_mt2j0ahwdevstack@QuobyteHD" returned: 0 in 0.480s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:26 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-9ea7eeea-64e8-47fd-b939-b72989f21843 tempest-VolumeImageDependencyTests-1641410403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0c8829b9-052a-47c4-bdf3-386889b1a1b1_mt2j0ahwdevstack@QuobyteHD {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:27 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-39358f25-ec25-46d7-b499-4de9048b24d7 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Lock "cinder-555f8b55-e1d3-47eb-9a2b-64d108f0b06a-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:42:27 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-39358f25-ec25-46d7-b499-4de9048b24d7 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Acquiring lock "cinder-quobyte-555f8b55-e1d3-47eb-9a2b-64d108f0b06a" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:42:27 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-39358f25-ec25-46d7-b499-4de9048b24d7 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Lock "cinder-quobyte-555f8b55-e1d3-47eb-9a2b-64d108f0b06a" acquired by "delete_volume" :: waited 0.031s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:42:27 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[69a1ece4-fb47-4f54-b88f-7a3451703c4a]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:42:27 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-39358f25-ec25-46d7-b499-4de9048b24d7 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-555f8b55-e1d3-47eb-9a2b-64d108f0b06a {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:27 devstack sudo[114163]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:27 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-bd88e136-0225-4e15-912c-5158211fb94f tempest-CreateVolumesFromSnapshotTest-1806966364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.323s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:27 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-bd88e136-0225-4e15-912c-5158211fb94f tempest-CreateVolumesFromSnapshotTest-1806966364 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:42:27 devstack sudo[114167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0c8829b9-052a-47c4-bdf3-386889b1a1b1_mt2j0ahwdevstack@QuobyteHD Aug 26 14:42:27 devstack sudo[114167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:27 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-bd88e136-0225-4e15-912c-5158211fb94f tempest-CreateVolumesFromSnapshotTest-1806966364 None] Deleted volume successfully. Aug 26 14:42:27 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-bd88e136-0225-4e15-912c-5158211fb94f tempest-CreateVolumesFromSnapshotTest-1806966364 None] Lock "cinder-d977d131-dac7-45c8-b5e7-215ffa36391a-delete_volume" released by "delete_volume" :: held 1.524s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:42:27 devstack sudo[114169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-555f8b55-e1d3-47eb-9a2b-64d108f0b06a Aug 26 14:42:27 devstack sudo[114169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:27 devstack sudo[114167]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:27 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-9ea7eeea-64e8-47fd-b939-b72989f21843 tempest-VolumeImageDependencyTests-1641410403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0c8829b9-052a-47c4-bdf3-386889b1a1b1_mt2j0ahwdevstack@QuobyteHD" returned: 1 in 0.401s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:27 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-9ea7eeea-64e8-47fd-b939-b72989f21843 tempest-VolumeImageDependencyTests-1641410403 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0c8829b9-052a-47c4-bdf3-386889b1a1b1_mt2j0ahwdevstack@QuobyteHD' failed. Not Retrying. {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 14:42:27 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-9ea7eeea-64e8-47fd-b939-b72989f21843 tempest-VolumeImageDependencyTests-1641410403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:42:27 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-9ea7eeea-64e8-47fd-b939-b72989f21843 tempest-VolumeImageDependencyTests-1641410403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:42:27 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-9ea7eeea-64e8-47fd-b939-b72989f21843 tempest-VolumeImageDependencyTests-1641410403 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:42:24Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de6963f1-5faa-4d92-a06c-6919a00bfe5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f76efe5cca9401eb4dc074601679fed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:42:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:42:25Z,use_quota=True,user_id='a5ba5599184e4b268e85c44015e21c7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:42:27 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-9ea7eeea-64e8-47fd-b939-b72989f21843 tempest-VolumeImageDependencyTests-1641410403 None] Creating volume de6963f1-5faa-4d92-a06c-6919a00bfe5d {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:42:27 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-9ea7eeea-64e8-47fd-b939-b72989f21843 tempest-VolumeImageDependencyTests-1641410403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:42:27 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-9ea7eeea-64e8-47fd-b939-b72989f21843 tempest-VolumeImageDependencyTests-1641410403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:42:27 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-9ea7eeea-64e8-47fd-b939-b72989f21843 tempest-VolumeImageDependencyTests-1641410403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:42:27 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-9ea7eeea-64e8-47fd-b939-b72989f21843 tempest-VolumeImageDependencyTests-1641410403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:42:27 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-9ea7eeea-64e8-47fd-b939-b72989f21843 tempest-VolumeImageDependencyTests-1641410403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:42:27 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-9ea7eeea-64e8-47fd-b939-b72989f21843 tempest-VolumeImageDependencyTests-1641410403 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:42:27 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-9ea7eeea-64e8-47fd-b939-b72989f21843 tempest-VolumeImageDependencyTests-1641410403 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:42:27 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-9ea7eeea-64e8-47fd-b939-b72989f21843 tempest-VolumeImageDependencyTests-1641410403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-de6963f1-5faa-4d92-a06c-6919a00bfe5d 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:27 devstack sudo[114175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-de6963f1-5faa-4d92-a06c-6919a00bfe5d 1073741824 Aug 26 14:42:27 devstack sudo[114175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:27 devstack sudo[114169]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:27 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-39358f25-ec25-46d7-b499-4de9048b24d7 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-555f8b55-e1d3-47eb-9a2b-64d108f0b06a" returned: 0 in 0.378s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:27 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-39358f25-ec25-46d7-b499-4de9048b24d7 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-555f8b55-e1d3-47eb-9a2b-64d108f0b06a {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:27 devstack sudo[114181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-555f8b55-e1d3-47eb-9a2b-64d108f0b06a Aug 26 14:42:27 devstack sudo[114181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:27 devstack sudo[114181]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:27 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-39358f25-ec25-46d7-b499-4de9048b24d7 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-555f8b55-e1d3-47eb-9a2b-64d108f0b06a" returned: 0 in 0.276s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:27 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-39358f25-ec25-46d7-b499-4de9048b24d7 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Lock "cinder-quobyte-555f8b55-e1d3-47eb-9a2b-64d108f0b06a" released by "delete_volume" :: held 0.711s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:42:27 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-39358f25-ec25-46d7-b499-4de9048b24d7 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Created reservations ['8d0a5183-ab97-4505-960f-a1a6819262da', 'd1ee65ee-7f8f-4c9c-8925-2cc886f1dd5f', 'bde01eb7-e904-4ada-80e1-d6d000e30a96', '0e61d031-130d-4cee-9674-81b2b799d264'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:42:27 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-8ea2aed8-30a2-471e-a0c9-8123f64c9133 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Acquiring lock "cinder-b5955fec-2901-4a15-b53d-a4cba7d81562-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:42:27 devstack sudo[114175]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:27 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-9ea7eeea-64e8-47fd-b939-b72989f21843 tempest-VolumeImageDependencyTests-1641410403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-de6963f1-5faa-4d92-a06c-6919a00bfe5d 1073741824" returned: 0 in 0.523s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:27 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-8ea2aed8-30a2-471e-a0c9-8123f64c9133 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Lock "cinder-b5955fec-2901-4a15-b53d-a4cba7d81562-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:42:27 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-8ea2aed8-30a2-471e-a0c9-8123f64c9133 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Acquiring lock "cinder-quobyte-b5955fec-2901-4a15-b53d-a4cba7d81562" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:42:27 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-39358f25-ec25-46d7-b499-4de9048b24d7 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:42:27 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-39358f25-ec25-46d7-b499-4de9048b24d7 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:42:27 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-39358f25-ec25-46d7-b499-4de9048b24d7 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:42:27 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-39358f25-ec25-46d7-b499-4de9048b24d7 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:42:27 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-39358f25-ec25-46d7-b499-4de9048b24d7 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:42:27 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-39358f25-ec25-46d7-b499-4de9048b24d7 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:28 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-9ea7eeea-64e8-47fd-b939-b72989f21843 tempest-VolumeImageDependencyTests-1641410403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-de6963f1-5faa-4d92-a06c-6919a00bfe5d {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:28 devstack sudo[114188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:42:28 devstack sudo[114188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:28 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-8ea2aed8-30a2-471e-a0c9-8123f64c9133 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Lock "cinder-quobyte-b5955fec-2901-4a15-b53d-a4cba7d81562" acquired by "delete_volume" :: waited 0.065s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:42:28 devstack sudo[114189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-de6963f1-5faa-4d92-a06c-6919a00bfe5d Aug 26 14:42:28 devstack sudo[114189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:28 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ad768b1-a4ed-47ef-a5d2-d5bb4e1766ec]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:42:28 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-8ea2aed8-30a2-471e-a0c9-8123f64c9133 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b5955fec-2901-4a15-b53d-a4cba7d81562 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:28 devstack sudo[114192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b5955fec-2901-4a15-b53d-a4cba7d81562 Aug 26 14:42:28 devstack sudo[114192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:28 devstack sudo[114188]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:28 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-39358f25-ec25-46d7-b499-4de9048b24d7 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.453s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:28 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-39358f25-ec25-46d7-b499-4de9048b24d7 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:42:28 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-39358f25-ec25-46d7-b499-4de9048b24d7 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Deleted volume successfully. Aug 26 14:42:28 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-39358f25-ec25-46d7-b499-4de9048b24d7 tempest-CreateVolumesFromSourceVolumeTest-1184938438 None] Lock "cinder-555f8b55-e1d3-47eb-9a2b-64d108f0b06a-delete_volume" released by "delete_volume" :: held 1.490s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:42:28 devstack sudo[114189]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:28 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-9ea7eeea-64e8-47fd-b939-b72989f21843 tempest-VolumeImageDependencyTests-1641410403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-de6963f1-5faa-4d92-a06c-6919a00bfe5d" returned: 0 in 0.492s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:28 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-9ea7eeea-64e8-47fd-b939-b72989f21843 tempest-VolumeImageDependencyTests-1641410403 None] <== create_volume: return (1111ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:42:28 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-9ea7eeea-64e8-47fd-b939-b72989f21843 tempest-VolumeImageDependencyTests-1641410403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.113s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:42:28 devstack sudo[114192]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:28 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-8ea2aed8-30a2-471e-a0c9-8123f64c9133 tempest-CreateVolumesFromSnapshotTest-1806966364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b5955fec-2901-4a15-b53d-a4cba7d81562" returned: 0 in 0.439s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:28 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-8ea2aed8-30a2-471e-a0c9-8123f64c9133 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b5955fec-2901-4a15-b53d-a4cba7d81562 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:28 devstack cinder-volume[94394]: DEBUG cinder.volume.volume_utils [None req-9ea7eeea-64e8-47fd-b939-b72989f21843 tempest-VolumeImageDependencyTests-1641410403 None] Attempting download of 0c8829b9-052a-47c4-bdf3-386889b1a1b1 ((None, [{'url': 'file:///opt/stack/data/glance/images/0c8829b9-052a-47c4-bdf3-386889b1a1b1', 'metadata': {}}])) to volume de6963f1-5faa-4d92-a06c-6919a00bfe5d. {{(pid=94394) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 26 14:42:28 devstack sudo[114200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b5955fec-2901-4a15-b53d-a4cba7d81562 Aug 26 14:42:28 devstack sudo[114200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:28 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[a26a7356-a046-4776-8ec9-d8fe22a6bdd8]: (4, 'raw') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:42:28 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-9ea7eeea-64e8-47fd-b939-b72989f21843 tempest-VolumeImageDependencyTests-1641410403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0c8829b9-052a-47c4-bdf3-386889b1a1b1_iwk9epln {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:28 devstack sudo[114202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0c8829b9-052a-47c4-bdf3-386889b1a1b1_iwk9epln Aug 26 14:42:28 devstack sudo[114202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:28 devstack sudo[114200]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:28 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-8ea2aed8-30a2-471e-a0c9-8123f64c9133 tempest-CreateVolumesFromSnapshotTest-1806966364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b5955fec-2901-4a15-b53d-a4cba7d81562" returned: 0 in 0.298s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:28 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-8ea2aed8-30a2-471e-a0c9-8123f64c9133 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Lock "cinder-quobyte-b5955fec-2901-4a15-b53d-a4cba7d81562" released by "delete_volume" :: held 0.808s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:42:28 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-8ea2aed8-30a2-471e-a0c9-8123f64c9133 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Created reservations ['46505c54-be3f-4fc5-ac0b-e2f49f10b854', 'a267f6ab-52c4-4642-8d83-95bcdb918714', 'f4b82918-2de5-47f5-a93c-799e0263eb6d', '84dbed4f-f4ff-402b-8630-634fb637cfd9'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:42:29 devstack sudo[114202]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:29 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-9ea7eeea-64e8-47fd-b939-b72989f21843 tempest-VolumeImageDependencyTests-1641410403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0c8829b9-052a-47c4-bdf3-386889b1a1b1_iwk9epln" returned: 0 in 0.399s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:29 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-9ea7eeea-64e8-47fd-b939-b72989f21843 tempest-VolumeImageDependencyTests-1641410403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0c8829b9-052a-47c4-bdf3-386889b1a1b1_iwk9epln {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:29 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-8ea2aed8-30a2-471e-a0c9-8123f64c9133 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:42:29 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-8ea2aed8-30a2-471e-a0c9-8123f64c9133 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:42:29 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-8ea2aed8-30a2-471e-a0c9-8123f64c9133 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:42:29 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-8ea2aed8-30a2-471e-a0c9-8123f64c9133 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:42:29 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-8ea2aed8-30a2-471e-a0c9-8123f64c9133 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:42:29 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-8ea2aed8-30a2-471e-a0c9-8123f64c9133 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:29 devstack sudo[114208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:42:29 devstack sudo[114208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:29 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-75511dd4-158d-4d16-85c8-028b3a3889eb tempest-CreateVolumesFromSnapshotTest-1806966364 None] Acquiring lock "cinder-2828911c-4fbd-4677-be7e-a8069766c95d-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:42:29 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-75511dd4-158d-4d16-85c8-028b3a3889eb tempest-CreateVolumesFromSnapshotTest-1806966364 None] Lock "cinder-2828911c-4fbd-4677-be7e-a8069766c95d-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:42:29 devstack sudo[114207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0c8829b9-052a-47c4-bdf3-386889b1a1b1_iwk9epln Aug 26 14:42:29 devstack sudo[114207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:29 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-75511dd4-158d-4d16-85c8-028b3a3889eb tempest-CreateVolumesFromSnapshotTest-1806966364 None] Acquiring lock "cinder-quobyte-2828911c-4fbd-4677-be7e-a8069766c95d" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:42:29 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-75511dd4-158d-4d16-85c8-028b3a3889eb tempest-CreateVolumesFromSnapshotTest-1806966364 None] Lock "cinder-quobyte-2828911c-4fbd-4677-be7e-a8069766c95d" acquired by "delete_volume" :: waited 0.039s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:42:29 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[adee15a4-9d56-4b2d-8282-8bb5dc1cf9fa]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:42:29 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-75511dd4-158d-4d16-85c8-028b3a3889eb tempest-CreateVolumesFromSnapshotTest-1806966364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2828911c-4fbd-4677-be7e-a8069766c95d {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:29 devstack sudo[114208]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:29 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-8ea2aed8-30a2-471e-a0c9-8123f64c9133 tempest-CreateVolumesFromSnapshotTest-1806966364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.392s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:29 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-8ea2aed8-30a2-471e-a0c9-8123f64c9133 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:42:29 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-8ea2aed8-30a2-471e-a0c9-8123f64c9133 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Deleted volume successfully. Aug 26 14:42:29 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-8ea2aed8-30a2-471e-a0c9-8123f64c9133 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Lock "cinder-b5955fec-2901-4a15-b53d-a4cba7d81562-delete_volume" released by "delete_volume" :: held 1.619s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:42:29 devstack sudo[114207]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:29 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-9ea7eeea-64e8-47fd-b939-b72989f21843 tempest-VolumeImageDependencyTests-1641410403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0c8829b9-052a-47c4-bdf3-386889b1a1b1_iwk9epln" returned: 1 in 0.544s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:29 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-9ea7eeea-64e8-47fd-b939-b72989f21843 tempest-VolumeImageDependencyTests-1641410403 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0c8829b9-052a-47c4-bdf3-386889b1a1b1_iwk9epln' failed. Not Retrying. {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 14:42:29 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7943a6e-1069-4154-8f00-0a9e01ea1fc6]: (4, 'raw') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:42:29 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-9ea7eeea-64e8-47fd-b939-b72989f21843 tempest-VolumeImageDependencyTests-1641410403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0c8829b9-052a-47c4-bdf3-386889b1a1b1_mt2j0ahwdevstack@QuobyteHD {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:29 devstack sudo[114211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2828911c-4fbd-4677-be7e-a8069766c95d Aug 26 14:42:29 devstack sudo[114211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:29 devstack sudo[114215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0c8829b9-052a-47c4-bdf3-386889b1a1b1_mt2j0ahwdevstack@QuobyteHD Aug 26 14:42:29 devstack sudo[114215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:29 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-1901e696-f68c-4d0b-81aa-4df75902d55e tempest-CinderUnicodeTest-714633432 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:42:29 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-1901e696-f68c-4d0b-81aa-4df75902d55e tempest-CinderUnicodeTest-714633432 None] Flow 'volume_create_manager' (7bda2b50-9b3a-47e7-ad08-2d0c436afec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:42:29 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-1901e696-f68c-4d0b-81aa-4df75902d55e tempest-CinderUnicodeTest-714633432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76e5ed28-2ca3-4a56-a1b4-6d2ee78611c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:29 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-1901e696-f68c-4d0b-81aa-4df75902d55e tempest-CinderUnicodeTest-714633432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76e5ed28-2ca3-4a56-a1b4-6d2ee78611c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:42:29Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fef507c2-daea-4375-9184-69f6afc808ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d34b42b3ba54a87a66c4c11c3686743',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:42:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:42:30Z,use_quota=True,user_id='9c365232231a4203afa918f4cce57bba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:29 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-1901e696-f68c-4d0b-81aa-4df75902d55e tempest-CinderUnicodeTest-714633432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb012419-4c94-49cf-b954-39251dbef378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:29 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-1901e696-f68c-4d0b-81aa-4df75902d55e tempest-CinderUnicodeTest-714633432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb012419-4c94-49cf-b954-39251dbef378) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:29 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-1901e696-f68c-4d0b-81aa-4df75902d55e tempest-CinderUnicodeTest-714633432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7f58950-295c-4ee2-bf16-af47a78e657e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:29 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-1901e696-f68c-4d0b-81aa-4df75902d55e tempest-CinderUnicodeTest-714633432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7f58950-295c-4ee2-bf16-af47a78e657e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fef507c2-daea-4375-9184-69f6afc808ba', 'volume_name': 'volume-fef507c2-daea-4375-9184-69f6afc808ba', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:29 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-1901e696-f68c-4d0b-81aa-4df75902d55e tempest-CinderUnicodeTest-714633432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aaee941f-795b-4b34-b176-d3bffb3f5438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:29 devstack sudo[114211]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:29 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-1901e696-f68c-4d0b-81aa-4df75902d55e tempest-CinderUnicodeTest-714633432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aaee941f-795b-4b34-b176-d3bffb3f5438) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:29 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-1901e696-f68c-4d0b-81aa-4df75902d55e tempest-CinderUnicodeTest-714633432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (126249c0-58d7-4363-8daa-20d76f7d2822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:29 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-1901e696-f68c-4d0b-81aa-4df75902d55e tempest-CinderUnicodeTest-714633432 None] Volume fef507c2-daea-4375-9184-69f6afc808ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fef507c2-daea-4375-9184-69f6afc808ba', 'volume_size': 1} Aug 26 14:42:29 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-1901e696-f68c-4d0b-81aa-4df75902d55e tempest-CinderUnicodeTest-714633432 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:42:29 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-1901e696-f68c-4d0b-81aa-4df75902d55e tempest-CinderUnicodeTest-714633432 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:42:29 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-1901e696-f68c-4d0b-81aa-4df75902d55e tempest-CinderUnicodeTest-714633432 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:42:29Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fef507c2-daea-4375-9184-69f6afc808ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d34b42b3ba54a87a66c4c11c3686743',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:42:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:42:30Z,use_quota=True,user_id='9c365232231a4203afa918f4cce57bba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:42:29 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-1901e696-f68c-4d0b-81aa-4df75902d55e tempest-CinderUnicodeTest-714633432 None] Creating volume fef507c2-daea-4375-9184-69f6afc808ba {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:42:29 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-1901e696-f68c-4d0b-81aa-4df75902d55e tempest-CinderUnicodeTest-714633432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:42:29 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-1901e696-f68c-4d0b-81aa-4df75902d55e tempest-CinderUnicodeTest-714633432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:42:29 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-1901e696-f68c-4d0b-81aa-4df75902d55e tempest-CinderUnicodeTest-714633432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:42:29 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-1901e696-f68c-4d0b-81aa-4df75902d55e tempest-CinderUnicodeTest-714633432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:42:29 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-1901e696-f68c-4d0b-81aa-4df75902d55e tempest-CinderUnicodeTest-714633432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:42:29 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-1901e696-f68c-4d0b-81aa-4df75902d55e tempest-CinderUnicodeTest-714633432 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:42:29 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-1901e696-f68c-4d0b-81aa-4df75902d55e tempest-CinderUnicodeTest-714633432 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:42:29 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-1901e696-f68c-4d0b-81aa-4df75902d55e tempest-CinderUnicodeTest-714633432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-fef507c2-daea-4375-9184-69f6afc808ba 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:29 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-75511dd4-158d-4d16-85c8-028b3a3889eb tempest-CreateVolumesFromSnapshotTest-1806966364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2828911c-4fbd-4677-be7e-a8069766c95d" returned: 0 in 0.535s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:29 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-75511dd4-158d-4d16-85c8-028b3a3889eb tempest-CreateVolumesFromSnapshotTest-1806966364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2828911c-4fbd-4677-be7e-a8069766c95d {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:29 devstack sudo[114221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-fef507c2-daea-4375-9184-69f6afc808ba 1073741824 Aug 26 14:42:29 devstack sudo[114221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:29 devstack sudo[114215]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:29 devstack sudo[114224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2828911c-4fbd-4677-be7e-a8069766c95d Aug 26 14:42:29 devstack sudo[114224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:29 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-9ea7eeea-64e8-47fd-b939-b72989f21843 tempest-VolumeImageDependencyTests-1641410403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0c8829b9-052a-47c4-bdf3-386889b1a1b1_mt2j0ahwdevstack@QuobyteHD" returned: 0 in 0.387s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:29 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-9ea7eeea-64e8-47fd-b939-b72989f21843 tempest-VolumeImageDependencyTests-1641410403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0c8829b9-052a-47c4-bdf3-386889b1a1b1_mt2j0ahwdevstack@QuobyteHD {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:30 devstack sudo[114227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0c8829b9-052a-47c4-bdf3-386889b1a1b1_mt2j0ahwdevstack@QuobyteHD Aug 26 14:42:30 devstack sudo[114227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:30 devstack sudo[114224]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:30 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-75511dd4-158d-4d16-85c8-028b3a3889eb tempest-CreateVolumesFromSnapshotTest-1806966364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2828911c-4fbd-4677-be7e-a8069766c95d" returned: 0 in 0.308s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:30 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-75511dd4-158d-4d16-85c8-028b3a3889eb tempest-CreateVolumesFromSnapshotTest-1806966364 None] Lock "cinder-quobyte-2828911c-4fbd-4677-be7e-a8069766c95d" released by "delete_volume" :: held 0.900s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:42:30 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-75511dd4-158d-4d16-85c8-028b3a3889eb tempest-CreateVolumesFromSnapshotTest-1806966364 None] Created reservations ['c0f0c461-8d89-4f64-9656-d913777ef666', 'ddc46629-9932-4ad3-b264-314112229846', 'fa3697fe-a176-4d65-978e-9deacc40ca00', '25544cd1-4519-405d-952f-bdb4f8f2bb4e'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:42:30 devstack sudo[114227]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:30 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-9ea7eeea-64e8-47fd-b939-b72989f21843 tempest-VolumeImageDependencyTests-1641410403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0c8829b9-052a-47c4-bdf3-386889b1a1b1_mt2j0ahwdevstack@QuobyteHD" returned: 1 in 0.428s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:30 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-9ea7eeea-64e8-47fd-b939-b72989f21843 tempest-VolumeImageDependencyTests-1641410403 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0c8829b9-052a-47c4-bdf3-386889b1a1b1_mt2j0ahwdevstack@QuobyteHD' failed. Not Retrying. {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 14:42:30 devstack cinder-volume[94394]: DEBUG cinder.image.image_utils [None req-9ea7eeea-64e8-47fd-b939-b72989f21843 tempest-VolumeImageDependencyTests-1641410403 None] 0c8829b9-052a-47c4-bdf3-386889b1a1b1 was raw, converting to qcow2 {{(pid=94394) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 26 14:42:30 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-9ea7eeea-64e8-47fd-b939-b72989f21843 tempest-VolumeImageDependencyTests-1641410403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_0c8829b9-052a-47c4-bdf3-386889b1a1b1_mt2j0ahwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-de6963f1-5faa-4d92-a06c-6919a00bfe5d {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:30 devstack sudo[114237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_0c8829b9-052a-47c4-bdf3-386889b1a1b1_mt2j0ahwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-de6963f1-5faa-4d92-a06c-6919a00bfe5d Aug 26 14:42:30 devstack sudo[114237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:30 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-75511dd4-158d-4d16-85c8-028b3a3889eb tempest-CreateVolumesFromSnapshotTest-1806966364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:42:30 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-75511dd4-158d-4d16-85c8-028b3a3889eb tempest-CreateVolumesFromSnapshotTest-1806966364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:42:30 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-75511dd4-158d-4d16-85c8-028b3a3889eb tempest-CreateVolumesFromSnapshotTest-1806966364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:42:30 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-75511dd4-158d-4d16-85c8-028b3a3889eb tempest-CreateVolumesFromSnapshotTest-1806966364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:42:30 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-75511dd4-158d-4d16-85c8-028b3a3889eb tempest-CreateVolumesFromSnapshotTest-1806966364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:42:30 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-75511dd4-158d-4d16-85c8-028b3a3889eb tempest-CreateVolumesFromSnapshotTest-1806966364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:30 devstack sudo[114239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:42:30 devstack sudo[114239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:30 devstack sudo[114221]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:30 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-1901e696-f68c-4d0b-81aa-4df75902d55e tempest-CinderUnicodeTest-714633432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-fef507c2-daea-4375-9184-69f6afc808ba 1073741824" returned: 0 in 0.600s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:30 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-1901e696-f68c-4d0b-81aa-4df75902d55e tempest-CinderUnicodeTest-714633432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-fef507c2-daea-4375-9184-69f6afc808ba {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:30 devstack sudo[114241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-fef507c2-daea-4375-9184-69f6afc808ba Aug 26 14:42:30 devstack sudo[114241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:30 devstack sudo[114239]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:30 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-75511dd4-158d-4d16-85c8-028b3a3889eb tempest-CreateVolumesFromSnapshotTest-1806966364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.324s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:30 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-75511dd4-158d-4d16-85c8-028b3a3889eb tempest-CreateVolumesFromSnapshotTest-1806966364 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:42:30 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-75511dd4-158d-4d16-85c8-028b3a3889eb tempest-CreateVolumesFromSnapshotTest-1806966364 None] Deleted volume successfully. Aug 26 14:42:30 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-75511dd4-158d-4d16-85c8-028b3a3889eb tempest-CreateVolumesFromSnapshotTest-1806966364 None] Lock "cinder-2828911c-4fbd-4677-be7e-a8069766c95d-delete_volume" released by "delete_volume" :: held 1.571s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:42:30 devstack sudo[114241]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:30 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-1901e696-f68c-4d0b-81aa-4df75902d55e tempest-CinderUnicodeTest-714633432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-fef507c2-daea-4375-9184-69f6afc808ba" returned: 0 in 0.301s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:30 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-1901e696-f68c-4d0b-81aa-4df75902d55e tempest-CinderUnicodeTest-714633432 None] <== create_volume: return (944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:42:30 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-1901e696-f68c-4d0b-81aa-4df75902d55e tempest-CinderUnicodeTest-714633432 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:42:30 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-1901e696-f68c-4d0b-81aa-4df75902d55e tempest-CinderUnicodeTest-714633432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (126249c0-58d7-4363-8daa-20d76f7d2822) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fef507c2-daea-4375-9184-69f6afc808ba', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:30 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-1901e696-f68c-4d0b-81aa-4df75902d55e tempest-CinderUnicodeTest-714633432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ac96261-4e58-4d4f-9178-f8917ea6d67e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:30 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-1901e696-f68c-4d0b-81aa-4df75902d55e tempest-CinderUnicodeTest-714633432 None] Volume volume-fef507c2-daea-4375-9184-69f6afc808ba (fef507c2-daea-4375-9184-69f6afc808ba): created successfully Aug 26 14:42:30 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-1901e696-f68c-4d0b-81aa-4df75902d55e tempest-CinderUnicodeTest-714633432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ac96261-4e58-4d4f-9178-f8917ea6d67e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:30 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-1901e696-f68c-4d0b-81aa-4df75902d55e tempest-CinderUnicodeTest-714633432 None] Flow 'volume_create_manager' (7bda2b50-9b3a-47e7-ad08-2d0c436afec0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:42:30 devstack sudo[114237]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:30 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-9ea7eeea-64e8-47fd-b939-b72989f21843 tempest-VolumeImageDependencyTests-1641410403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_0c8829b9-052a-47c4-bdf3-386889b1a1b1_mt2j0ahwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-de6963f1-5faa-4d92-a06c-6919a00bfe5d" returned: 0 in 0.501s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:30 devstack cinder-volume[94394]: DEBUG cinder.image.image_utils [None req-9ea7eeea-64e8-47fd-b939-b72989f21843 tempest-VolumeImageDependencyTests-1641410403 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0c8829b9-052a-47c4-bdf3-386889b1a1b1_mt2j0ahwdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-de6963f1-5faa-4d92-a06c-6919a00bfe5d {{(pid=94394) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 14:42:30 devstack cinder-volume[94394]: INFO cinder.image.image_utils [None req-9ea7eeea-64e8-47fd-b939-b72989f21843 tempest-VolumeImageDependencyTests-1641410403 None] Converted 0.00 MB image at 0.00 MB/s Aug 26 14:42:30 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-9ea7eeea-64e8-47fd-b939-b72989f21843 tempest-VolumeImageDependencyTests-1641410403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-de6963f1-5faa-4d92-a06c-6919a00bfe5d 1G {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:30 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-1901e696-f68c-4d0b-81aa-4df75902d55e tempest-CinderUnicodeTest-714633432 None] Created volume successfully. Aug 26 14:42:30 devstack sudo[114250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-de6963f1-5faa-4d92-a06c-6919a00bfe5d 1G Aug 26 14:42:30 devstack sudo[114250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:31 devstack sudo[114250]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:31 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-9ea7eeea-64e8-47fd-b939-b72989f21843 tempest-VolumeImageDependencyTests-1641410403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-de6963f1-5faa-4d92-a06c-6919a00bfe5d 1G" returned: 0 in 0.352s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:31 devstack cinder-volume[94394]: DEBUG cinder.volume.volume_utils [None req-9ea7eeea-64e8-47fd-b939-b72989f21843 tempest-VolumeImageDependencyTests-1641410403 None] Downloaded image 0c8829b9-052a-47c4-bdf3-386889b1a1b1 ((None, [{'url': 'file:///opt/stack/data/glance/images/0c8829b9-052a-47c4-bdf3-386889b1a1b1', 'metadata': {}}])) to volume de6963f1-5faa-4d92-a06c-6919a00bfe5d successfully. {{(pid=94394) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 26 14:42:31 devstack cinder-volume[94394]: DEBUG cinder.image.image_utils [None req-9ea7eeea-64e8-47fd-b939-b72989f21843 tempest-VolumeImageDependencyTests-1641410403 None] Temporary image 0c8829b9-052a-47c4-bdf3-386889b1a1b1 for user a5ba5599184e4b268e85c44015e21c7d is deleted. {{(pid=94394) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 26 14:42:31 devstack cinder-volume[94394]: DEBUG cinder.volume.volume_utils [None req-9ea7eeea-64e8-47fd-b939-b72989f21843 tempest-VolumeImageDependencyTests-1641410403 None] Marking volume de6963f1-5faa-4d92-a06c-6919a00bfe5d as bootable. {{(pid=94394) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 26 14:42:31 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ea7eeea-64e8-47fd-b939-b72989f21843 tempest-VolumeImageDependencyTests-1641410403 None] Copying metadata from image 0c8829b9-052a-47c4-bdf3-386889b1a1b1 to de6963f1-5faa-4d92-a06c-6919a00bfe5d. {{(pid=94394) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 26 14:42:31 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ea7eeea-64e8-47fd-b939-b72989f21843 tempest-VolumeImageDependencyTests-1641410403 None] Creating volume glance metadata for volume de6963f1-5faa-4d92-a06c-6919a00bfe5d backed by image 0c8829b9-052a-47c4-bdf3-386889b1a1b1 with: {'image_id': '0c8829b9-052a-47c4-bdf3-386889b1a1b1', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '3a9c162de5ee98b9caff5f5c89bb445f', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=94394) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 26 14:42:31 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-9ea7eeea-64e8-47fd-b939-b72989f21843 tempest-VolumeImageDependencyTests-1641410403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f67e172f-83f8-452f-80c4-7300affaa9f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de6963f1-5faa-4d92-a06c-6919a00bfe5d', 'volume_size': 1, 'image_id': '0c8829b9-052a-47c4-bdf3-386889b1a1b1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0c8829b9-052a-47c4-bdf3-386889b1a1b1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3a9c162de5ee98b9caff5f5c89bb445f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3f76efe5cca9401eb4dc074601679fed', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f4dca8f937783fcc94008b8a529ed2e1d76d239415f65b9574b3b2200f90960976a5c7afa62e0d785abed5ca58424b449053af74341647a0a883b1339f383272', 'id': '0c8829b9-052a-47c4-bdf3-386889b1a1b1', 'created_at': datetime.datetime(2026, 8, 26, 12, 42, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 12, 42, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0c8829b9-052a-47c4-bdf3-386889b1a1b1/file', 'properties': {}}, 'image_service': }' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:31 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-9ea7eeea-64e8-47fd-b939-b72989f21843 tempest-VolumeImageDependencyTests-1641410403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2d8bbfd-76e9-42f6-a0d6-b77335e955de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:31 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-9ea7eeea-64e8-47fd-b939-b72989f21843 tempest-VolumeImageDependencyTests-1641410403 None] Volume volume-de6963f1-5faa-4d92-a06c-6919a00bfe5d (de6963f1-5faa-4d92-a06c-6919a00bfe5d): created successfully Aug 26 14:42:31 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-9ea7eeea-64e8-47fd-b939-b72989f21843 tempest-VolumeImageDependencyTests-1641410403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2d8bbfd-76e9-42f6-a0d6-b77335e955de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:31 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-9ea7eeea-64e8-47fd-b939-b72989f21843 tempest-VolumeImageDependencyTests-1641410403 None] Flow 'volume_create_manager' (4496e400-caf9-47b4-91d1-0cdf17578e03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:42:31 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-9ea7eeea-64e8-47fd-b939-b72989f21843 tempest-VolumeImageDependencyTests-1641410403 None] Created volume successfully. Aug 26 14:42:31 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-ddaf95ae-48db-4f54-95ff-3f2d290e8131 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Acquiring lock "cinder-e305f68b-1993-4de1-9908-a5a4983d8dc3-delete_snapshot" by "delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:42:31 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-ddaf95ae-48db-4f54-95ff-3f2d290e8131 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Lock "cinder-e305f68b-1993-4de1-9908-a5a4983d8dc3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:42:31 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-ddaf95ae-48db-4f54-95ff-3f2d290e8131 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Acquiring lock "cinder-quobyte-839c1e2a-1e7a-4ad6-a829-7624ecbe0348" by "delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:42:31 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-ddaf95ae-48db-4f54-95ff-3f2d290e8131 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Lock "cinder-quobyte-839c1e2a-1e7a-4ad6-a829-7624ecbe0348" acquired by "delete_snapshot" :: waited 0.016s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:42:31 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-ddaf95ae-48db-4f54-95ff-3f2d290e8131 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Acquiring lock "cinder-quobyte-e305f68b-1993-4de1-9908-a5a4983d8dc3" by "_delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:42:31 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-ddaf95ae-48db-4f54-95ff-3f2d290e8131 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Lock "cinder-quobyte-e305f68b-1993-4de1-9908-a5a4983d8dc3" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:42:31 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-ddaf95ae-48db-4f54-95ff-3f2d290e8131 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Deleting offline snapshot e305f68b-1993-4de1-9908-a5a4983d8dc3 of volume 839c1e2a-1e7a-4ad6-a829-7624ecbe0348 {{(pid=94394) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 14:42:31 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-ddaf95ae-48db-4f54-95ff-3f2d290e8131 tempest-CreateVolumesFromSnapshotTest-1806966364 None] snapshot_file for this snap is: volume-839c1e2a-1e7a-4ad6-a829-7624ecbe0348.e305f68b-1993-4de1-9908-a5a4983d8dc3 {{(pid=94394) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 14:42:31 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[52272d6d-7bca-44ef-92f4-77e883cd2e00]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:42:31 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-ddaf95ae-48db-4f54-95ff-3f2d290e8131 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-839c1e2a-1e7a-4ad6-a829-7624ecbe0348.e305f68b-1993-4de1-9908-a5a4983d8dc3 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:31 devstack sudo[114255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-839c1e2a-1e7a-4ad6-a829-7624ecbe0348.e305f68b-1993-4de1-9908-a5a4983d8dc3 Aug 26 14:42:31 devstack sudo[114255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:31 devstack sudo[114255]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:31 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-ddaf95ae-48db-4f54-95ff-3f2d290e8131 tempest-CreateVolumesFromSnapshotTest-1806966364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-839c1e2a-1e7a-4ad6-a829-7624ecbe0348.e305f68b-1993-4de1-9908-a5a4983d8dc3" returned: 0 in 0.375s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:31 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-ddaf95ae-48db-4f54-95ff-3f2d290e8131 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-839c1e2a-1e7a-4ad6-a829-7624ecbe0348(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94394) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 14:42:31 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-46a0bc0c-3c33-417d-9f1f-8063b2913fe2 tempest-ProjectAdminTests-375244635 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.8208618164062, 'free_capacity_gb': 1774.8208618164062, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=94394) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Aug 26 14:42:31 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[3481695f-cbe4-46ce-a843-3bc841aa1e0b]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:42:31 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-ddaf95ae-48db-4f54-95ff-3f2d290e8131 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-839c1e2a-1e7a-4ad6-a829-7624ecbe0348 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:32 devstack sudo[114260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-839c1e2a-1e7a-4ad6-a829-7624ecbe0348 Aug 26 14:42:32 devstack sudo[114260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:32 devstack sudo[114260]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:32 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-ddaf95ae-48db-4f54-95ff-3f2d290e8131 tempest-CreateVolumesFromSnapshotTest-1806966364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-839c1e2a-1e7a-4ad6-a829-7624ecbe0348" returned: 0 in 0.469s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:32 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-ddaf95ae-48db-4f54-95ff-3f2d290e8131 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-839c1e2a-1e7a-4ad6-a829-7624ecbe0348.e305f68b-1993-4de1-9908-a5a4983d8dc3 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:32 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-24f60619-0892-4e4f-89f8-d54f8428d548 tempest-CinderUnicodeTest-714633432 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:42:32 devstack sudo[114266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-839c1e2a-1e7a-4ad6-a829-7624ecbe0348.e305f68b-1993-4de1-9908-a5a4983d8dc3 Aug 26 14:42:32 devstack sudo[114266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:32 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-24f60619-0892-4e4f-89f8-d54f8428d548 tempest-CinderUnicodeTest-714633432 None] Flow 'volume_create_manager' (77989426-caff-4516-8561-1d5d45f1b06f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:42:32 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-24f60619-0892-4e4f-89f8-d54f8428d548 tempest-CinderUnicodeTest-714633432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76c64771-4f26-4bb2-aa3e-9677908cb764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:32 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-6305e3c5-1f02-44fc-97bd-4711f01c9c46 tempest-VolumeImageDependencyTests-1641410403 None] Acquiring lock "cinder-de6963f1-5faa-4d92-a06c-6919a00bfe5d-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:42:32 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-24f60619-0892-4e4f-89f8-d54f8428d548 tempest-CinderUnicodeTest-714633432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76c64771-4f26-4bb2-aa3e-9677908cb764) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:42:32Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-112981940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c0813ae-05ee-4905-b58d-99fdf524aaeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d34b42b3ba54a87a66c4c11c3686743',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:42:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:42:32Z,use_quota=True,user_id='9c365232231a4203afa918f4cce57bba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:32 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-24f60619-0892-4e4f-89f8-d54f8428d548 tempest-CinderUnicodeTest-714633432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af53dd30-21a5-47ac-9270-f567e1eac7cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:32 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-24f60619-0892-4e4f-89f8-d54f8428d548 tempest-CinderUnicodeTest-714633432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af53dd30-21a5-47ac-9270-f567e1eac7cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:32 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-24f60619-0892-4e4f-89f8-d54f8428d548 tempest-CinderUnicodeTest-714633432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d454ee87-27a0-446f-8a64-3faae765213f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:32 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-24f60619-0892-4e4f-89f8-d54f8428d548 tempest-CinderUnicodeTest-714633432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d454ee87-27a0-446f-8a64-3faae765213f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c0813ae-05ee-4905-b58d-99fdf524aaeb', 'volume_name': 'volume-2c0813ae-05ee-4905-b58d-99fdf524aaeb', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:32 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-24f60619-0892-4e4f-89f8-d54f8428d548 tempest-CinderUnicodeTest-714633432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (feec3ef7-b5b6-4305-bff1-126d3cc179df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:32 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-24f60619-0892-4e4f-89f8-d54f8428d548 tempest-CinderUnicodeTest-714633432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (feec3ef7-b5b6-4305-bff1-126d3cc179df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:32 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-24f60619-0892-4e4f-89f8-d54f8428d548 tempest-CinderUnicodeTest-714633432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfea8054-cddd-465a-8270-daa0dff1d9c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:32 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-24f60619-0892-4e4f-89f8-d54f8428d548 tempest-CinderUnicodeTest-714633432 None] Volume 2c0813ae-05ee-4905-b58d-99fdf524aaeb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c0813ae-05ee-4905-b58d-99fdf524aaeb', 'volume_size': 1} Aug 26 14:42:32 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-24f60619-0892-4e4f-89f8-d54f8428d548 tempest-CinderUnicodeTest-714633432 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:42:32 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-24f60619-0892-4e4f-89f8-d54f8428d548 tempest-CinderUnicodeTest-714633432 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:42:32 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-24f60619-0892-4e4f-89f8-d54f8428d548 tempest-CinderUnicodeTest-714633432 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:42:32Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-112981940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c0813ae-05ee-4905-b58d-99fdf524aaeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d34b42b3ba54a87a66c4c11c3686743',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:42:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:42:32Z,use_quota=True,user_id='9c365232231a4203afa918f4cce57bba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:42:32 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-24f60619-0892-4e4f-89f8-d54f8428d548 tempest-CinderUnicodeTest-714633432 None] Creating volume 2c0813ae-05ee-4905-b58d-99fdf524aaeb {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:42:32 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-24f60619-0892-4e4f-89f8-d54f8428d548 tempest-CinderUnicodeTest-714633432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:42:32 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-24f60619-0892-4e4f-89f8-d54f8428d548 tempest-CinderUnicodeTest-714633432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:42:32 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-24f60619-0892-4e4f-89f8-d54f8428d548 tempest-CinderUnicodeTest-714633432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:42:32 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-24f60619-0892-4e4f-89f8-d54f8428d548 tempest-CinderUnicodeTest-714633432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:42:32 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-24f60619-0892-4e4f-89f8-d54f8428d548 tempest-CinderUnicodeTest-714633432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:42:32 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-24f60619-0892-4e4f-89f8-d54f8428d548 tempest-CinderUnicodeTest-714633432 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:42:32 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-24f60619-0892-4e4f-89f8-d54f8428d548 tempest-CinderUnicodeTest-714633432 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:42:32 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-24f60619-0892-4e4f-89f8-d54f8428d548 tempest-CinderUnicodeTest-714633432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2c0813ae-05ee-4905-b58d-99fdf524aaeb 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:32 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-6305e3c5-1f02-44fc-97bd-4711f01c9c46 tempest-VolumeImageDependencyTests-1641410403 None] Lock "cinder-de6963f1-5faa-4d92-a06c-6919a00bfe5d-delete_volume" acquired by "delete_volume" :: waited 0.109s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:42:32 devstack sudo[114268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2c0813ae-05ee-4905-b58d-99fdf524aaeb 1073741824 Aug 26 14:42:32 devstack sudo[114268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:32 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-6305e3c5-1f02-44fc-97bd-4711f01c9c46 tempest-VolumeImageDependencyTests-1641410403 None] Acquiring lock "cinder-quobyte-de6963f1-5faa-4d92-a06c-6919a00bfe5d" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:42:32 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-6305e3c5-1f02-44fc-97bd-4711f01c9c46 tempest-VolumeImageDependencyTests-1641410403 None] Lock "cinder-quobyte-de6963f1-5faa-4d92-a06c-6919a00bfe5d" acquired by "delete_volume" :: waited 0.017s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:42:32 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4201bd4-7acb-4243-a51b-06ca3536524a]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:42:32 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-6305e3c5-1f02-44fc-97bd-4711f01c9c46 tempest-VolumeImageDependencyTests-1641410403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-de6963f1-5faa-4d92-a06c-6919a00bfe5d {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:32 devstack sudo[114266]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:32 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-ddaf95ae-48db-4f54-95ff-3f2d290e8131 tempest-CreateVolumesFromSnapshotTest-1806966364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-839c1e2a-1e7a-4ad6-a829-7624ecbe0348.e305f68b-1993-4de1-9908-a5a4983d8dc3" returned: 0 in 0.411s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:32 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-ddaf95ae-48db-4f54-95ff-3f2d290e8131 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-839c1e2a-1e7a-4ad6-a829-7624ecbe0348.e305f68b-1993-4de1-9908-a5a4983d8dc3 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:32 devstack sudo[114272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-de6963f1-5faa-4d92-a06c-6919a00bfe5d Aug 26 14:42:32 devstack sudo[114272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:32 devstack sudo[114277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-839c1e2a-1e7a-4ad6-a829-7624ecbe0348.e305f68b-1993-4de1-9908-a5a4983d8dc3 Aug 26 14:42:32 devstack sudo[114277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:33 devstack sudo[114268]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-24f60619-0892-4e4f-89f8-d54f8428d548 tempest-CinderUnicodeTest-714633432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2c0813ae-05ee-4905-b58d-99fdf524aaeb 1073741824" returned: 0 in 0.492s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:33 devstack sudo[114277]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-24f60619-0892-4e4f-89f8-d54f8428d548 tempest-CinderUnicodeTest-714633432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2c0813ae-05ee-4905-b58d-99fdf524aaeb {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-ddaf95ae-48db-4f54-95ff-3f2d290e8131 tempest-CreateVolumesFromSnapshotTest-1806966364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-839c1e2a-1e7a-4ad6-a829-7624ecbe0348.e305f68b-1993-4de1-9908-a5a4983d8dc3" returned: 0 in 0.306s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:33 devstack sudo[114272]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-6305e3c5-1f02-44fc-97bd-4711f01c9c46 tempest-VolumeImageDependencyTests-1641410403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-de6963f1-5faa-4d92-a06c-6919a00bfe5d" returned: 0 in 0.463s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-6305e3c5-1f02-44fc-97bd-4711f01c9c46 tempest-VolumeImageDependencyTests-1641410403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-de6963f1-5faa-4d92-a06c-6919a00bfe5d {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:33 devstack sudo[114284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2c0813ae-05ee-4905-b58d-99fdf524aaeb Aug 26 14:42:33 devstack sudo[114284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:33 devstack sudo[114286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-de6963f1-5faa-4d92-a06c-6919a00bfe5d Aug 26 14:42:33 devstack sudo[114286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:33 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-ddaf95ae-48db-4f54-95ff-3f2d290e8131 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Lock "cinder-quobyte-e305f68b-1993-4de1-9908-a5a4983d8dc3" released by "_delete_snapshot" :: held 1.742s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:42:33 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-ddaf95ae-48db-4f54-95ff-3f2d290e8131 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Lock "cinder-quobyte-839c1e2a-1e7a-4ad6-a829-7624ecbe0348" released by "delete_snapshot" :: held 1.773s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:42:33 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-ddaf95ae-48db-4f54-95ff-3f2d290e8131 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Created reservations ['f8f01637-ec0b-4ede-94ad-2ae8b4dcfc71', '0157ec9d-6e76-4b28-b0ce-2d1988606388', '9ff21be1-d7d1-4d70-943c-0df87bf08a95', '165d5c71-fd63-4bf9-8b1e-40cc8126a9bf'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:42:33 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-ddaf95ae-48db-4f54-95ff-3f2d290e8131 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Delete snapshot completed successfully. Aug 26 14:42:33 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-ddaf95ae-48db-4f54-95ff-3f2d290e8131 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Lock "cinder-e305f68b-1993-4de1-9908-a5a4983d8dc3-delete_snapshot" released by "delete_snapshot" :: held 1.950s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:42:33 devstack sudo[114284]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-24f60619-0892-4e4f-89f8-d54f8428d548 tempest-CinderUnicodeTest-714633432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2c0813ae-05ee-4905-b58d-99fdf524aaeb" returned: 0 in 0.338s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:33 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-24f60619-0892-4e4f-89f8-d54f8428d548 tempest-CinderUnicodeTest-714633432 None] <== create_volume: return (892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:42:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-24f60619-0892-4e4f-89f8-d54f8428d548 tempest-CinderUnicodeTest-714633432 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.895s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:42:33 devstack sudo[114286]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:33 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-24f60619-0892-4e4f-89f8-d54f8428d548 tempest-CinderUnicodeTest-714633432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfea8054-cddd-465a-8270-daa0dff1d9c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c0813ae-05ee-4905-b58d-99fdf524aaeb', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:33 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-24f60619-0892-4e4f-89f8-d54f8428d548 tempest-CinderUnicodeTest-714633432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e323aca-2310-4560-9640-7639558d9478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-6305e3c5-1f02-44fc-97bd-4711f01c9c46 tempest-VolumeImageDependencyTests-1641410403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-de6963f1-5faa-4d92-a06c-6919a00bfe5d" returned: 0 in 0.337s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:33 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-24f60619-0892-4e4f-89f8-d54f8428d548 tempest-CinderUnicodeTest-714633432 None] Volume volume-2c0813ae-05ee-4905-b58d-99fdf524aaeb (2c0813ae-05ee-4905-b58d-99fdf524aaeb): created successfully Aug 26 14:42:33 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-24f60619-0892-4e4f-89f8-d54f8428d548 tempest-CinderUnicodeTest-714633432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e323aca-2310-4560-9640-7639558d9478) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:33 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-24f60619-0892-4e4f-89f8-d54f8428d548 tempest-CinderUnicodeTest-714633432 None] Flow 'volume_create_manager' (77989426-caff-4516-8561-1d5d45f1b06f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:42:33 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-6305e3c5-1f02-44fc-97bd-4711f01c9c46 tempest-VolumeImageDependencyTests-1641410403 None] Lock "cinder-quobyte-de6963f1-5faa-4d92-a06c-6919a00bfe5d" released by "delete_volume" :: held 0.857s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:42:33 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-24f60619-0892-4e4f-89f8-d54f8428d548 tempest-CinderUnicodeTest-714633432 None] Created volume successfully. Aug 26 14:42:33 devstack cinder-volume[94394]: DEBUG oslo_service.periodic_task [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94394) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 14:42:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:42:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:42:33 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:42:33 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:42:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:42:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:33 devstack sudo[114290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:42:33 devstack sudo[114290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:33 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-6305e3c5-1f02-44fc-97bd-4711f01c9c46 tempest-VolumeImageDependencyTests-1641410403 None] Created reservations ['cc267fff-7711-4ac1-8be1-944950fe55b3', '1ff22b97-ba25-485c-88ea-3b369eabbf57', '8ea4c840-89a4-4209-91fe-2ece8049aab9', '2200b04e-4521-4c7c-ae96-03aff3c997bb'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:42:33 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-4b63c5d7-4ab6-4841-91ae-044f511fb543 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Acquiring lock "cinder-839c1e2a-1e7a-4ad6-a829-7624ecbe0348-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:42:33 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-4b63c5d7-4ab6-4841-91ae-044f511fb543 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Lock "cinder-839c1e2a-1e7a-4ad6-a829-7624ecbe0348-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:42:33 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-4b63c5d7-4ab6-4841-91ae-044f511fb543 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Acquiring lock "cinder-quobyte-839c1e2a-1e7a-4ad6-a829-7624ecbe0348" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:42:33 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-4b63c5d7-4ab6-4841-91ae-044f511fb543 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Lock "cinder-quobyte-839c1e2a-1e7a-4ad6-a829-7624ecbe0348" acquired by "delete_volume" :: waited 0.024s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:42:33 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[13bcd1c6-612a-47a4-b795-9476f13f9663]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:42:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4b63c5d7-4ab6-4841-91ae-044f511fb543 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-839c1e2a-1e7a-4ad6-a829-7624ecbe0348 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-6305e3c5-1f02-44fc-97bd-4711f01c9c46 tempest-VolumeImageDependencyTests-1641410403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:42:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-6305e3c5-1f02-44fc-97bd-4711f01c9c46 tempest-VolumeImageDependencyTests-1641410403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:42:33 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-6305e3c5-1f02-44fc-97bd-4711f01c9c46 tempest-VolumeImageDependencyTests-1641410403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:42:33 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-6305e3c5-1f02-44fc-97bd-4711f01c9c46 tempest-VolumeImageDependencyTests-1641410403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:42:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-6305e3c5-1f02-44fc-97bd-4711f01c9c46 tempest-VolumeImageDependencyTests-1641410403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:42:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-6305e3c5-1f02-44fc-97bd-4711f01c9c46 tempest-VolumeImageDependencyTests-1641410403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:33 devstack sudo[114293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:42:33 devstack sudo[114293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:33 devstack sudo[114290]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.402s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:33 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:42:34 devstack cinder-volume[94394]: DEBUG oslo_service.periodic_task [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Running periodic task VolumeManager._thread_info {{(pid=94394) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 14:42:34 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] thread count: 28 {{(pid=94394) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 14:42:34 devstack sudo[114292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-839c1e2a-1e7a-4ad6-a829-7624ecbe0348 Aug 26 14:42:34 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] thread info: [<_MainThread(MainThread, started 126600738033792)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94394) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 14:42:34 devstack sudo[114292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:34 devstack sudo[114293]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:34 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-6305e3c5-1f02-44fc-97bd-4711f01c9c46 tempest-VolumeImageDependencyTests-1641410403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.363s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:34 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-6305e3c5-1f02-44fc-97bd-4711f01c9c46 tempest-VolumeImageDependencyTests-1641410403 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:42:34 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-6305e3c5-1f02-44fc-97bd-4711f01c9c46 tempest-VolumeImageDependencyTests-1641410403 None] Deleted volume successfully. Aug 26 14:42:34 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-6305e3c5-1f02-44fc-97bd-4711f01c9c46 tempest-VolumeImageDependencyTests-1641410403 None] Lock "cinder-de6963f1-5faa-4d92-a06c-6919a00bfe5d-delete_volume" released by "delete_volume" :: held 1.677s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:42:34 devstack sudo[114292]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:34 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4b63c5d7-4ab6-4841-91ae-044f511fb543 tempest-CreateVolumesFromSnapshotTest-1806966364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-839c1e2a-1e7a-4ad6-a829-7624ecbe0348" returned: 0 in 0.465s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:34 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4b63c5d7-4ab6-4841-91ae-044f511fb543 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-839c1e2a-1e7a-4ad6-a829-7624ecbe0348 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:34 devstack sudo[114335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-839c1e2a-1e7a-4ad6-a829-7624ecbe0348 Aug 26 14:42:34 devstack sudo[114335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:34 devstack sudo[114335]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:34 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4b63c5d7-4ab6-4841-91ae-044f511fb543 tempest-CreateVolumesFromSnapshotTest-1806966364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-839c1e2a-1e7a-4ad6-a829-7624ecbe0348" returned: 0 in 0.283s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:34 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-4b63c5d7-4ab6-4841-91ae-044f511fb543 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Lock "cinder-quobyte-839c1e2a-1e7a-4ad6-a829-7624ecbe0348" released by "delete_volume" :: held 0.835s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:42:34 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-4b63c5d7-4ab6-4841-91ae-044f511fb543 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Created reservations ['658a495c-71a2-4a23-8b64-5f70fd08bff5', '0efd9d4a-349e-4748-9b52-e043a610204c', 'b564089a-8646-4dca-90f6-ff7adf922279', '6d05c3ac-8a1e-4e5b-a77b-15bfb2f970ff'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:42:34 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-4b63c5d7-4ab6-4841-91ae-044f511fb543 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:42:34 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-4b63c5d7-4ab6-4841-91ae-044f511fb543 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:42:34 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-4b63c5d7-4ab6-4841-91ae-044f511fb543 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:42:34 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-4b63c5d7-4ab6-4841-91ae-044f511fb543 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:42:34 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-4b63c5d7-4ab6-4841-91ae-044f511fb543 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:42:34 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4b63c5d7-4ab6-4841-91ae-044f511fb543 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:34 devstack sudo[114340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:42:34 devstack sudo[114340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:34 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-98a55a67-4712-4c28-8265-a7230a0e5400 tempest-CinderUnicodeTest-714633432 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:42:34 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-98a55a67-4712-4c28-8265-a7230a0e5400 tempest-CinderUnicodeTest-714633432 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:42:34 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-98a55a67-4712-4c28-8265-a7230a0e5400 tempest-CinderUnicodeTest-714633432 None] Creating offline snapshot 50dd878b-8517-4318-b757-f26225f8c5e7 of volume 2c0813ae-05ee-4905-b58d-99fdf524aaeb {{(pid=94394) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 14:42:34 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[f734a8e2-a466-4326-82b2-995181d504fd]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:42:34 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-98a55a67-4712-4c28-8265-a7230a0e5400 tempest-CinderUnicodeTest-714633432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2c0813ae-05ee-4905-b58d-99fdf524aaeb {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:35 devstack sudo[114342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2c0813ae-05ee-4905-b58d-99fdf524aaeb Aug 26 14:42:35 devstack sudo[114342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:35 devstack sudo[114340]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:35 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4b63c5d7-4ab6-4841-91ae-044f511fb543 tempest-CreateVolumesFromSnapshotTest-1806966364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.401s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:35 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-4b63c5d7-4ab6-4841-91ae-044f511fb543 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:42:35 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-4b63c5d7-4ab6-4841-91ae-044f511fb543 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Deleted volume successfully. Aug 26 14:42:35 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-4b63c5d7-4ab6-4841-91ae-044f511fb543 tempest-CreateVolumesFromSnapshotTest-1806966364 None] Lock "cinder-839c1e2a-1e7a-4ad6-a829-7624ecbe0348-delete_volume" released by "delete_volume" :: held 1.561s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:42:35 devstack sudo[114342]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:35 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-98a55a67-4712-4c28-8265-a7230a0e5400 tempest-CinderUnicodeTest-714633432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2c0813ae-05ee-4905-b58d-99fdf524aaeb" returned: 0 in 0.396s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:35 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-98a55a67-4712-4c28-8265-a7230a0e5400 tempest-CinderUnicodeTest-714633432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2c0813ae-05ee-4905-b58d-99fdf524aaeb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2c0813ae-05ee-4905-b58d-99fdf524aaeb.50dd878b-8517-4318-b757-f26225f8c5e7 1G {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:35 devstack sudo[114349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2c0813ae-05ee-4905-b58d-99fdf524aaeb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2c0813ae-05ee-4905-b58d-99fdf524aaeb.50dd878b-8517-4318-b757-f26225f8c5e7 1G Aug 26 14:42:35 devstack sudo[114349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:35 devstack sudo[114349]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:35 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-98a55a67-4712-4c28-8265-a7230a0e5400 tempest-CinderUnicodeTest-714633432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2c0813ae-05ee-4905-b58d-99fdf524aaeb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2c0813ae-05ee-4905-b58d-99fdf524aaeb.50dd878b-8517-4318-b757-f26225f8c5e7 1G" returned: 0 in 0.466s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:35 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-98a55a67-4712-4c28-8265-a7230a0e5400 tempest-CinderUnicodeTest-714633432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c0813ae-05ee-4905-b58d-99fdf524aaeb -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2c0813ae-05ee-4905-b58d-99fdf524aaeb.50dd878b-8517-4318-b757-f26225f8c5e7 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:35 devstack sudo[114355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c0813ae-05ee-4905-b58d-99fdf524aaeb -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2c0813ae-05ee-4905-b58d-99fdf524aaeb.50dd878b-8517-4318-b757-f26225f8c5e7 Aug 26 14:42:35 devstack sudo[114355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:36 devstack sudo[114355]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:36 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-98a55a67-4712-4c28-8265-a7230a0e5400 tempest-CinderUnicodeTest-714633432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c0813ae-05ee-4905-b58d-99fdf524aaeb -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2c0813ae-05ee-4905-b58d-99fdf524aaeb.50dd878b-8517-4318-b757-f26225f8c5e7" returned: 0 in 0.477s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:36 devstack cinder-volume[94394]: WARNING cinder.volume.drivers.remotefs [None req-98a55a67-4712-4c28-8265-a7230a0e5400 tempest-CinderUnicodeTest-714633432 None] /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2c0813ae-05ee-4905-b58d-99fdf524aaeb.50dd878b-8517-4318-b757-f26225f8c5e7 is being set with open permissions: ugo+rw Aug 26 14:42:36 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-98a55a67-4712-4c28-8265-a7230a0e5400 tempest-CinderUnicodeTest-714633432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2c0813ae-05ee-4905-b58d-99fdf524aaeb.50dd878b-8517-4318-b757-f26225f8c5e7 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:36 devstack sudo[114360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2c0813ae-05ee-4905-b58d-99fdf524aaeb.50dd878b-8517-4318-b757-f26225f8c5e7 Aug 26 14:42:36 devstack sudo[114360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:36 devstack sudo[114360]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:36 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-98a55a67-4712-4c28-8265-a7230a0e5400 tempest-CinderUnicodeTest-714633432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2c0813ae-05ee-4905-b58d-99fdf524aaeb.50dd878b-8517-4318-b757-f26225f8c5e7" returned: 0 in 0.284s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:36 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-98a55a67-4712-4c28-8265-a7230a0e5400 tempest-CinderUnicodeTest-714633432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2c0813ae-05ee-4905-b58d-99fdf524aaeb.info {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:36 devstack sudo[114363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2c0813ae-05ee-4905-b58d-99fdf524aaeb.info Aug 26 14:42:36 devstack sudo[114363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:37 devstack sudo[114363]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:37 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-98a55a67-4712-4c28-8265-a7230a0e5400 tempest-CinderUnicodeTest-714633432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2c0813ae-05ee-4905-b58d-99fdf524aaeb.info" returned: 0 in 0.336s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:37 devstack cinder-volume[94394]: WARNING cinder.volume.drivers.remotefs [None req-98a55a67-4712-4c28-8265-a7230a0e5400 tempest-CinderUnicodeTest-714633432 None] /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2c0813ae-05ee-4905-b58d-99fdf524aaeb.info is being set with open permissions: ugo+rw Aug 26 14:42:37 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-98a55a67-4712-4c28-8265-a7230a0e5400 tempest-CinderUnicodeTest-714633432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2c0813ae-05ee-4905-b58d-99fdf524aaeb.info {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:37 devstack sudo[114366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2c0813ae-05ee-4905-b58d-99fdf524aaeb.info Aug 26 14:42:37 devstack sudo[114366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:37 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-069e967f-fb79-4ab7-8f1b-3e96f0ecae32 tempest-ProjectMemberTests-1774785373 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:42:37 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-069e967f-fb79-4ab7-8f1b-3e96f0ecae32 tempest-ProjectMemberTests-1774785373 None] Flow 'volume_create_manager' (f7e4ff55-52a2-4d67-ad7b-90b11a22e660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:42:37 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-069e967f-fb79-4ab7-8f1b-3e96f0ecae32 tempest-ProjectMemberTests-1774785373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9149f359-b595-47d4-839d-dd608cd68548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:37 devstack sudo[114366]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:37 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-069e967f-fb79-4ab7-8f1b-3e96f0ecae32 tempest-ProjectMemberTests-1774785373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9149f359-b595-47d4-839d-dd608cd68548) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:42:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1728257304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da99c5a2-5172-445b-8bb1-5c0a0f280347,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8dd248190cb40cebc9daf2b89f48fd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:42:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:42:37Z,use_quota=True,user_id='ad0617c386b6460d8f790d85646880e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:37 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-069e967f-fb79-4ab7-8f1b-3e96f0ecae32 tempest-ProjectMemberTests-1774785373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08fa2786-c45f-46dd-aad6-97400236d0b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:37 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-069e967f-fb79-4ab7-8f1b-3e96f0ecae32 tempest-ProjectMemberTests-1774785373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08fa2786-c45f-46dd-aad6-97400236d0b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:37 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-069e967f-fb79-4ab7-8f1b-3e96f0ecae32 tempest-ProjectMemberTests-1774785373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a41b73db-7b3b-47f6-bf53-5960b986bf4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:37 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-069e967f-fb79-4ab7-8f1b-3e96f0ecae32 tempest-ProjectMemberTests-1774785373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a41b73db-7b3b-47f6-bf53-5960b986bf4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da99c5a2-5172-445b-8bb1-5c0a0f280347', 'volume_name': 'volume-da99c5a2-5172-445b-8bb1-5c0a0f280347', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:37 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-069e967f-fb79-4ab7-8f1b-3e96f0ecae32 tempest-ProjectMemberTests-1774785373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (205fdfb2-5611-4b52-b3e8-cc9abb1e5a27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:37 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-069e967f-fb79-4ab7-8f1b-3e96f0ecae32 tempest-ProjectMemberTests-1774785373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (205fdfb2-5611-4b52-b3e8-cc9abb1e5a27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:37 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-069e967f-fb79-4ab7-8f1b-3e96f0ecae32 tempest-ProjectMemberTests-1774785373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9f6a307-3c43-4355-a0d4-36580c9b75e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:37 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-069e967f-fb79-4ab7-8f1b-3e96f0ecae32 tempest-ProjectMemberTests-1774785373 None] Volume da99c5a2-5172-445b-8bb1-5c0a0f280347: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da99c5a2-5172-445b-8bb1-5c0a0f280347', 'volume_size': 1} Aug 26 14:42:37 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-069e967f-fb79-4ab7-8f1b-3e96f0ecae32 tempest-ProjectMemberTests-1774785373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:42:37 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-98a55a67-4712-4c28-8265-a7230a0e5400 tempest-CinderUnicodeTest-714633432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2c0813ae-05ee-4905-b58d-99fdf524aaeb.info" returned: 0 in 0.371s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:37 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-98a55a67-4712-4c28-8265-a7230a0e5400 tempest-CinderUnicodeTest-714633432 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.460s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:42:37 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-069e967f-fb79-4ab7-8f1b-3e96f0ecae32 tempest-ProjectMemberTests-1774785373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.020s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:42:37 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-069e967f-fb79-4ab7-8f1b-3e96f0ecae32 tempest-ProjectMemberTests-1774785373 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:42:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1728257304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da99c5a2-5172-445b-8bb1-5c0a0f280347,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8dd248190cb40cebc9daf2b89f48fd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:42:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:42:37Z,use_quota=True,user_id='ad0617c386b6460d8f790d85646880e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:42:37 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-069e967f-fb79-4ab7-8f1b-3e96f0ecae32 tempest-ProjectMemberTests-1774785373 None] Creating volume da99c5a2-5172-445b-8bb1-5c0a0f280347 {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:42:37 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-069e967f-fb79-4ab7-8f1b-3e96f0ecae32 tempest-ProjectMemberTests-1774785373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:42:37 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-069e967f-fb79-4ab7-8f1b-3e96f0ecae32 tempest-ProjectMemberTests-1774785373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:42:37 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-069e967f-fb79-4ab7-8f1b-3e96f0ecae32 tempest-ProjectMemberTests-1774785373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:42:37 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-069e967f-fb79-4ab7-8f1b-3e96f0ecae32 tempest-ProjectMemberTests-1774785373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:42:37 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-069e967f-fb79-4ab7-8f1b-3e96f0ecae32 tempest-ProjectMemberTests-1774785373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:42:37 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-069e967f-fb79-4ab7-8f1b-3e96f0ecae32 tempest-ProjectMemberTests-1774785373 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:42:37 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-069e967f-fb79-4ab7-8f1b-3e96f0ecae32 tempest-ProjectMemberTests-1774785373 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:42:37 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-069e967f-fb79-4ab7-8f1b-3e96f0ecae32 tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-da99c5a2-5172-445b-8bb1-5c0a0f280347 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:37 devstack sudo[114369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-da99c5a2-5172-445b-8bb1-5c0a0f280347 1073741824 Aug 26 14:42:37 devstack sudo[114369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:37 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-98a55a67-4712-4c28-8265-a7230a0e5400 tempest-CinderUnicodeTest-714633432 None] Create snapshot completed successfully Aug 26 14:42:37 devstack sudo[114369]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:37 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-069e967f-fb79-4ab7-8f1b-3e96f0ecae32 tempest-ProjectMemberTests-1774785373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-da99c5a2-5172-445b-8bb1-5c0a0f280347 1073741824" returned: 0 in 0.550s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:38 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-069e967f-fb79-4ab7-8f1b-3e96f0ecae32 tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-da99c5a2-5172-445b-8bb1-5c0a0f280347 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:38 devstack sudo[114375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-da99c5a2-5172-445b-8bb1-5c0a0f280347 Aug 26 14:42:38 devstack sudo[114375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:38 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-4b828f8d-5886-4ed1-9089-f6f357af0f22 tempest-CinderUnicodeTest-714633432 None] Acquiring lock "cinder-50dd878b-8517-4318-b757-f26225f8c5e7-delete_snapshot" by "delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:42:38 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-4b828f8d-5886-4ed1-9089-f6f357af0f22 tempest-CinderUnicodeTest-714633432 None] Lock "cinder-50dd878b-8517-4318-b757-f26225f8c5e7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:42:38 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-4b828f8d-5886-4ed1-9089-f6f357af0f22 tempest-CinderUnicodeTest-714633432 None] Acquiring lock "cinder-quobyte-2c0813ae-05ee-4905-b58d-99fdf524aaeb" by "delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:42:38 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-4b828f8d-5886-4ed1-9089-f6f357af0f22 tempest-CinderUnicodeTest-714633432 None] Lock "cinder-quobyte-2c0813ae-05ee-4905-b58d-99fdf524aaeb" acquired by "delete_snapshot" :: waited 0.022s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:42:38 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-4b828f8d-5886-4ed1-9089-f6f357af0f22 tempest-CinderUnicodeTest-714633432 None] Acquiring lock "cinder-quobyte-50dd878b-8517-4318-b757-f26225f8c5e7" by "_delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:42:38 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-4b828f8d-5886-4ed1-9089-f6f357af0f22 tempest-CinderUnicodeTest-714633432 None] Lock "cinder-quobyte-50dd878b-8517-4318-b757-f26225f8c5e7" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:42:38 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-4b828f8d-5886-4ed1-9089-f6f357af0f22 tempest-CinderUnicodeTest-714633432 None] Deleting offline snapshot 50dd878b-8517-4318-b757-f26225f8c5e7 of volume 2c0813ae-05ee-4905-b58d-99fdf524aaeb {{(pid=94394) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 14:42:38 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-4b828f8d-5886-4ed1-9089-f6f357af0f22 tempest-CinderUnicodeTest-714633432 None] snapshot_file for this snap is: volume-2c0813ae-05ee-4905-b58d-99fdf524aaeb.50dd878b-8517-4318-b757-f26225f8c5e7 {{(pid=94394) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 14:42:38 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b5fffd2-3345-49e7-8e65-85162e5bb75e]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:42:38 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4b828f8d-5886-4ed1-9089-f6f357af0f22 tempest-CinderUnicodeTest-714633432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2c0813ae-05ee-4905-b58d-99fdf524aaeb.50dd878b-8517-4318-b757-f26225f8c5e7 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:38 devstack sudo[114377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2c0813ae-05ee-4905-b58d-99fdf524aaeb.50dd878b-8517-4318-b757-f26225f8c5e7 Aug 26 14:42:38 devstack sudo[114377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:38 devstack sudo[114375]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:38 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-069e967f-fb79-4ab7-8f1b-3e96f0ecae32 tempest-ProjectMemberTests-1774785373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-da99c5a2-5172-445b-8bb1-5c0a0f280347" returned: 0 in 0.365s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:38 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-069e967f-fb79-4ab7-8f1b-3e96f0ecae32 tempest-ProjectMemberTests-1774785373 None] <== create_volume: return (969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:42:38 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-069e967f-fb79-4ab7-8f1b-3e96f0ecae32 tempest-ProjectMemberTests-1774785373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.973s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:42:38 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-069e967f-fb79-4ab7-8f1b-3e96f0ecae32 tempest-ProjectMemberTests-1774785373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9f6a307-3c43-4355-a0d4-36580c9b75e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da99c5a2-5172-445b-8bb1-5c0a0f280347', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:38 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-069e967f-fb79-4ab7-8f1b-3e96f0ecae32 tempest-ProjectMemberTests-1774785373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de444b37-490b-4e8c-a191-78105419494c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:38 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-069e967f-fb79-4ab7-8f1b-3e96f0ecae32 tempest-ProjectMemberTests-1774785373 None] Volume volume-da99c5a2-5172-445b-8bb1-5c0a0f280347 (da99c5a2-5172-445b-8bb1-5c0a0f280347): created successfully Aug 26 14:42:38 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-069e967f-fb79-4ab7-8f1b-3e96f0ecae32 tempest-ProjectMemberTests-1774785373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de444b37-490b-4e8c-a191-78105419494c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:38 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-069e967f-fb79-4ab7-8f1b-3e96f0ecae32 tempest-ProjectMemberTests-1774785373 None] Flow 'volume_create_manager' (f7e4ff55-52a2-4d67-ad7b-90b11a22e660) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:42:38 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-069e967f-fb79-4ab7-8f1b-3e96f0ecae32 tempest-ProjectMemberTests-1774785373 None] Created volume successfully. Aug 26 14:42:38 devstack sudo[114377]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:38 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4b828f8d-5886-4ed1-9089-f6f357af0f22 tempest-CinderUnicodeTest-714633432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2c0813ae-05ee-4905-b58d-99fdf524aaeb.50dd878b-8517-4318-b757-f26225f8c5e7" returned: 0 in 0.486s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:38 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-4b828f8d-5886-4ed1-9089-f6f357af0f22 tempest-CinderUnicodeTest-714633432 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2c0813ae-05ee-4905-b58d-99fdf524aaeb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94394) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 14:42:38 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[5963d38e-d725-4f64-a358-3b1f4b808c7b]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:42:38 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4b828f8d-5886-4ed1-9089-f6f357af0f22 tempest-CinderUnicodeTest-714633432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2c0813ae-05ee-4905-b58d-99fdf524aaeb {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:38 devstack sudo[114383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2c0813ae-05ee-4905-b58d-99fdf524aaeb Aug 26 14:42:38 devstack sudo[114383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:38 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-646e5f62-cb7b-41b3-be86-6eb0931ab5ea tempest-VolumeDependencyTests-1292197561 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:42:38 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-646e5f62-cb7b-41b3-be86-6eb0931ab5ea tempest-VolumeDependencyTests-1292197561 None] Flow 'volume_create_manager' (2224b758-4c1e-444f-b5b4-12c0ad4232fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:42:39 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-646e5f62-cb7b-41b3-be86-6eb0931ab5ea tempest-VolumeDependencyTests-1292197561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fd927ec-a5c1-4ddc-be61-099486a6f61b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:39 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-646e5f62-cb7b-41b3-be86-6eb0931ab5ea tempest-VolumeDependencyTests-1292197561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fd927ec-a5c1-4ddc-be61-099486a6f61b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:42:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1542938910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d96a19c1-6fb6-4808-9b45-6a69e8cd195d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8da608abaf6d467091ab3d110b9c4e0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:42:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:42:39Z,use_quota=True,user_id='01eda08a1e40480db0f45b709f454dd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:39 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-646e5f62-cb7b-41b3-be86-6eb0931ab5ea tempest-VolumeDependencyTests-1292197561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bad04bb9-298a-4195-b0ea-c365374fd955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:39 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-646e5f62-cb7b-41b3-be86-6eb0931ab5ea tempest-VolumeDependencyTests-1292197561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bad04bb9-298a-4195-b0ea-c365374fd955) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:39 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-646e5f62-cb7b-41b3-be86-6eb0931ab5ea tempest-VolumeDependencyTests-1292197561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa11cd2e-513e-4c05-9ab3-73c3bbb0a059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:39 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-646e5f62-cb7b-41b3-be86-6eb0931ab5ea tempest-VolumeDependencyTests-1292197561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa11cd2e-513e-4c05-9ab3-73c3bbb0a059) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd96a19c1-6fb6-4808-9b45-6a69e8cd195d', 'volume_name': 'volume-d96a19c1-6fb6-4808-9b45-6a69e8cd195d', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:39 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-646e5f62-cb7b-41b3-be86-6eb0931ab5ea tempest-VolumeDependencyTests-1292197561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f361429-830b-4833-8cd5-1ffe0ab0e573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:39 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-646e5f62-cb7b-41b3-be86-6eb0931ab5ea tempest-VolumeDependencyTests-1292197561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f361429-830b-4833-8cd5-1ffe0ab0e573) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:39 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-646e5f62-cb7b-41b3-be86-6eb0931ab5ea tempest-VolumeDependencyTests-1292197561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b23da555-1edb-4d3f-ad76-352ef83ed982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:39 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-646e5f62-cb7b-41b3-be86-6eb0931ab5ea tempest-VolumeDependencyTests-1292197561 None] Volume d96a19c1-6fb6-4808-9b45-6a69e8cd195d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d96a19c1-6fb6-4808-9b45-6a69e8cd195d', 'volume_size': 1} Aug 26 14:42:39 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-646e5f62-cb7b-41b3-be86-6eb0931ab5ea tempest-VolumeDependencyTests-1292197561 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:42:39 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-646e5f62-cb7b-41b3-be86-6eb0931ab5ea tempest-VolumeDependencyTests-1292197561 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:42:39 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-646e5f62-cb7b-41b3-be86-6eb0931ab5ea tempest-VolumeDependencyTests-1292197561 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:42:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1542938910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d96a19c1-6fb6-4808-9b45-6a69e8cd195d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8da608abaf6d467091ab3d110b9c4e0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:42:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:42:39Z,use_quota=True,user_id='01eda08a1e40480db0f45b709f454dd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:42:39 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-646e5f62-cb7b-41b3-be86-6eb0931ab5ea tempest-VolumeDependencyTests-1292197561 None] Creating volume d96a19c1-6fb6-4808-9b45-6a69e8cd195d {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:42:39 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-646e5f62-cb7b-41b3-be86-6eb0931ab5ea tempest-VolumeDependencyTests-1292197561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:42:39 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-646e5f62-cb7b-41b3-be86-6eb0931ab5ea tempest-VolumeDependencyTests-1292197561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:42:39 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-646e5f62-cb7b-41b3-be86-6eb0931ab5ea tempest-VolumeDependencyTests-1292197561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:42:39 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-646e5f62-cb7b-41b3-be86-6eb0931ab5ea tempest-VolumeDependencyTests-1292197561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:42:39 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-646e5f62-cb7b-41b3-be86-6eb0931ab5ea tempest-VolumeDependencyTests-1292197561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:42:39 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-646e5f62-cb7b-41b3-be86-6eb0931ab5ea tempest-VolumeDependencyTests-1292197561 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:42:39 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-646e5f62-cb7b-41b3-be86-6eb0931ab5ea tempest-VolumeDependencyTests-1292197561 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:42:39 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-646e5f62-cb7b-41b3-be86-6eb0931ab5ea tempest-VolumeDependencyTests-1292197561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d96a19c1-6fb6-4808-9b45-6a69e8cd195d 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:39 devstack sudo[114387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d96a19c1-6fb6-4808-9b45-6a69e8cd195d 1073741824 Aug 26 14:42:39 devstack sudo[114387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:39 devstack sudo[114383]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:39 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4b828f8d-5886-4ed1-9089-f6f357af0f22 tempest-CinderUnicodeTest-714633432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2c0813ae-05ee-4905-b58d-99fdf524aaeb" returned: 0 in 0.445s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:39 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4b828f8d-5886-4ed1-9089-f6f357af0f22 tempest-CinderUnicodeTest-714633432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2c0813ae-05ee-4905-b58d-99fdf524aaeb.50dd878b-8517-4318-b757-f26225f8c5e7 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:39 devstack sudo[114390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2c0813ae-05ee-4905-b58d-99fdf524aaeb.50dd878b-8517-4318-b757-f26225f8c5e7 Aug 26 14:42:39 devstack sudo[114390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:39 devstack sudo[114390]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:39 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4b828f8d-5886-4ed1-9089-f6f357af0f22 tempest-CinderUnicodeTest-714633432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2c0813ae-05ee-4905-b58d-99fdf524aaeb.50dd878b-8517-4318-b757-f26225f8c5e7" returned: 0 in 0.385s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:39 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4b828f8d-5886-4ed1-9089-f6f357af0f22 tempest-CinderUnicodeTest-714633432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2c0813ae-05ee-4905-b58d-99fdf524aaeb.50dd878b-8517-4318-b757-f26225f8c5e7 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:39 devstack sudo[114400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2c0813ae-05ee-4905-b58d-99fdf524aaeb.50dd878b-8517-4318-b757-f26225f8c5e7 Aug 26 14:42:39 devstack sudo[114400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:39 devstack sudo[114387]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:39 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-646e5f62-cb7b-41b3-be86-6eb0931ab5ea tempest-VolumeDependencyTests-1292197561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d96a19c1-6fb6-4808-9b45-6a69e8cd195d 1073741824" returned: 0 in 0.561s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:39 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-646e5f62-cb7b-41b3-be86-6eb0931ab5ea tempest-VolumeDependencyTests-1292197561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d96a19c1-6fb6-4808-9b45-6a69e8cd195d {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:39 devstack sudo[114402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d96a19c1-6fb6-4808-9b45-6a69e8cd195d Aug 26 14:42:39 devstack sudo[114402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:39 devstack sudo[114400]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:39 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4b828f8d-5886-4ed1-9089-f6f357af0f22 tempest-CinderUnicodeTest-714633432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2c0813ae-05ee-4905-b58d-99fdf524aaeb.50dd878b-8517-4318-b757-f26225f8c5e7" returned: 0 in 0.325s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:39 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-4b828f8d-5886-4ed1-9089-f6f357af0f22 tempest-CinderUnicodeTest-714633432 None] Lock "cinder-quobyte-50dd878b-8517-4318-b757-f26225f8c5e7" released by "_delete_snapshot" :: held 1.807s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:42:39 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-4b828f8d-5886-4ed1-9089-f6f357af0f22 tempest-CinderUnicodeTest-714633432 None] Lock "cinder-quobyte-2c0813ae-05ee-4905-b58d-99fdf524aaeb" released by "delete_snapshot" :: held 1.840s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:42:39 devstack sudo[114402]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:39 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-646e5f62-cb7b-41b3-be86-6eb0931ab5ea tempest-VolumeDependencyTests-1292197561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d96a19c1-6fb6-4808-9b45-6a69e8cd195d" returned: 0 in 0.325s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:39 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-646e5f62-cb7b-41b3-be86-6eb0931ab5ea tempest-VolumeDependencyTests-1292197561 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:42:39 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-646e5f62-cb7b-41b3-be86-6eb0931ab5ea tempest-VolumeDependencyTests-1292197561 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.938s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:42:40 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-646e5f62-cb7b-41b3-be86-6eb0931ab5ea tempest-VolumeDependencyTests-1292197561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b23da555-1edb-4d3f-ad76-352ef83ed982) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d96a19c1-6fb6-4808-9b45-6a69e8cd195d', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:40 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-646e5f62-cb7b-41b3-be86-6eb0931ab5ea tempest-VolumeDependencyTests-1292197561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b1e6a3d-e45f-48d7-8d32-36b7f4b956a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:40 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-793bc731-5080-4df1-bd17-f7ca09030596 tempest-ProjectMemberTests-1774785373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:42:40 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-793bc731-5080-4df1-bd17-f7ca09030596 tempest-ProjectMemberTests-1774785373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:42:40 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-646e5f62-cb7b-41b3-be86-6eb0931ab5ea tempest-VolumeDependencyTests-1292197561 None] Volume volume-d96a19c1-6fb6-4808-9b45-6a69e8cd195d (d96a19c1-6fb6-4808-9b45-6a69e8cd195d): created successfully Aug 26 14:42:40 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-646e5f62-cb7b-41b3-be86-6eb0931ab5ea tempest-VolumeDependencyTests-1292197561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b1e6a3d-e45f-48d7-8d32-36b7f4b956a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:40 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-646e5f62-cb7b-41b3-be86-6eb0931ab5ea tempest-VolumeDependencyTests-1292197561 None] Flow 'volume_create_manager' (2224b758-4c1e-444f-b5b4-12c0ad4232fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:42:40 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-793bc731-5080-4df1-bd17-f7ca09030596 tempest-ProjectMemberTests-1774785373 None] Creating offline snapshot 6ec3af79-228a-4a59-a5d7-07d43597b93a of volume da99c5a2-5172-445b-8bb1-5c0a0f280347 {{(pid=94394) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 14:42:40 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-646e5f62-cb7b-41b3-be86-6eb0931ab5ea tempest-VolumeDependencyTests-1292197561 None] Created volume successfully. Aug 26 14:42:40 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[64617c9b-1a9a-4404-9539-9ca764e5e4b5]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:42:40 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-793bc731-5080-4df1-bd17-f7ca09030596 tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-da99c5a2-5172-445b-8bb1-5c0a0f280347 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:40 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-4b828f8d-5886-4ed1-9089-f6f357af0f22 tempest-CinderUnicodeTest-714633432 None] Created reservations ['19287e65-d612-4d6e-833e-c887bedb297d', 'e80557bd-fbfa-4f7d-aa99-b4bebe5341f4', 'a9ea6b82-fc29-4b04-acd2-66539c74fa1f', '4be47c85-36d6-4fa4-9c37-a212218156d0'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:42:40 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-4b828f8d-5886-4ed1-9089-f6f357af0f22 tempest-CinderUnicodeTest-714633432 None] Delete snapshot completed successfully. Aug 26 14:42:40 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-4b828f8d-5886-4ed1-9089-f6f357af0f22 tempest-CinderUnicodeTest-714633432 None] Lock "cinder-50dd878b-8517-4318-b757-f26225f8c5e7-delete_snapshot" released by "delete_snapshot" :: held 2.119s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:42:40 devstack sudo[114406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-da99c5a2-5172-445b-8bb1-5c0a0f280347 Aug 26 14:42:40 devstack sudo[114406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:40 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-f060eb93-4abb-47cb-8313-7da864ac3fc3 tempest-CinderUnicodeTest-714633432 None] Acquiring lock "cinder-2c0813ae-05ee-4905-b58d-99fdf524aaeb-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:42:40 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-f060eb93-4abb-47cb-8313-7da864ac3fc3 tempest-CinderUnicodeTest-714633432 None] Lock "cinder-2c0813ae-05ee-4905-b58d-99fdf524aaeb-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:42:40 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-f060eb93-4abb-47cb-8313-7da864ac3fc3 tempest-CinderUnicodeTest-714633432 None] Acquiring lock "cinder-quobyte-2c0813ae-05ee-4905-b58d-99fdf524aaeb" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:42:40 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-f060eb93-4abb-47cb-8313-7da864ac3fc3 tempest-CinderUnicodeTest-714633432 None] Lock "cinder-quobyte-2c0813ae-05ee-4905-b58d-99fdf524aaeb" acquired by "delete_volume" :: waited 0.019s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:42:40 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[b49a184e-a309-4d3b-a407-6086b5282c05]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:42:40 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-f060eb93-4abb-47cb-8313-7da864ac3fc3 tempest-CinderUnicodeTest-714633432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2c0813ae-05ee-4905-b58d-99fdf524aaeb {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:40 devstack sudo[114406]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:40 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-793bc731-5080-4df1-bd17-f7ca09030596 tempest-ProjectMemberTests-1774785373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-da99c5a2-5172-445b-8bb1-5c0a0f280347" returned: 0 in 0.409s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:40 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-793bc731-5080-4df1-bd17-f7ca09030596 tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-da99c5a2-5172-445b-8bb1-5c0a0f280347,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-da99c5a2-5172-445b-8bb1-5c0a0f280347.6ec3af79-228a-4a59-a5d7-07d43597b93a 1G {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:40 devstack sudo[114408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2c0813ae-05ee-4905-b58d-99fdf524aaeb Aug 26 14:42:40 devstack sudo[114408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:40 devstack sudo[114412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-da99c5a2-5172-445b-8bb1-5c0a0f280347,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-da99c5a2-5172-445b-8bb1-5c0a0f280347.6ec3af79-228a-4a59-a5d7-07d43597b93a 1G Aug 26 14:42:40 devstack sudo[114412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:40 devstack sudo[114408]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:40 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-f060eb93-4abb-47cb-8313-7da864ac3fc3 tempest-CinderUnicodeTest-714633432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2c0813ae-05ee-4905-b58d-99fdf524aaeb" returned: 0 in 0.424s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:40 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-f060eb93-4abb-47cb-8313-7da864ac3fc3 tempest-CinderUnicodeTest-714633432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2c0813ae-05ee-4905-b58d-99fdf524aaeb {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:40 devstack sudo[114422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2c0813ae-05ee-4905-b58d-99fdf524aaeb Aug 26 14:42:40 devstack sudo[114422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:40 devstack sudo[114412]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:40 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-793bc731-5080-4df1-bd17-f7ca09030596 tempest-ProjectMemberTests-1774785373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-da99c5a2-5172-445b-8bb1-5c0a0f280347,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-da99c5a2-5172-445b-8bb1-5c0a0f280347.6ec3af79-228a-4a59-a5d7-07d43597b93a 1G" returned: 0 in 0.418s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:40 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-793bc731-5080-4df1-bd17-f7ca09030596 tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da99c5a2-5172-445b-8bb1-5c0a0f280347 -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-da99c5a2-5172-445b-8bb1-5c0a0f280347.6ec3af79-228a-4a59-a5d7-07d43597b93a {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:40 devstack sudo[114425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da99c5a2-5172-445b-8bb1-5c0a0f280347 -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-da99c5a2-5172-445b-8bb1-5c0a0f280347.6ec3af79-228a-4a59-a5d7-07d43597b93a Aug 26 14:42:40 devstack sudo[114425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:41 devstack sudo[114422]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:41 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-f060eb93-4abb-47cb-8313-7da864ac3fc3 tempest-CinderUnicodeTest-714633432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-2c0813ae-05ee-4905-b58d-99fdf524aaeb" returned: 0 in 0.293s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:41 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-f060eb93-4abb-47cb-8313-7da864ac3fc3 tempest-CinderUnicodeTest-714633432 None] Lock "cinder-quobyte-2c0813ae-05ee-4905-b58d-99fdf524aaeb" released by "delete_volume" :: held 0.774s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:42:41 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-f060eb93-4abb-47cb-8313-7da864ac3fc3 tempest-CinderUnicodeTest-714633432 None] Created reservations ['0bed2e8f-16ac-444d-8978-f522c243577f', '8a490d70-068e-47f7-8531-435c2fa07d8f', '0c3b34da-f7a2-4e88-a66a-7f32f40b9cb6', '874211d7-854e-4925-be18-d5de38befc18'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:42:41 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-f060eb93-4abb-47cb-8313-7da864ac3fc3 tempest-CinderUnicodeTest-714633432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:42:41 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-f060eb93-4abb-47cb-8313-7da864ac3fc3 tempest-CinderUnicodeTest-714633432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:42:41 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-f060eb93-4abb-47cb-8313-7da864ac3fc3 tempest-CinderUnicodeTest-714633432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:42:41 devstack sudo[114425]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:41 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-f060eb93-4abb-47cb-8313-7da864ac3fc3 tempest-CinderUnicodeTest-714633432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:42:41 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-f060eb93-4abb-47cb-8313-7da864ac3fc3 tempest-CinderUnicodeTest-714633432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:42:41 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-f060eb93-4abb-47cb-8313-7da864ac3fc3 tempest-CinderUnicodeTest-714633432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:41 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-793bc731-5080-4df1-bd17-f7ca09030596 tempest-ProjectMemberTests-1774785373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da99c5a2-5172-445b-8bb1-5c0a0f280347 -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-da99c5a2-5172-445b-8bb1-5c0a0f280347.6ec3af79-228a-4a59-a5d7-07d43597b93a" returned: 0 in 0.430s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:41 devstack cinder-volume[94394]: WARNING cinder.volume.drivers.remotefs [None req-793bc731-5080-4df1-bd17-f7ca09030596 tempest-ProjectMemberTests-1774785373 None] /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-da99c5a2-5172-445b-8bb1-5c0a0f280347.6ec3af79-228a-4a59-a5d7-07d43597b93a is being set with open permissions: ugo+rw Aug 26 14:42:41 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-793bc731-5080-4df1-bd17-f7ca09030596 tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-da99c5a2-5172-445b-8bb1-5c0a0f280347.6ec3af79-228a-4a59-a5d7-07d43597b93a {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:41 devstack sudo[114432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-da99c5a2-5172-445b-8bb1-5c0a0f280347.6ec3af79-228a-4a59-a5d7-07d43597b93a Aug 26 14:42:41 devstack sudo[114432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:41 devstack sudo[114431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:42:41 devstack sudo[114431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:41 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-be6f03ab-2b95-4f3d-9305-1127bf5e1ac3 tempest-VolumeDependencyTests-1292197561 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:42:41 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-0019b2f0-37f1-4c63-9d3a-525721232bd8 tempest-CinderUnicodeTest-714633432 None] Acquiring lock "cinder-fef507c2-daea-4375-9184-69f6afc808ba-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:42:41 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-0019b2f0-37f1-4c63-9d3a-525721232bd8 tempest-CinderUnicodeTest-714633432 None] Lock "cinder-fef507c2-daea-4375-9184-69f6afc808ba-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:42:41 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-0019b2f0-37f1-4c63-9d3a-525721232bd8 tempest-CinderUnicodeTest-714633432 None] Acquiring lock "cinder-quobyte-fef507c2-daea-4375-9184-69f6afc808ba" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:42:41 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-0019b2f0-37f1-4c63-9d3a-525721232bd8 tempest-CinderUnicodeTest-714633432 None] Lock "cinder-quobyte-fef507c2-daea-4375-9184-69f6afc808ba" acquired by "delete_volume" :: waited 0.023s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:42:41 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[369a2b05-a95d-4fa3-be05-170f2e0bf03d]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:42:41 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-0019b2f0-37f1-4c63-9d3a-525721232bd8 tempest-CinderUnicodeTest-714633432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-fef507c2-daea-4375-9184-69f6afc808ba {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:41 devstack sudo[114431]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:41 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-f060eb93-4abb-47cb-8313-7da864ac3fc3 tempest-CinderUnicodeTest-714633432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.357s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:41 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-f060eb93-4abb-47cb-8313-7da864ac3fc3 tempest-CinderUnicodeTest-714633432 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:42:41 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-f060eb93-4abb-47cb-8313-7da864ac3fc3 tempest-CinderUnicodeTest-714633432 None] Deleted volume successfully. Aug 26 14:42:41 devstack sudo[114432]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:41 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-793bc731-5080-4df1-bd17-f7ca09030596 tempest-ProjectMemberTests-1774785373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-da99c5a2-5172-445b-8bb1-5c0a0f280347.6ec3af79-228a-4a59-a5d7-07d43597b93a" returned: 0 in 0.362s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:41 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-f060eb93-4abb-47cb-8313-7da864ac3fc3 tempest-CinderUnicodeTest-714633432 None] Lock "cinder-2c0813ae-05ee-4905-b58d-99fdf524aaeb-delete_volume" released by "delete_volume" :: held 1.444s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:42:41 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-793bc731-5080-4df1-bd17-f7ca09030596 tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-da99c5a2-5172-445b-8bb1-5c0a0f280347.info {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:41 devstack sudo[114438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-da99c5a2-5172-445b-8bb1-5c0a0f280347.info Aug 26 14:42:41 devstack sudo[114438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:41 devstack sudo[114437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-fef507c2-daea-4375-9184-69f6afc808ba Aug 26 14:42:41 devstack sudo[114437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:42 devstack sudo[114438]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:42 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-793bc731-5080-4df1-bd17-f7ca09030596 tempest-ProjectMemberTests-1774785373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-da99c5a2-5172-445b-8bb1-5c0a0f280347.info" returned: 0 in 0.281s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:42 devstack cinder-volume[94394]: WARNING cinder.volume.drivers.remotefs [None req-793bc731-5080-4df1-bd17-f7ca09030596 tempest-ProjectMemberTests-1774785373 None] /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-da99c5a2-5172-445b-8bb1-5c0a0f280347.info is being set with open permissions: ugo+rw Aug 26 14:42:42 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-793bc731-5080-4df1-bd17-f7ca09030596 tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-da99c5a2-5172-445b-8bb1-5c0a0f280347.info {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:42 devstack sudo[114445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-da99c5a2-5172-445b-8bb1-5c0a0f280347.info Aug 26 14:42:42 devstack sudo[114445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:42 devstack sudo[114437]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:42 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-0019b2f0-37f1-4c63-9d3a-525721232bd8 tempest-CinderUnicodeTest-714633432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-fef507c2-daea-4375-9184-69f6afc808ba" returned: 0 in 0.428s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:42 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-0019b2f0-37f1-4c63-9d3a-525721232bd8 tempest-CinderUnicodeTest-714633432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-fef507c2-daea-4375-9184-69f6afc808ba {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:42 devstack sudo[114447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-fef507c2-daea-4375-9184-69f6afc808ba Aug 26 14:42:42 devstack sudo[114447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:42 devstack sudo[114445]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:42 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-793bc731-5080-4df1-bd17-f7ca09030596 tempest-ProjectMemberTests-1774785373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-da99c5a2-5172-445b-8bb1-5c0a0f280347.info" returned: 0 in 0.306s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:42 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-793bc731-5080-4df1-bd17-f7ca09030596 tempest-ProjectMemberTests-1774785373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.349s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:42:42 devstack sudo[114447]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:42 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-be6f03ab-2b95-4f3d-9305-1127bf5e1ac3 tempest-VolumeDependencyTests-1292197561 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.875s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:42:42 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-0019b2f0-37f1-4c63-9d3a-525721232bd8 tempest-CinderUnicodeTest-714633432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-fef507c2-daea-4375-9184-69f6afc808ba" returned: 0 in 0.289s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:42 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-be6f03ab-2b95-4f3d-9305-1127bf5e1ac3 tempest-VolumeDependencyTests-1292197561 None] Creating offline snapshot 4479e28b-1851-4783-8799-d92e98043a7c of volume d96a19c1-6fb6-4808-9b45-6a69e8cd195d {{(pid=94394) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 14:42:42 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-0019b2f0-37f1-4c63-9d3a-525721232bd8 tempest-CinderUnicodeTest-714633432 None] Lock "cinder-quobyte-fef507c2-daea-4375-9184-69f6afc808ba" released by "delete_volume" :: held 0.786s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:42:42 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-793bc731-5080-4df1-bd17-f7ca09030596 tempest-ProjectMemberTests-1774785373 None] Create snapshot completed successfully Aug 26 14:42:42 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1f47dc3-201b-4aa9-9909-8a568c23ffdb]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:42:42 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-be6f03ab-2b95-4f3d-9305-1127bf5e1ac3 tempest-VolumeDependencyTests-1292197561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d96a19c1-6fb6-4808-9b45-6a69e8cd195d {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:42 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-0019b2f0-37f1-4c63-9d3a-525721232bd8 tempest-CinderUnicodeTest-714633432 None] Created reservations ['36c0a593-2d8a-4b2e-b040-15e5c0719a91', '7db7e8ac-7925-4ab0-971e-44f5ab10059c', 'e033b0d5-9e67-4178-8bb8-0ebbd18a4de8', '1fdac769-b2a6-4c9b-8203-5c7b777a42c6'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:42:42 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-0019b2f0-37f1-4c63-9d3a-525721232bd8 tempest-CinderUnicodeTest-714633432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:42:42 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-0019b2f0-37f1-4c63-9d3a-525721232bd8 tempest-CinderUnicodeTest-714633432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:42:42 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-0019b2f0-37f1-4c63-9d3a-525721232bd8 tempest-CinderUnicodeTest-714633432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:42:42 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-0019b2f0-37f1-4c63-9d3a-525721232bd8 tempest-CinderUnicodeTest-714633432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:42:42 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-0019b2f0-37f1-4c63-9d3a-525721232bd8 tempest-CinderUnicodeTest-714633432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:42:42 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-0019b2f0-37f1-4c63-9d3a-525721232bd8 tempest-CinderUnicodeTest-714633432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:42 devstack sudo[114451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d96a19c1-6fb6-4808-9b45-6a69e8cd195d Aug 26 14:42:42 devstack sudo[114451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:42 devstack sudo[114456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:42:42 devstack sudo[114456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:42 devstack sudo[114456]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:42 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-0019b2f0-37f1-4c63-9d3a-525721232bd8 tempest-CinderUnicodeTest-714633432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.283s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:42 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-0019b2f0-37f1-4c63-9d3a-525721232bd8 tempest-CinderUnicodeTest-714633432 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:42:42 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-0019b2f0-37f1-4c63-9d3a-525721232bd8 tempest-CinderUnicodeTest-714633432 None] Deleted volume successfully. Aug 26 14:42:42 devstack sudo[114451]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:42 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-be6f03ab-2b95-4f3d-9305-1127bf5e1ac3 tempest-VolumeDependencyTests-1292197561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d96a19c1-6fb6-4808-9b45-6a69e8cd195d" returned: 0 in 0.425s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:42 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-be6f03ab-2b95-4f3d-9305-1127bf5e1ac3 tempest-VolumeDependencyTests-1292197561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d96a19c1-6fb6-4808-9b45-6a69e8cd195d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d96a19c1-6fb6-4808-9b45-6a69e8cd195d.4479e28b-1851-4783-8799-d92e98043a7c 1G {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:42 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-0019b2f0-37f1-4c63-9d3a-525721232bd8 tempest-CinderUnicodeTest-714633432 None] Lock "cinder-fef507c2-daea-4375-9184-69f6afc808ba-delete_volume" released by "delete_volume" :: held 1.351s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:42:42 devstack sudo[114465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d96a19c1-6fb6-4808-9b45-6a69e8cd195d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d96a19c1-6fb6-4808-9b45-6a69e8cd195d.4479e28b-1851-4783-8799-d92e98043a7c 1G Aug 26 14:42:42 devstack sudo[114465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:43 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-b439d8b1-8cc9-4fce-94f0-6354b60a038c tempest-ProjectMemberTests-1774785373 None] Acquiring lock "cinder-6ec3af79-228a-4a59-a5d7-07d43597b93a-delete_snapshot" by "delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:42:43 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-b439d8b1-8cc9-4fce-94f0-6354b60a038c tempest-ProjectMemberTests-1774785373 None] Lock "cinder-6ec3af79-228a-4a59-a5d7-07d43597b93a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:42:43 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-b439d8b1-8cc9-4fce-94f0-6354b60a038c tempest-ProjectMemberTests-1774785373 None] Acquiring lock "cinder-quobyte-da99c5a2-5172-445b-8bb1-5c0a0f280347" by "delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:42:43 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-b439d8b1-8cc9-4fce-94f0-6354b60a038c tempest-ProjectMemberTests-1774785373 None] Lock "cinder-quobyte-da99c5a2-5172-445b-8bb1-5c0a0f280347" acquired by "delete_snapshot" :: waited 0.024s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:42:43 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-b439d8b1-8cc9-4fce-94f0-6354b60a038c tempest-ProjectMemberTests-1774785373 None] Acquiring lock "cinder-quobyte-6ec3af79-228a-4a59-a5d7-07d43597b93a" by "_delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:42:43 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-b439d8b1-8cc9-4fce-94f0-6354b60a038c tempest-ProjectMemberTests-1774785373 None] Lock "cinder-quobyte-6ec3af79-228a-4a59-a5d7-07d43597b93a" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:42:43 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-b439d8b1-8cc9-4fce-94f0-6354b60a038c tempest-ProjectMemberTests-1774785373 None] Deleting offline snapshot 6ec3af79-228a-4a59-a5d7-07d43597b93a of volume da99c5a2-5172-445b-8bb1-5c0a0f280347 {{(pid=94394) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 14:42:43 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-b439d8b1-8cc9-4fce-94f0-6354b60a038c tempest-ProjectMemberTests-1774785373 None] snapshot_file for this snap is: volume-da99c5a2-5172-445b-8bb1-5c0a0f280347.6ec3af79-228a-4a59-a5d7-07d43597b93a {{(pid=94394) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 14:42:43 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c1b0f4f-23a8-4cd9-aab4-34cdfcffe6ca]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:42:43 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-b439d8b1-8cc9-4fce-94f0-6354b60a038c tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-da99c5a2-5172-445b-8bb1-5c0a0f280347.6ec3af79-228a-4a59-a5d7-07d43597b93a {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:43 devstack sudo[114465]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:43 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-be6f03ab-2b95-4f3d-9305-1127bf5e1ac3 tempest-VolumeDependencyTests-1292197561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d96a19c1-6fb6-4808-9b45-6a69e8cd195d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d96a19c1-6fb6-4808-9b45-6a69e8cd195d.4479e28b-1851-4783-8799-d92e98043a7c 1G" returned: 0 in 0.501s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:43 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-be6f03ab-2b95-4f3d-9305-1127bf5e1ac3 tempest-VolumeDependencyTests-1292197561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d96a19c1-6fb6-4808-9b45-6a69e8cd195d -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d96a19c1-6fb6-4808-9b45-6a69e8cd195d.4479e28b-1851-4783-8799-d92e98043a7c {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:43 devstack sudo[114472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d96a19c1-6fb6-4808-9b45-6a69e8cd195d -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d96a19c1-6fb6-4808-9b45-6a69e8cd195d.4479e28b-1851-4783-8799-d92e98043a7c Aug 26 14:42:43 devstack sudo[114472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:43 devstack sudo[114470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-da99c5a2-5172-445b-8bb1-5c0a0f280347.6ec3af79-228a-4a59-a5d7-07d43597b93a Aug 26 14:42:43 devstack sudo[114470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:43 devstack sudo[114470]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:43 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-b439d8b1-8cc9-4fce-94f0-6354b60a038c tempest-ProjectMemberTests-1774785373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-da99c5a2-5172-445b-8bb1-5c0a0f280347.6ec3af79-228a-4a59-a5d7-07d43597b93a" returned: 0 in 0.490s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:43 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-b439d8b1-8cc9-4fce-94f0-6354b60a038c tempest-ProjectMemberTests-1774785373 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-da99c5a2-5172-445b-8bb1-5c0a0f280347(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94394) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 14:42:43 devstack sudo[114472]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:43 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-be6f03ab-2b95-4f3d-9305-1127bf5e1ac3 tempest-VolumeDependencyTests-1292197561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d96a19c1-6fb6-4808-9b45-6a69e8cd195d -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d96a19c1-6fb6-4808-9b45-6a69e8cd195d.4479e28b-1851-4783-8799-d92e98043a7c" returned: 0 in 0.404s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:43 devstack cinder-volume[94394]: WARNING cinder.volume.drivers.remotefs [None req-be6f03ab-2b95-4f3d-9305-1127bf5e1ac3 tempest-VolumeDependencyTests-1292197561 None] /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d96a19c1-6fb6-4808-9b45-6a69e8cd195d.4479e28b-1851-4783-8799-d92e98043a7c is being set with open permissions: ugo+rw Aug 26 14:42:43 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-be6f03ab-2b95-4f3d-9305-1127bf5e1ac3 tempest-VolumeDependencyTests-1292197561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d96a19c1-6fb6-4808-9b45-6a69e8cd195d.4479e28b-1851-4783-8799-d92e98043a7c {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:43 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[d22d7190-364d-4526-bd7e-8a299f4cd05d]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:42:43 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-b439d8b1-8cc9-4fce-94f0-6354b60a038c tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-da99c5a2-5172-445b-8bb1-5c0a0f280347 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:43 devstack sudo[114482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d96a19c1-6fb6-4808-9b45-6a69e8cd195d.4479e28b-1851-4783-8799-d92e98043a7c Aug 26 14:42:43 devstack sudo[114482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:43 devstack sudo[114483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-da99c5a2-5172-445b-8bb1-5c0a0f280347 Aug 26 14:42:43 devstack sudo[114483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:44 devstack sudo[114482]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:44 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-be6f03ab-2b95-4f3d-9305-1127bf5e1ac3 tempest-VolumeDependencyTests-1292197561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d96a19c1-6fb6-4808-9b45-6a69e8cd195d.4479e28b-1851-4783-8799-d92e98043a7c" returned: 0 in 0.376s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:44 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-be6f03ab-2b95-4f3d-9305-1127bf5e1ac3 tempest-VolumeDependencyTests-1292197561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d96a19c1-6fb6-4808-9b45-6a69e8cd195d.info {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:44 devstack sudo[114489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d96a19c1-6fb6-4808-9b45-6a69e8cd195d.info Aug 26 14:42:44 devstack sudo[114489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:44 devstack sudo[114483]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:44 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-b439d8b1-8cc9-4fce-94f0-6354b60a038c tempest-ProjectMemberTests-1774785373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-da99c5a2-5172-445b-8bb1-5c0a0f280347" returned: 0 in 0.499s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:44 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-b439d8b1-8cc9-4fce-94f0-6354b60a038c tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-da99c5a2-5172-445b-8bb1-5c0a0f280347.6ec3af79-228a-4a59-a5d7-07d43597b93a {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:44 devstack sudo[114492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-da99c5a2-5172-445b-8bb1-5c0a0f280347.6ec3af79-228a-4a59-a5d7-07d43597b93a Aug 26 14:42:44 devstack sudo[114492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:44 devstack sudo[114489]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:44 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-be6f03ab-2b95-4f3d-9305-1127bf5e1ac3 tempest-VolumeDependencyTests-1292197561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d96a19c1-6fb6-4808-9b45-6a69e8cd195d.info" returned: 0 in 0.295s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:44 devstack cinder-volume[94394]: WARNING cinder.volume.drivers.remotefs [None req-be6f03ab-2b95-4f3d-9305-1127bf5e1ac3 tempest-VolumeDependencyTests-1292197561 None] /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d96a19c1-6fb6-4808-9b45-6a69e8cd195d.info is being set with open permissions: ugo+rw Aug 26 14:42:44 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-be6f03ab-2b95-4f3d-9305-1127bf5e1ac3 tempest-VolumeDependencyTests-1292197561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d96a19c1-6fb6-4808-9b45-6a69e8cd195d.info {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:44 devstack sudo[114495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d96a19c1-6fb6-4808-9b45-6a69e8cd195d.info Aug 26 14:42:44 devstack sudo[114495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:44 devstack sudo[114492]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:44 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-b439d8b1-8cc9-4fce-94f0-6354b60a038c tempest-ProjectMemberTests-1774785373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-da99c5a2-5172-445b-8bb1-5c0a0f280347.6ec3af79-228a-4a59-a5d7-07d43597b93a" returned: 0 in 0.454s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:44 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-b439d8b1-8cc9-4fce-94f0-6354b60a038c tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-da99c5a2-5172-445b-8bb1-5c0a0f280347.6ec3af79-228a-4a59-a5d7-07d43597b93a {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:44 devstack sudo[114495]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:44 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-be6f03ab-2b95-4f3d-9305-1127bf5e1ac3 tempest-VolumeDependencyTests-1292197561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d96a19c1-6fb6-4808-9b45-6a69e8cd195d.info" returned: 0 in 0.295s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:44 devstack sudo[114505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-da99c5a2-5172-445b-8bb1-5c0a0f280347.6ec3af79-228a-4a59-a5d7-07d43597b93a Aug 26 14:42:44 devstack sudo[114505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:44 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-be6f03ab-2b95-4f3d-9305-1127bf5e1ac3 tempest-VolumeDependencyTests-1292197561 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.437s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:42:44 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-be6f03ab-2b95-4f3d-9305-1127bf5e1ac3 tempest-VolumeDependencyTests-1292197561 None] Create snapshot completed successfully Aug 26 14:42:45 devstack sudo[114505]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:45 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-b439d8b1-8cc9-4fce-94f0-6354b60a038c tempest-ProjectMemberTests-1774785373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-da99c5a2-5172-445b-8bb1-5c0a0f280347.6ec3af79-228a-4a59-a5d7-07d43597b93a" returned: 0 in 0.297s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:45 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-b439d8b1-8cc9-4fce-94f0-6354b60a038c tempest-ProjectMemberTests-1774785373 None] Lock "cinder-quobyte-6ec3af79-228a-4a59-a5d7-07d43597b93a" released by "_delete_snapshot" :: held 1.882s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:42:45 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-b439d8b1-8cc9-4fce-94f0-6354b60a038c tempest-ProjectMemberTests-1774785373 None] Lock "cinder-quobyte-da99c5a2-5172-445b-8bb1-5c0a0f280347" released by "delete_snapshot" :: held 1.914s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:42:45 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-b439d8b1-8cc9-4fce-94f0-6354b60a038c tempest-ProjectMemberTests-1774785373 None] Created reservations ['f5e32504-3001-4972-81b2-91acc2f4ac96', '401901c2-edc6-4be4-8a60-ddb872c03a1d', '70d76a76-7636-4a98-a3d8-67ca9cb41cea', 'b72bdde9-a09e-4f3d-a629-b871e9a07e53'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:42:45 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-b439d8b1-8cc9-4fce-94f0-6354b60a038c tempest-ProjectMemberTests-1774785373 None] Delete snapshot completed successfully. Aug 26 14:42:45 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-b439d8b1-8cc9-4fce-94f0-6354b60a038c tempest-ProjectMemberTests-1774785373 None] Lock "cinder-6ec3af79-228a-4a59-a5d7-07d43597b93a-delete_snapshot" released by "delete_snapshot" :: held 2.153s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:42:46 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-88a21a40-e27c-4582-b571-d80c6c218e09 tempest-VolumeDependencyTests-1292197561 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:42:46 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-88a21a40-e27c-4582-b571-d80c6c218e09 tempest-VolumeDependencyTests-1292197561 None] Flow 'volume_create_manager' (d64d2d3e-6632-4fba-8bb8-7338ec3b2cd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:42:46 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-88a21a40-e27c-4582-b571-d80c6c218e09 tempest-VolumeDependencyTests-1292197561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61b1b729-6a2a-41a9-a9ba-4bf07cfe0078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:46 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-88a21a40-e27c-4582-b571-d80c6c218e09 tempest-VolumeDependencyTests-1292197561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61b1b729-6a2a-41a9-a9ba-4bf07cfe0078) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:42:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1538741330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb2459ae-1ff6-4769-aff9-c465635e57c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8da608abaf6d467091ab3d110b9c4e0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:42:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=4479e28b-1851-4783-8799-d92e98043a7c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:42:46Z,use_quota=True,user_id='01eda08a1e40480db0f45b709f454dd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:46 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-88a21a40-e27c-4582-b571-d80c6c218e09 tempest-VolumeDependencyTests-1292197561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2c4d538-11af-4976-9cf4-4e90a7594899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:46 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-88a21a40-e27c-4582-b571-d80c6c218e09 tempest-VolumeDependencyTests-1292197561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2c4d538-11af-4976-9cf4-4e90a7594899) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:46 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-88a21a40-e27c-4582-b571-d80c6c218e09 tempest-VolumeDependencyTests-1292197561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0266cee0-99fa-4240-b1d8-2e9699e430b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:46 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-88a21a40-e27c-4582-b571-d80c6c218e09 tempest-VolumeDependencyTests-1292197561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0266cee0-99fa-4240-b1d8-2e9699e430b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'fb2459ae-1ff6-4769-aff9-c465635e57c3', 'volume_name': 'volume-fb2459ae-1ff6-4769-aff9-c465635e57c3', 'volume_size': 1, 'snapshot_id': '4479e28b-1851-4783-8799-d92e98043a7c'}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:46 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-88a21a40-e27c-4582-b571-d80c6c218e09 tempest-VolumeDependencyTests-1292197561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8047660d-4aa6-447f-81be-b7d9fda38563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:46 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-88a21a40-e27c-4582-b571-d80c6c218e09 tempest-VolumeDependencyTests-1292197561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8047660d-4aa6-447f-81be-b7d9fda38563) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:46 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-88a21a40-e27c-4582-b571-d80c6c218e09 tempest-VolumeDependencyTests-1292197561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e182ca83-59be-4eb7-bc93-c8ddebf4b9ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:46 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-88a21a40-e27c-4582-b571-d80c6c218e09 tempest-VolumeDependencyTests-1292197561 None] Volume fb2459ae-1ff6-4769-aff9-c465635e57c3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-fb2459ae-1ff6-4769-aff9-c465635e57c3', 'volume_size': 1, 'snapshot_id': '4479e28b-1851-4783-8799-d92e98043a7c'} Aug 26 14:42:46 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-d616c147-34da-434f-b70e-2d3e9fbabb88 tempest-ProjectMemberTests-1774785373 None] Acquiring lock "cinder-da99c5a2-5172-445b-8bb1-5c0a0f280347-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:42:46 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-88a21a40-e27c-4582-b571-d80c6c218e09 tempest-VolumeDependencyTests-1292197561 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:42:46 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-88a21a40-e27c-4582-b571-d80c6c218e09 tempest-VolumeDependencyTests-1292197561 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:42:46 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-88a21a40-e27c-4582-b571-d80c6c218e09 tempest-VolumeDependencyTests-1292197561 None] Acquiring lock "cinder-quobyte-4479e28b-1851-4783-8799-d92e98043a7c-fb2459ae-1ff6-4769-aff9-c465635e57c3" by "_create_volume_from_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:42:46 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-d616c147-34da-434f-b70e-2d3e9fbabb88 tempest-ProjectMemberTests-1774785373 None] Lock "cinder-da99c5a2-5172-445b-8bb1-5c0a0f280347-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:42:46 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-88a21a40-e27c-4582-b571-d80c6c218e09 tempest-VolumeDependencyTests-1292197561 None] Lock "cinder-quobyte-4479e28b-1851-4783-8799-d92e98043a7c-fb2459ae-1ff6-4769-aff9-c465635e57c3" acquired by "_create_volume_from_snapshot" :: waited 0.035s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:42:46 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-88a21a40-e27c-4582-b571-d80c6c218e09 tempest-VolumeDependencyTests-1292197561 None] Creating volume fb2459ae-1ff6-4769-aff9-c465635e57c3 from snapshot 4479e28b-1851-4783-8799-d92e98043a7c {{(pid=94394) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Aug 26 14:42:46 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-88a21a40-e27c-4582-b571-d80c6c218e09 tempest-VolumeDependencyTests-1292197561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:42:46 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-88a21a40-e27c-4582-b571-d80c6c218e09 tempest-VolumeDependencyTests-1292197561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:42:46 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-88a21a40-e27c-4582-b571-d80c6c218e09 tempest-VolumeDependencyTests-1292197561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:42:46 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-88a21a40-e27c-4582-b571-d80c6c218e09 tempest-VolumeDependencyTests-1292197561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:42:46 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-88a21a40-e27c-4582-b571-d80c6c218e09 tempest-VolumeDependencyTests-1292197561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:42:46 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-88a21a40-e27c-4582-b571-d80c6c218e09 tempest-VolumeDependencyTests-1292197561 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:42:46 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-88a21a40-e27c-4582-b571-d80c6c218e09 tempest-VolumeDependencyTests-1292197561 None] Acquiring lock "cinder-quobyte-fb2459ae-1ff6-4769-aff9-c465635e57c3" by "_copy_volume_from_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:42:46 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-d616c147-34da-434f-b70e-2d3e9fbabb88 tempest-ProjectMemberTests-1774785373 None] Acquiring lock "cinder-quobyte-da99c5a2-5172-445b-8bb1-5c0a0f280347" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:42:46 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-88a21a40-e27c-4582-b571-d80c6c218e09 tempest-VolumeDependencyTests-1292197561 None] Lock "cinder-quobyte-fb2459ae-1ff6-4769-aff9-c465635e57c3" acquired by "_copy_volume_from_snapshot" :: waited 0.034s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:42:46 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-88a21a40-e27c-4582-b571-d80c6c218e09 tempest-VolumeDependencyTests-1292197561 None] snapshot: 4479e28b-1851-4783-8799-d92e98043a7c, volume: fb2459ae-1ff6-4769-aff9-c465635e57c3, {{(pid=94394) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 26 14:42:46 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-88a21a40-e27c-4582-b571-d80c6c218e09 tempest-VolumeDependencyTests-1292197561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:42:46 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-88a21a40-e27c-4582-b571-d80c6c218e09 tempest-VolumeDependencyTests-1292197561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:42:46 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-88a21a40-e27c-4582-b571-d80c6c218e09 tempest-VolumeDependencyTests-1292197561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:42:46 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-88a21a40-e27c-4582-b571-d80c6c218e09 tempest-VolumeDependencyTests-1292197561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:42:46 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-88a21a40-e27c-4582-b571-d80c6c218e09 tempest-VolumeDependencyTests-1292197561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:42:46 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-d616c147-34da-434f-b70e-2d3e9fbabb88 tempest-ProjectMemberTests-1774785373 None] Lock "cinder-quobyte-da99c5a2-5172-445b-8bb1-5c0a0f280347" acquired by "delete_volume" :: waited 0.051s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:42:46 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[185ee896-0d5b-42ea-8129-408d5c36296f]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:42:46 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-88a21a40-e27c-4582-b571-d80c6c218e09 tempest-VolumeDependencyTests-1292197561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d96a19c1-6fb6-4808-9b45-6a69e8cd195d.4479e28b-1851-4783-8799-d92e98043a7c {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:46 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[f30ef6ea-f3e6-42a4-9231-d5f298a49e81]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:42:46 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-d616c147-34da-434f-b70e-2d3e9fbabb88 tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-da99c5a2-5172-445b-8bb1-5c0a0f280347 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:46 devstack sudo[114508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d96a19c1-6fb6-4808-9b45-6a69e8cd195d.4479e28b-1851-4783-8799-d92e98043a7c Aug 26 14:42:46 devstack sudo[114508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:46 devstack sudo[114509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-da99c5a2-5172-445b-8bb1-5c0a0f280347 Aug 26 14:42:46 devstack sudo[114509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:47 devstack sudo[114508]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:47 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-88a21a40-e27c-4582-b571-d80c6c218e09 tempest-VolumeDependencyTests-1292197561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d96a19c1-6fb6-4808-9b45-6a69e8cd195d.4479e28b-1851-4783-8799-d92e98043a7c" returned: 0 in 0.389s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:47 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-88a21a40-e27c-4582-b571-d80c6c218e09 tempest-VolumeDependencyTests-1292197561 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d96a19c1-6fb6-4808-9b45-6a69e8cd195d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94394) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 14:42:47 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[114c0143-6899-4490-a8b9-9bb1b0914aca]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:42:47 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-88a21a40-e27c-4582-b571-d80c6c218e09 tempest-VolumeDependencyTests-1292197561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d96a19c1-6fb6-4808-9b45-6a69e8cd195d {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:47 devstack sudo[114509]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:47 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-d616c147-34da-434f-b70e-2d3e9fbabb88 tempest-ProjectMemberTests-1774785373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-da99c5a2-5172-445b-8bb1-5c0a0f280347" returned: 0 in 0.406s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:47 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-d616c147-34da-434f-b70e-2d3e9fbabb88 tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-da99c5a2-5172-445b-8bb1-5c0a0f280347 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:47 devstack sudo[114519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-da99c5a2-5172-445b-8bb1-5c0a0f280347 Aug 26 14:42:47 devstack sudo[114519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:47 devstack sudo[114518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d96a19c1-6fb6-4808-9b45-6a69e8cd195d Aug 26 14:42:47 devstack sudo[114518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:47 devstack sudo[114519]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:47 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-d616c147-34da-434f-b70e-2d3e9fbabb88 tempest-ProjectMemberTests-1774785373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-da99c5a2-5172-445b-8bb1-5c0a0f280347" returned: 0 in 0.295s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:47 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-d616c147-34da-434f-b70e-2d3e9fbabb88 tempest-ProjectMemberTests-1774785373 None] Lock "cinder-quobyte-da99c5a2-5172-445b-8bb1-5c0a0f280347" released by "delete_volume" :: held 0.766s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:42:47 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-d616c147-34da-434f-b70e-2d3e9fbabb88 tempest-ProjectMemberTests-1774785373 None] Created reservations ['9c423cdf-f478-4053-83a0-48bdf3d3f934', '6cf5aa72-aa4f-4880-ad31-3892b4a0d6bc', '23ab6a7d-199e-4c92-81ca-f5b05ba6fc6d', '3e481e85-b0d1-4850-842a-20211eebf400'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:42:47 devstack sudo[114518]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:47 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-88a21a40-e27c-4582-b571-d80c6c218e09 tempest-VolumeDependencyTests-1292197561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d96a19c1-6fb6-4808-9b45-6a69e8cd195d" returned: 0 in 0.452s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:47 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-88a21a40-e27c-4582-b571-d80c6c218e09 tempest-VolumeDependencyTests-1292197561 None] will copy from snapshot at /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d96a19c1-6fb6-4808-9b45-6a69e8cd195d {{(pid=94394) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 26 14:42:47 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-88a21a40-e27c-4582-b571-d80c6c218e09 tempest-VolumeDependencyTests-1292197561 None] Creating direct copy from snapshot {{(pid=94394) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 26 14:42:47 devstack cinder-volume[94394]: DEBUG cinder.utils [None req-88a21a40-e27c-4582-b571-d80c6c218e09 tempest-VolumeDependencyTests-1292197561 None] Path /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-fb2459ae-1ff6-4769-aff9-c465635e57c3 not found in is_blk_device check {{(pid=94394) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 26 14:42:47 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-88a21a40-e27c-4582-b571-d80c6c218e09 tempest-VolumeDependencyTests-1292197561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d96a19c1-6fb6-4808-9b45-6a69e8cd195d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-fb2459ae-1ff6-4769-aff9-c465635e57c3 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:47 devstack sudo[114526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d96a19c1-6fb6-4808-9b45-6a69e8cd195d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-fb2459ae-1ff6-4769-aff9-c465635e57c3 Aug 26 14:42:47 devstack sudo[114526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:47 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-d616c147-34da-434f-b70e-2d3e9fbabb88 tempest-ProjectMemberTests-1774785373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:42:47 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-d616c147-34da-434f-b70e-2d3e9fbabb88 tempest-ProjectMemberTests-1774785373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:42:47 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-d616c147-34da-434f-b70e-2d3e9fbabb88 tempest-ProjectMemberTests-1774785373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:42:47 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-d616c147-34da-434f-b70e-2d3e9fbabb88 tempest-ProjectMemberTests-1774785373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:42:47 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-d616c147-34da-434f-b70e-2d3e9fbabb88 tempest-ProjectMemberTests-1774785373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:42:47 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-d616c147-34da-434f-b70e-2d3e9fbabb88 tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:47 devstack sudo[114528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:42:47 devstack sudo[114528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:48 devstack sudo[114528]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:48 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-d616c147-34da-434f-b70e-2d3e9fbabb88 tempest-ProjectMemberTests-1774785373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.612s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:48 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-d616c147-34da-434f-b70e-2d3e9fbabb88 tempest-ProjectMemberTests-1774785373 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:42:48 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-d616c147-34da-434f-b70e-2d3e9fbabb88 tempest-ProjectMemberTests-1774785373 None] Deleted volume successfully. Aug 26 14:42:48 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-d616c147-34da-434f-b70e-2d3e9fbabb88 tempest-ProjectMemberTests-1774785373 None] Lock "cinder-da99c5a2-5172-445b-8bb1-5c0a0f280347-delete_volume" released by "delete_volume" :: held 1.764s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:42:48 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-67201a93-705e-4a6e-a175-76bb73609ec3 tempest-ProjectMemberTests-1774785373 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:42:48 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-67201a93-705e-4a6e-a175-76bb73609ec3 tempest-ProjectMemberTests-1774785373 None] Flow 'volume_create_manager' (e204566e-d108-4d48-9074-04f8f4174cfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:42:48 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-67201a93-705e-4a6e-a175-76bb73609ec3 tempest-ProjectMemberTests-1774785373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a3f2afa-dfce-4bcb-96eb-bb4ed3074986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:49 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-67201a93-705e-4a6e-a175-76bb73609ec3 tempest-ProjectMemberTests-1774785373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a3f2afa-dfce-4bcb-96eb-bb4ed3074986) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:42:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-970894486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c94ddf0-6127-48f1-9ce1-9a5e467936d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8dd248190cb40cebc9daf2b89f48fd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:42:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:42:49Z,use_quota=True,user_id='ad0617c386b6460d8f790d85646880e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:49 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-67201a93-705e-4a6e-a175-76bb73609ec3 tempest-ProjectMemberTests-1774785373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a2bcdf8-241b-417a-9ad7-7868c5238fed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:49 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-67201a93-705e-4a6e-a175-76bb73609ec3 tempest-ProjectMemberTests-1774785373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a2bcdf8-241b-417a-9ad7-7868c5238fed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:49 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-67201a93-705e-4a6e-a175-76bb73609ec3 tempest-ProjectMemberTests-1774785373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5f1344c-06b2-4bcc-a5ee-af6513d3b02c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:49 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-67201a93-705e-4a6e-a175-76bb73609ec3 tempest-ProjectMemberTests-1774785373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5f1344c-06b2-4bcc-a5ee-af6513d3b02c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c94ddf0-6127-48f1-9ce1-9a5e467936d1', 'volume_name': 'volume-5c94ddf0-6127-48f1-9ce1-9a5e467936d1', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:49 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-67201a93-705e-4a6e-a175-76bb73609ec3 tempest-ProjectMemberTests-1774785373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72ee4141-ef0f-46bf-b5e8-73dd5a4b61d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:49 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-67201a93-705e-4a6e-a175-76bb73609ec3 tempest-ProjectMemberTests-1774785373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72ee4141-ef0f-46bf-b5e8-73dd5a4b61d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:49 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-67201a93-705e-4a6e-a175-76bb73609ec3 tempest-ProjectMemberTests-1774785373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50dd0cf4-0e93-4f33-a9f0-d76f9b2794a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:49 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-67201a93-705e-4a6e-a175-76bb73609ec3 tempest-ProjectMemberTests-1774785373 None] Volume 5c94ddf0-6127-48f1-9ce1-9a5e467936d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c94ddf0-6127-48f1-9ce1-9a5e467936d1', 'volume_size': 1} Aug 26 14:42:49 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-67201a93-705e-4a6e-a175-76bb73609ec3 tempest-ProjectMemberTests-1774785373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:42:53 devstack sudo[114526]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:53 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-88a21a40-e27c-4582-b571-d80c6c218e09 tempest-VolumeDependencyTests-1292197561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d96a19c1-6fb6-4808-9b45-6a69e8cd195d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-fb2459ae-1ff6-4769-aff9-c465635e57c3" returned: 0 in 6.182s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:53 devstack cinder-volume[94394]: DEBUG cinder.image.image_utils [None req-88a21a40-e27c-4582-b571-d80c6c218e09 tempest-VolumeDependencyTests-1292197561 None] Image conversion details: src /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d96a19c1-6fb6-4808-9b45-6a69e8cd195d, size 1024.00 MB, duration 6.18 sec, destination /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-fb2459ae-1ff6-4769-aff9-c465635e57c3 {{(pid=94394) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 14:42:53 devstack cinder-volume[94394]: INFO cinder.image.image_utils [None req-88a21a40-e27c-4582-b571-d80c6c218e09 tempest-VolumeDependencyTests-1292197561 None] Converted 1024.00 MB image at 165.62 MB/s Aug 26 14:42:53 devstack cinder-volume[94394]: WARNING cinder.volume.drivers.remotefs [None req-88a21a40-e27c-4582-b571-d80c6c218e09 tempest-VolumeDependencyTests-1292197561 None] /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-fb2459ae-1ff6-4769-aff9-c465635e57c3 is being set with open permissions: ugo+rw Aug 26 14:42:53 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-88a21a40-e27c-4582-b571-d80c6c218e09 tempest-VolumeDependencyTests-1292197561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-fb2459ae-1ff6-4769-aff9-c465635e57c3 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:53 devstack sudo[114546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-fb2459ae-1ff6-4769-aff9-c465635e57c3 Aug 26 14:42:53 devstack sudo[114546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:53 devstack sudo[114546]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:53 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-88a21a40-e27c-4582-b571-d80c6c218e09 tempest-VolumeDependencyTests-1292197561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-fb2459ae-1ff6-4769-aff9-c465635e57c3" returned: 0 in 0.260s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:53 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-88a21a40-e27c-4582-b571-d80c6c218e09 tempest-VolumeDependencyTests-1292197561 None] Lock "cinder-quobyte-fb2459ae-1ff6-4769-aff9-c465635e57c3" released by "_copy_volume_from_snapshot" :: held 7.403s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:42:54 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-88a21a40-e27c-4582-b571-d80c6c218e09 tempest-VolumeDependencyTests-1292197561 None] Lock "cinder-quobyte-4479e28b-1851-4783-8799-d92e98043a7c-fb2459ae-1ff6-4769-aff9-c465635e57c3" released by "_create_volume_from_snapshot" :: held 7.506s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:42:54 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-88a21a40-e27c-4582-b571-d80c6c218e09 tempest-VolumeDependencyTests-1292197561 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.542s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:42:54 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-67201a93-705e-4a6e-a175-76bb73609ec3 tempest-ProjectMemberTests-1774785373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.876s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:42:54 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-67201a93-705e-4a6e-a175-76bb73609ec3 tempest-ProjectMemberTests-1774785373 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:42:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-970894486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c94ddf0-6127-48f1-9ce1-9a5e467936d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8dd248190cb40cebc9daf2b89f48fd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:42:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:42:49Z,use_quota=True,user_id='ad0617c386b6460d8f790d85646880e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:42:54 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-67201a93-705e-4a6e-a175-76bb73609ec3 tempest-ProjectMemberTests-1774785373 None] Creating volume 5c94ddf0-6127-48f1-9ce1-9a5e467936d1 {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:42:54 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-67201a93-705e-4a6e-a175-76bb73609ec3 tempest-ProjectMemberTests-1774785373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:42:54 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-67201a93-705e-4a6e-a175-76bb73609ec3 tempest-ProjectMemberTests-1774785373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:42:54 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-67201a93-705e-4a6e-a175-76bb73609ec3 tempest-ProjectMemberTests-1774785373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:42:54 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-67201a93-705e-4a6e-a175-76bb73609ec3 tempest-ProjectMemberTests-1774785373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:42:54 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-67201a93-705e-4a6e-a175-76bb73609ec3 tempest-ProjectMemberTests-1774785373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:42:54 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-67201a93-705e-4a6e-a175-76bb73609ec3 tempest-ProjectMemberTests-1774785373 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:42:54 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-67201a93-705e-4a6e-a175-76bb73609ec3 tempest-ProjectMemberTests-1774785373 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:42:54 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-67201a93-705e-4a6e-a175-76bb73609ec3 tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5c94ddf0-6127-48f1-9ce1-9a5e467936d1 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:54 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-88a21a40-e27c-4582-b571-d80c6c218e09 tempest-VolumeDependencyTests-1292197561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e182ca83-59be-4eb7-bc93-c8ddebf4b9ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb2459ae-1ff6-4769-aff9-c465635e57c3', 'volume_size': 1, 'snapshot_id': '4479e28b-1851-4783-8799-d92e98043a7c'}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:54 devstack sudo[114549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5c94ddf0-6127-48f1-9ce1-9a5e467936d1 1073741824 Aug 26 14:42:54 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-88a21a40-e27c-4582-b571-d80c6c218e09 tempest-VolumeDependencyTests-1292197561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf81ee99-492e-4a0b-a4a1-d1337fb7e66c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:54 devstack sudo[114549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:54 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-88a21a40-e27c-4582-b571-d80c6c218e09 tempest-VolumeDependencyTests-1292197561 None] Volume volume-fb2459ae-1ff6-4769-aff9-c465635e57c3 (fb2459ae-1ff6-4769-aff9-c465635e57c3): created successfully Aug 26 14:42:54 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-88a21a40-e27c-4582-b571-d80c6c218e09 tempest-VolumeDependencyTests-1292197561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf81ee99-492e-4a0b-a4a1-d1337fb7e66c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:54 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-88a21a40-e27c-4582-b571-d80c6c218e09 tempest-VolumeDependencyTests-1292197561 None] Flow 'volume_create_manager' (d64d2d3e-6632-4fba-8bb8-7338ec3b2cd8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:42:54 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-88a21a40-e27c-4582-b571-d80c6c218e09 tempest-VolumeDependencyTests-1292197561 None] Created volume successfully. Aug 26 14:42:54 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-efec2131-2e13-45a3-aea2-3cde56ed7072 tempest-VolumeDependencyTests-1292197561 None] Acquiring lock "cinder-4479e28b-1851-4783-8799-d92e98043a7c-delete_snapshot" by "delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:42:54 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-efec2131-2e13-45a3-aea2-3cde56ed7072 tempest-VolumeDependencyTests-1292197561 None] Lock "cinder-4479e28b-1851-4783-8799-d92e98043a7c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:42:54 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-efec2131-2e13-45a3-aea2-3cde56ed7072 tempest-VolumeDependencyTests-1292197561 None] Acquiring lock "cinder-quobyte-d96a19c1-6fb6-4808-9b45-6a69e8cd195d" by "delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:42:54 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-efec2131-2e13-45a3-aea2-3cde56ed7072 tempest-VolumeDependencyTests-1292197561 None] Lock "cinder-quobyte-d96a19c1-6fb6-4808-9b45-6a69e8cd195d" acquired by "delete_snapshot" :: waited 0.034s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:42:54 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-efec2131-2e13-45a3-aea2-3cde56ed7072 tempest-VolumeDependencyTests-1292197561 None] Acquiring lock "cinder-quobyte-4479e28b-1851-4783-8799-d92e98043a7c" by "_delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:42:54 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-efec2131-2e13-45a3-aea2-3cde56ed7072 tempest-VolumeDependencyTests-1292197561 None] Lock "cinder-quobyte-4479e28b-1851-4783-8799-d92e98043a7c" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:42:54 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-efec2131-2e13-45a3-aea2-3cde56ed7072 tempest-VolumeDependencyTests-1292197561 None] Deleting offline snapshot 4479e28b-1851-4783-8799-d92e98043a7c of volume d96a19c1-6fb6-4808-9b45-6a69e8cd195d {{(pid=94394) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 14:42:54 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-efec2131-2e13-45a3-aea2-3cde56ed7072 tempest-VolumeDependencyTests-1292197561 None] snapshot_file for this snap is: volume-d96a19c1-6fb6-4808-9b45-6a69e8cd195d.4479e28b-1851-4783-8799-d92e98043a7c {{(pid=94394) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 14:42:54 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f913fc0-4136-4e2d-8c3e-ab98cbf1954e]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:42:54 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-efec2131-2e13-45a3-aea2-3cde56ed7072 tempest-VolumeDependencyTests-1292197561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d96a19c1-6fb6-4808-9b45-6a69e8cd195d.4479e28b-1851-4783-8799-d92e98043a7c {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:54 devstack sudo[114549]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:54 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-67201a93-705e-4a6e-a175-76bb73609ec3 tempest-ProjectMemberTests-1774785373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5c94ddf0-6127-48f1-9ce1-9a5e467936d1 1073741824" returned: 0 in 0.761s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:54 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-67201a93-705e-4a6e-a175-76bb73609ec3 tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5c94ddf0-6127-48f1-9ce1-9a5e467936d1 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:54 devstack sudo[114557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5c94ddf0-6127-48f1-9ce1-9a5e467936d1 Aug 26 14:42:54 devstack sudo[114557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:54 devstack sudo[114556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d96a19c1-6fb6-4808-9b45-6a69e8cd195d.4479e28b-1851-4783-8799-d92e98043a7c Aug 26 14:42:54 devstack sudo[114556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:55 devstack sudo[114557]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:55 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-67201a93-705e-4a6e-a175-76bb73609ec3 tempest-ProjectMemberTests-1774785373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5c94ddf0-6127-48f1-9ce1-9a5e467936d1" returned: 0 in 0.366s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:55 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-67201a93-705e-4a6e-a175-76bb73609ec3 tempest-ProjectMemberTests-1774785373 None] <== create_volume: return (1231ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:42:55 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-67201a93-705e-4a6e-a175-76bb73609ec3 tempest-ProjectMemberTests-1774785373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.235s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:42:55 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-67201a93-705e-4a6e-a175-76bb73609ec3 tempest-ProjectMemberTests-1774785373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50dd0cf4-0e93-4f33-a9f0-d76f9b2794a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c94ddf0-6127-48f1-9ce1-9a5e467936d1', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:55 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-67201a93-705e-4a6e-a175-76bb73609ec3 tempest-ProjectMemberTests-1774785373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb7cc0fa-9656-4cc8-9059-57072dbdd7b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:42:55 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-67201a93-705e-4a6e-a175-76bb73609ec3 tempest-ProjectMemberTests-1774785373 None] Volume volume-5c94ddf0-6127-48f1-9ce1-9a5e467936d1 (5c94ddf0-6127-48f1-9ce1-9a5e467936d1): created successfully Aug 26 14:42:55 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-67201a93-705e-4a6e-a175-76bb73609ec3 tempest-ProjectMemberTests-1774785373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb7cc0fa-9656-4cc8-9059-57072dbdd7b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:42:55 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-67201a93-705e-4a6e-a175-76bb73609ec3 tempest-ProjectMemberTests-1774785373 None] Flow 'volume_create_manager' (e204566e-d108-4d48-9074-04f8f4174cfa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:42:55 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-67201a93-705e-4a6e-a175-76bb73609ec3 tempest-ProjectMemberTests-1774785373 None] Created volume successfully. Aug 26 14:42:55 devstack sudo[114556]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:55 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-efec2131-2e13-45a3-aea2-3cde56ed7072 tempest-VolumeDependencyTests-1292197561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d96a19c1-6fb6-4808-9b45-6a69e8cd195d.4479e28b-1851-4783-8799-d92e98043a7c" returned: 0 in 0.642s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:55 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-efec2131-2e13-45a3-aea2-3cde56ed7072 tempest-VolumeDependencyTests-1292197561 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d96a19c1-6fb6-4808-9b45-6a69e8cd195d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94394) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 14:42:55 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[91624b68-6df3-4cc6-8f66-5442318024fc]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:42:55 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-efec2131-2e13-45a3-aea2-3cde56ed7072 tempest-VolumeDependencyTests-1292197561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d96a19c1-6fb6-4808-9b45-6a69e8cd195d {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:55 devstack sudo[114564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d96a19c1-6fb6-4808-9b45-6a69e8cd195d Aug 26 14:42:55 devstack sudo[114564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:55 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-4df6314b-0e0d-41f6-a66c-f4248c8c2107 tempest-ProjectMemberTests-1774785373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:42:55 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-4df6314b-0e0d-41f6-a66c-f4248c8c2107 tempest-ProjectMemberTests-1774785373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:42:55 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-4df6314b-0e0d-41f6-a66c-f4248c8c2107 tempest-ProjectMemberTests-1774785373 None] Creating offline snapshot 52619b5e-951e-4ac5-a07a-0b1524b7dbe3 of volume 5c94ddf0-6127-48f1-9ce1-9a5e467936d1 {{(pid=94394) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 14:42:55 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a49be94-a24a-4e9f-bed8-c36e94d751cc]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:42:56 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4df6314b-0e0d-41f6-a66c-f4248c8c2107 tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5c94ddf0-6127-48f1-9ce1-9a5e467936d1 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:56 devstack sudo[114564]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:56 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-efec2131-2e13-45a3-aea2-3cde56ed7072 tempest-VolumeDependencyTests-1292197561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d96a19c1-6fb6-4808-9b45-6a69e8cd195d" returned: 0 in 0.704s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:56 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-efec2131-2e13-45a3-aea2-3cde56ed7072 tempest-VolumeDependencyTests-1292197561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d96a19c1-6fb6-4808-9b45-6a69e8cd195d.4479e28b-1851-4783-8799-d92e98043a7c {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:56 devstack sudo[114568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5c94ddf0-6127-48f1-9ce1-9a5e467936d1 Aug 26 14:42:56 devstack sudo[114568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:56 devstack sudo[114570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d96a19c1-6fb6-4808-9b45-6a69e8cd195d.4479e28b-1851-4783-8799-d92e98043a7c Aug 26 14:42:56 devstack sudo[114570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:56 devstack sudo[114568]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:56 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4df6314b-0e0d-41f6-a66c-f4248c8c2107 tempest-ProjectMemberTests-1774785373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5c94ddf0-6127-48f1-9ce1-9a5e467936d1" returned: 0 in 0.432s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:56 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4df6314b-0e0d-41f6-a66c-f4248c8c2107 tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5c94ddf0-6127-48f1-9ce1-9a5e467936d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5c94ddf0-6127-48f1-9ce1-9a5e467936d1.52619b5e-951e-4ac5-a07a-0b1524b7dbe3 1G {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:56 devstack sudo[114580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5c94ddf0-6127-48f1-9ce1-9a5e467936d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5c94ddf0-6127-48f1-9ce1-9a5e467936d1.52619b5e-951e-4ac5-a07a-0b1524b7dbe3 1G Aug 26 14:42:56 devstack sudo[114580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:56 devstack sudo[114570]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:56 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-efec2131-2e13-45a3-aea2-3cde56ed7072 tempest-VolumeDependencyTests-1292197561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d96a19c1-6fb6-4808-9b45-6a69e8cd195d.4479e28b-1851-4783-8799-d92e98043a7c" returned: 0 in 0.442s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:56 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-efec2131-2e13-45a3-aea2-3cde56ed7072 tempest-VolumeDependencyTests-1292197561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d96a19c1-6fb6-4808-9b45-6a69e8cd195d.4479e28b-1851-4783-8799-d92e98043a7c {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:56 devstack sudo[114582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d96a19c1-6fb6-4808-9b45-6a69e8cd195d.4479e28b-1851-4783-8799-d92e98043a7c Aug 26 14:42:56 devstack sudo[114582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:56 devstack sudo[114582]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:56 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-efec2131-2e13-45a3-aea2-3cde56ed7072 tempest-VolumeDependencyTests-1292197561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d96a19c1-6fb6-4808-9b45-6a69e8cd195d.4479e28b-1851-4783-8799-d92e98043a7c" returned: 0 in 0.339s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:56 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-efec2131-2e13-45a3-aea2-3cde56ed7072 tempest-VolumeDependencyTests-1292197561 None] Lock "cinder-quobyte-4479e28b-1851-4783-8799-d92e98043a7c" released by "_delete_snapshot" :: held 2.269s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:42:56 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-efec2131-2e13-45a3-aea2-3cde56ed7072 tempest-VolumeDependencyTests-1292197561 None] Lock "cinder-quobyte-d96a19c1-6fb6-4808-9b45-6a69e8cd195d" released by "delete_snapshot" :: held 2.304s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:42:57 devstack sudo[114580]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:57 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4df6314b-0e0d-41f6-a66c-f4248c8c2107 tempest-ProjectMemberTests-1774785373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5c94ddf0-6127-48f1-9ce1-9a5e467936d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5c94ddf0-6127-48f1-9ce1-9a5e467936d1.52619b5e-951e-4ac5-a07a-0b1524b7dbe3 1G" returned: 0 in 0.605s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:57 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4df6314b-0e0d-41f6-a66c-f4248c8c2107 tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c94ddf0-6127-48f1-9ce1-9a5e467936d1 -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5c94ddf0-6127-48f1-9ce1-9a5e467936d1.52619b5e-951e-4ac5-a07a-0b1524b7dbe3 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:57 devstack sudo[114589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c94ddf0-6127-48f1-9ce1-9a5e467936d1 -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5c94ddf0-6127-48f1-9ce1-9a5e467936d1.52619b5e-951e-4ac5-a07a-0b1524b7dbe3 Aug 26 14:42:57 devstack sudo[114589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:57 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-efec2131-2e13-45a3-aea2-3cde56ed7072 tempest-VolumeDependencyTests-1292197561 None] Created reservations ['0e5a28eb-c649-4486-ad5b-e0cc6eb539db', 'aab21f6e-574c-49f1-9a3c-03c2f8236cbf', 'daf4d01e-065d-46ea-a882-4f78a3006f30', '892bdec3-825a-4ef7-bc29-79f4ba2dda1c'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:42:57 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-efec2131-2e13-45a3-aea2-3cde56ed7072 tempest-VolumeDependencyTests-1292197561 None] Delete snapshot completed successfully. Aug 26 14:42:57 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-efec2131-2e13-45a3-aea2-3cde56ed7072 tempest-VolumeDependencyTests-1292197561 None] Lock "cinder-4479e28b-1851-4783-8799-d92e98043a7c-delete_snapshot" released by "delete_snapshot" :: held 2.613s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:42:57 devstack sudo[114589]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:57 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4df6314b-0e0d-41f6-a66c-f4248c8c2107 tempest-ProjectMemberTests-1774785373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c94ddf0-6127-48f1-9ce1-9a5e467936d1 -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5c94ddf0-6127-48f1-9ce1-9a5e467936d1.52619b5e-951e-4ac5-a07a-0b1524b7dbe3" returned: 0 in 0.444s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:57 devstack cinder-volume[94394]: WARNING cinder.volume.drivers.remotefs [None req-4df6314b-0e0d-41f6-a66c-f4248c8c2107 tempest-ProjectMemberTests-1774785373 None] /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5c94ddf0-6127-48f1-9ce1-9a5e467936d1.52619b5e-951e-4ac5-a07a-0b1524b7dbe3 is being set with open permissions: ugo+rw Aug 26 14:42:57 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4df6314b-0e0d-41f6-a66c-f4248c8c2107 tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5c94ddf0-6127-48f1-9ce1-9a5e467936d1.52619b5e-951e-4ac5-a07a-0b1524b7dbe3 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:57 devstack sudo[114594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5c94ddf0-6127-48f1-9ce1-9a5e467936d1.52619b5e-951e-4ac5-a07a-0b1524b7dbe3 Aug 26 14:42:57 devstack sudo[114594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:57 devstack sudo[114594]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:57 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4df6314b-0e0d-41f6-a66c-f4248c8c2107 tempest-ProjectMemberTests-1774785373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5c94ddf0-6127-48f1-9ce1-9a5e467936d1.52619b5e-951e-4ac5-a07a-0b1524b7dbe3" returned: 0 in 0.351s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:57 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-c205e71a-c52c-4a95-87fa-3cd9bbaf1113 tempest-VolumeDependencyTests-1292197561 None] Acquiring lock "cinder-d96a19c1-6fb6-4808-9b45-6a69e8cd195d-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:42:57 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4df6314b-0e0d-41f6-a66c-f4248c8c2107 tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5c94ddf0-6127-48f1-9ce1-9a5e467936d1.info {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:57 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-c205e71a-c52c-4a95-87fa-3cd9bbaf1113 tempest-VolumeDependencyTests-1292197561 None] Lock "cinder-d96a19c1-6fb6-4808-9b45-6a69e8cd195d-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:42:57 devstack sudo[114598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5c94ddf0-6127-48f1-9ce1-9a5e467936d1.info Aug 26 14:42:57 devstack sudo[114598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:58 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-c205e71a-c52c-4a95-87fa-3cd9bbaf1113 tempest-VolumeDependencyTests-1292197561 None] Acquiring lock "cinder-quobyte-d96a19c1-6fb6-4808-9b45-6a69e8cd195d" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:42:58 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-c205e71a-c52c-4a95-87fa-3cd9bbaf1113 tempest-VolumeDependencyTests-1292197561 None] Lock "cinder-quobyte-d96a19c1-6fb6-4808-9b45-6a69e8cd195d" acquired by "delete_volume" :: waited 0.021s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:42:58 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[26c9911a-83cc-496d-8030-ef1fe9964077]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:42:58 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-c205e71a-c52c-4a95-87fa-3cd9bbaf1113 tempest-VolumeDependencyTests-1292197561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d96a19c1-6fb6-4808-9b45-6a69e8cd195d {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:58 devstack sudo[114600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d96a19c1-6fb6-4808-9b45-6a69e8cd195d Aug 26 14:42:58 devstack sudo[114600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:58 devstack sudo[114598]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:58 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4df6314b-0e0d-41f6-a66c-f4248c8c2107 tempest-ProjectMemberTests-1774785373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5c94ddf0-6127-48f1-9ce1-9a5e467936d1.info" returned: 0 in 0.428s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:58 devstack cinder-volume[94394]: WARNING cinder.volume.drivers.remotefs [None req-4df6314b-0e0d-41f6-a66c-f4248c8c2107 tempest-ProjectMemberTests-1774785373 None] /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5c94ddf0-6127-48f1-9ce1-9a5e467936d1.info is being set with open permissions: ugo+rw Aug 26 14:42:58 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4df6314b-0e0d-41f6-a66c-f4248c8c2107 tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5c94ddf0-6127-48f1-9ce1-9a5e467936d1.info {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:58 devstack sudo[114603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5c94ddf0-6127-48f1-9ce1-9a5e467936d1.info Aug 26 14:42:58 devstack sudo[114603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:58 devstack sudo[114600]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:58 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-c205e71a-c52c-4a95-87fa-3cd9bbaf1113 tempest-VolumeDependencyTests-1292197561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d96a19c1-6fb6-4808-9b45-6a69e8cd195d" returned: 0 in 0.496s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:58 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-c205e71a-c52c-4a95-87fa-3cd9bbaf1113 tempest-VolumeDependencyTests-1292197561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d96a19c1-6fb6-4808-9b45-6a69e8cd195d {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:58 devstack sudo[114608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d96a19c1-6fb6-4808-9b45-6a69e8cd195d Aug 26 14:42:58 devstack sudo[114608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:58 devstack sudo[114603]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:58 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4df6314b-0e0d-41f6-a66c-f4248c8c2107 tempest-ProjectMemberTests-1774785373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5c94ddf0-6127-48f1-9ce1-9a5e467936d1.info" returned: 0 in 0.358s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:58 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-4df6314b-0e0d-41f6-a66c-f4248c8c2107 tempest-ProjectMemberTests-1774785373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.745s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:42:58 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-4df6314b-0e0d-41f6-a66c-f4248c8c2107 tempest-ProjectMemberTests-1774785373 None] Create snapshot completed successfully Aug 26 14:42:58 devstack sudo[114608]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:58 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-c205e71a-c52c-4a95-87fa-3cd9bbaf1113 tempest-VolumeDependencyTests-1292197561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d96a19c1-6fb6-4808-9b45-6a69e8cd195d" returned: 0 in 0.285s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:58 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-c205e71a-c52c-4a95-87fa-3cd9bbaf1113 tempest-VolumeDependencyTests-1292197561 None] Lock "cinder-quobyte-d96a19c1-6fb6-4808-9b45-6a69e8cd195d" released by "delete_volume" :: held 0.861s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:42:58 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-c205e71a-c52c-4a95-87fa-3cd9bbaf1113 tempest-VolumeDependencyTests-1292197561 None] Created reservations ['19fffc44-f005-4b32-b716-b19cfd5be667', 'a1458ad4-010a-48c7-baa4-24dc7a737d86', 'e3498e2d-73fd-48be-bb8d-87bed603861a', 'c52431e8-c35c-43d5-ab75-60d0fc8496c6'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:42:59 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-c205e71a-c52c-4a95-87fa-3cd9bbaf1113 tempest-VolumeDependencyTests-1292197561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:42:59 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-c205e71a-c52c-4a95-87fa-3cd9bbaf1113 tempest-VolumeDependencyTests-1292197561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:42:59 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-c205e71a-c52c-4a95-87fa-3cd9bbaf1113 tempest-VolumeDependencyTests-1292197561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:42:59 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-c205e71a-c52c-4a95-87fa-3cd9bbaf1113 tempest-VolumeDependencyTests-1292197561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:42:59 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-c205e71a-c52c-4a95-87fa-3cd9bbaf1113 tempest-VolumeDependencyTests-1292197561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:42:59 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-c205e71a-c52c-4a95-87fa-3cd9bbaf1113 tempest-VolumeDependencyTests-1292197561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:59 devstack sudo[114612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:42:59 devstack sudo[114612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:59 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-4b6b177c-81ee-443b-8e0d-a71e901d7f9c tempest-VolumeDependencyTests-1292197561 None] Acquiring lock "cinder-fb2459ae-1ff6-4769-aff9-c465635e57c3-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:42:59 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-4b6b177c-81ee-443b-8e0d-a71e901d7f9c tempest-VolumeDependencyTests-1292197561 None] Lock "cinder-fb2459ae-1ff6-4769-aff9-c465635e57c3-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:42:59 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-4b6b177c-81ee-443b-8e0d-a71e901d7f9c tempest-VolumeDependencyTests-1292197561 None] Acquiring lock "cinder-quobyte-fb2459ae-1ff6-4769-aff9-c465635e57c3" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:42:59 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-62e82b49-79e7-4581-bbb3-79574cd86157 tempest-ProjectMemberTests-1774785373 None] Acquiring lock "cinder-52619b5e-951e-4ac5-a07a-0b1524b7dbe3-delete_snapshot" by "delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:42:59 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-4b6b177c-81ee-443b-8e0d-a71e901d7f9c tempest-VolumeDependencyTests-1292197561 None] Lock "cinder-quobyte-fb2459ae-1ff6-4769-aff9-c465635e57c3" acquired by "delete_volume" :: waited 0.039s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:42:59 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-62e82b49-79e7-4581-bbb3-79574cd86157 tempest-ProjectMemberTests-1774785373 None] Lock "cinder-52619b5e-951e-4ac5-a07a-0b1524b7dbe3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.063s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:42:59 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-62e82b49-79e7-4581-bbb3-79574cd86157 tempest-ProjectMemberTests-1774785373 None] Acquiring lock "cinder-quobyte-5c94ddf0-6127-48f1-9ce1-9a5e467936d1" by "delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:42:59 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5c274b3-f06d-40f4-a8ba-c546be835c5b]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:42:59 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4b6b177c-81ee-443b-8e0d-a71e901d7f9c tempest-VolumeDependencyTests-1292197561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-fb2459ae-1ff6-4769-aff9-c465635e57c3 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:59 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-62e82b49-79e7-4581-bbb3-79574cd86157 tempest-ProjectMemberTests-1774785373 None] Lock "cinder-quobyte-5c94ddf0-6127-48f1-9ce1-9a5e467936d1" acquired by "delete_snapshot" :: waited 0.038s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:42:59 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-62e82b49-79e7-4581-bbb3-79574cd86157 tempest-ProjectMemberTests-1774785373 None] Acquiring lock "cinder-quobyte-52619b5e-951e-4ac5-a07a-0b1524b7dbe3" by "_delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:42:59 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-62e82b49-79e7-4581-bbb3-79574cd86157 tempest-ProjectMemberTests-1774785373 None] Lock "cinder-quobyte-52619b5e-951e-4ac5-a07a-0b1524b7dbe3" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:42:59 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-62e82b49-79e7-4581-bbb3-79574cd86157 tempest-ProjectMemberTests-1774785373 None] Deleting offline snapshot 52619b5e-951e-4ac5-a07a-0b1524b7dbe3 of volume 5c94ddf0-6127-48f1-9ce1-9a5e467936d1 {{(pid=94394) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 14:42:59 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-62e82b49-79e7-4581-bbb3-79574cd86157 tempest-ProjectMemberTests-1774785373 None] snapshot_file for this snap is: volume-5c94ddf0-6127-48f1-9ce1-9a5e467936d1.52619b5e-951e-4ac5-a07a-0b1524b7dbe3 {{(pid=94394) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 14:42:59 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf0c58f1-7ecc-4e70-880a-9d6a0897f149]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:42:59 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-62e82b49-79e7-4581-bbb3-79574cd86157 tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5c94ddf0-6127-48f1-9ce1-9a5e467936d1.52619b5e-951e-4ac5-a07a-0b1524b7dbe3 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:59 devstack sudo[114614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-fb2459ae-1ff6-4769-aff9-c465635e57c3 Aug 26 14:42:59 devstack sudo[114614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:59 devstack sudo[114612]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:59 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-c205e71a-c52c-4a95-87fa-3cd9bbaf1113 tempest-VolumeDependencyTests-1292197561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.448s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:59 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-c205e71a-c52c-4a95-87fa-3cd9bbaf1113 tempest-VolumeDependencyTests-1292197561 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:42:59 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-c205e71a-c52c-4a95-87fa-3cd9bbaf1113 tempest-VolumeDependencyTests-1292197561 None] Deleted volume successfully. Aug 26 14:42:59 devstack sudo[114615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5c94ddf0-6127-48f1-9ce1-9a5e467936d1.52619b5e-951e-4ac5-a07a-0b1524b7dbe3 Aug 26 14:42:59 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-c205e71a-c52c-4a95-87fa-3cd9bbaf1113 tempest-VolumeDependencyTests-1292197561 None] Lock "cinder-d96a19c1-6fb6-4808-9b45-6a69e8cd195d-delete_volume" released by "delete_volume" :: held 1.624s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:42:59 devstack sudo[114615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:59 devstack sudo[114614]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:59 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4b6b177c-81ee-443b-8e0d-a71e901d7f9c tempest-VolumeDependencyTests-1292197561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-fb2459ae-1ff6-4769-aff9-c465635e57c3" returned: 0 in 0.476s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:59 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4b6b177c-81ee-443b-8e0d-a71e901d7f9c tempest-VolumeDependencyTests-1292197561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-fb2459ae-1ff6-4769-aff9-c465635e57c3 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:42:59 devstack sudo[114624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-fb2459ae-1ff6-4769-aff9-c465635e57c3 Aug 26 14:42:59 devstack sudo[114624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:42:59 devstack sudo[114615]: pam_unix(sudo:session): session closed for user root Aug 26 14:42:59 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-62e82b49-79e7-4581-bbb3-79574cd86157 tempest-ProjectMemberTests-1774785373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5c94ddf0-6127-48f1-9ce1-9a5e467936d1.52619b5e-951e-4ac5-a07a-0b1524b7dbe3" returned: 0 in 0.517s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:42:59 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-62e82b49-79e7-4581-bbb3-79574cd86157 tempest-ProjectMemberTests-1774785373 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c94ddf0-6127-48f1-9ce1-9a5e467936d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94394) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 14:42:59 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[a612f232-0047-4ea6-a621-5d1b541bc8ea]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:42:59 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-62e82b49-79e7-4581-bbb3-79574cd86157 tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5c94ddf0-6127-48f1-9ce1-9a5e467936d1 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:00 devstack sudo[114628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5c94ddf0-6127-48f1-9ce1-9a5e467936d1 Aug 26 14:43:00 devstack sudo[114628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:00 devstack sudo[114624]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:00 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4b6b177c-81ee-443b-8e0d-a71e901d7f9c tempest-VolumeDependencyTests-1292197561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-fb2459ae-1ff6-4769-aff9-c465635e57c3" returned: 0 in 0.323s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:00 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-4b6b177c-81ee-443b-8e0d-a71e901d7f9c tempest-VolumeDependencyTests-1292197561 None] Lock "cinder-quobyte-fb2459ae-1ff6-4769-aff9-c465635e57c3" released by "delete_volume" :: held 0.873s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:43:00 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-4b6b177c-81ee-443b-8e0d-a71e901d7f9c tempest-VolumeDependencyTests-1292197561 None] Created reservations ['a256b8df-aaa5-41a4-821a-673ce07796b6', '0671bdfb-c244-4150-9f8e-0994d68a20f4', 'baf9384f-2a74-4361-9ab2-61ec8ef6f2a6', 'f454d8b4-a271-411a-b61c-cd166551d0b7'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:43:00 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-4b6b177c-81ee-443b-8e0d-a71e901d7f9c tempest-VolumeDependencyTests-1292197561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:43:00 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-4b6b177c-81ee-443b-8e0d-a71e901d7f9c tempest-VolumeDependencyTests-1292197561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:43:00 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-4b6b177c-81ee-443b-8e0d-a71e901d7f9c tempest-VolumeDependencyTests-1292197561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:43:00 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-4b6b177c-81ee-443b-8e0d-a71e901d7f9c tempest-VolumeDependencyTests-1292197561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:43:00 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-4b6b177c-81ee-443b-8e0d-a71e901d7f9c tempest-VolumeDependencyTests-1292197561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:43:00 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4b6b177c-81ee-443b-8e0d-a71e901d7f9c tempest-VolumeDependencyTests-1292197561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:00 devstack sudo[114633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:43:00 devstack sudo[114633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:00 devstack sudo[114628]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:00 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-62e82b49-79e7-4581-bbb3-79574cd86157 tempest-ProjectMemberTests-1774785373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5c94ddf0-6127-48f1-9ce1-9a5e467936d1" returned: 0 in 0.553s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:00 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-62e82b49-79e7-4581-bbb3-79574cd86157 tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5c94ddf0-6127-48f1-9ce1-9a5e467936d1.52619b5e-951e-4ac5-a07a-0b1524b7dbe3 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:00 devstack sudo[114636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5c94ddf0-6127-48f1-9ce1-9a5e467936d1.52619b5e-951e-4ac5-a07a-0b1524b7dbe3 Aug 26 14:43:00 devstack sudo[114636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:00 devstack sudo[114633]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:00 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4b6b177c-81ee-443b-8e0d-a71e901d7f9c tempest-VolumeDependencyTests-1292197561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.345s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:00 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-4b6b177c-81ee-443b-8e0d-a71e901d7f9c tempest-VolumeDependencyTests-1292197561 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:43:00 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-4b6b177c-81ee-443b-8e0d-a71e901d7f9c tempest-VolumeDependencyTests-1292197561 None] Deleted volume successfully. Aug 26 14:43:00 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-4b6b177c-81ee-443b-8e0d-a71e901d7f9c tempest-VolumeDependencyTests-1292197561 None] Lock "cinder-fb2459ae-1ff6-4769-aff9-c465635e57c3-delete_volume" released by "delete_volume" :: held 1.583s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:43:00 devstack sudo[114636]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:01 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-62e82b49-79e7-4581-bbb3-79574cd86157 tempest-ProjectMemberTests-1774785373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5c94ddf0-6127-48f1-9ce1-9a5e467936d1.52619b5e-951e-4ac5-a07a-0b1524b7dbe3" returned: 0 in 0.480s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:01 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-62e82b49-79e7-4581-bbb3-79574cd86157 tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5c94ddf0-6127-48f1-9ce1-9a5e467936d1.52619b5e-951e-4ac5-a07a-0b1524b7dbe3 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:01 devstack sudo[114644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5c94ddf0-6127-48f1-9ce1-9a5e467936d1.52619b5e-951e-4ac5-a07a-0b1524b7dbe3 Aug 26 14:43:01 devstack sudo[114644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:01 devstack sudo[114644]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:01 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-62e82b49-79e7-4581-bbb3-79574cd86157 tempest-ProjectMemberTests-1774785373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5c94ddf0-6127-48f1-9ce1-9a5e467936d1.52619b5e-951e-4ac5-a07a-0b1524b7dbe3" returned: 0 in 0.308s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:01 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-62e82b49-79e7-4581-bbb3-79574cd86157 tempest-ProjectMemberTests-1774785373 None] Lock "cinder-quobyte-52619b5e-951e-4ac5-a07a-0b1524b7dbe3" released by "_delete_snapshot" :: held 2.001s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:43:01 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-62e82b49-79e7-4581-bbb3-79574cd86157 tempest-ProjectMemberTests-1774785373 None] Lock "cinder-quobyte-5c94ddf0-6127-48f1-9ce1-9a5e467936d1" released by "delete_snapshot" :: held 2.033s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:43:01 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-62e82b49-79e7-4581-bbb3-79574cd86157 tempest-ProjectMemberTests-1774785373 None] Created reservations ['8643fc60-11ac-4eba-8d53-b8964989d177', '3bb70d21-640f-436f-8dea-6619a0cd8ebc', '5c3c6927-a501-4204-a179-cdacb91447cb', '5cbe8313-331f-4d85-90dc-d5b1f19382c1'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:43:01 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-62e82b49-79e7-4581-bbb3-79574cd86157 tempest-ProjectMemberTests-1774785373 None] Delete snapshot completed successfully. Aug 26 14:43:01 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-62e82b49-79e7-4581-bbb3-79574cd86157 tempest-ProjectMemberTests-1774785373 None] Lock "cinder-52619b5e-951e-4ac5-a07a-0b1524b7dbe3-delete_snapshot" released by "delete_snapshot" :: held 2.282s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:43:02 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-67c54db1-906a-446b-b6d6-9742f00e10fc tempest-ProjectMemberTests-1774785373 None] Acquiring lock "cinder-5c94ddf0-6127-48f1-9ce1-9a5e467936d1-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:43:02 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-67c54db1-906a-446b-b6d6-9742f00e10fc tempest-ProjectMemberTests-1774785373 None] Lock "cinder-5c94ddf0-6127-48f1-9ce1-9a5e467936d1-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:43:02 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-67c54db1-906a-446b-b6d6-9742f00e10fc tempest-ProjectMemberTests-1774785373 None] Acquiring lock "cinder-quobyte-5c94ddf0-6127-48f1-9ce1-9a5e467936d1" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:43:02 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-67c54db1-906a-446b-b6d6-9742f00e10fc tempest-ProjectMemberTests-1774785373 None] Lock "cinder-quobyte-5c94ddf0-6127-48f1-9ce1-9a5e467936d1" acquired by "delete_volume" :: waited 0.022s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:43:02 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[59704c56-33cb-4216-b9ad-d6872ba63130]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:43:02 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-67c54db1-906a-446b-b6d6-9742f00e10fc tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5c94ddf0-6127-48f1-9ce1-9a5e467936d1 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:02 devstack sudo[114647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5c94ddf0-6127-48f1-9ce1-9a5e467936d1 Aug 26 14:43:02 devstack sudo[114647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:03 devstack sudo[114647]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:03 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-67c54db1-906a-446b-b6d6-9742f00e10fc tempest-ProjectMemberTests-1774785373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5c94ddf0-6127-48f1-9ce1-9a5e467936d1" returned: 0 in 0.567s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:03 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-67c54db1-906a-446b-b6d6-9742f00e10fc tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5c94ddf0-6127-48f1-9ce1-9a5e467936d1 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:03 devstack sudo[114652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5c94ddf0-6127-48f1-9ce1-9a5e467936d1 Aug 26 14:43:03 devstack sudo[114652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:03 devstack sudo[114652]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:03 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-67c54db1-906a-446b-b6d6-9742f00e10fc tempest-ProjectMemberTests-1774785373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5c94ddf0-6127-48f1-9ce1-9a5e467936d1" returned: 0 in 0.353s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:03 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-67c54db1-906a-446b-b6d6-9742f00e10fc tempest-ProjectMemberTests-1774785373 None] Lock "cinder-quobyte-5c94ddf0-6127-48f1-9ce1-9a5e467936d1" released by "delete_volume" :: held 1.014s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:43:03 devstack cinder-volume[94394]: DEBUG dbcounter [-] [94394] Writing DB stats cinder:SELECT=217,cinder:UPDATE=293,cinder:INSERT=88,cinder:DELETE=22 {{(pid=94394) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 14:43:03 devstack cinder-volume[94394]: DEBUG dbcounter [-] [94394] Writing DB stats cinder:UPDATE=318,cinder:SELECT=241,cinder:INSERT=77,cinder:DELETE=32 {{(pid=94394) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 14:43:03 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-67c54db1-906a-446b-b6d6-9742f00e10fc tempest-ProjectMemberTests-1774785373 None] Created reservations ['eb448c77-27bb-4e1a-a90a-29d27e0424cc', '9480cb09-ff90-473d-b26b-256a5d1d3de8', 'd4cd358e-6b8d-43c0-a920-6969ecfaec12', '72d3cea1-47ae-454d-847d-0088e58f7d0f'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:43:03 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-67c54db1-906a-446b-b6d6-9742f00e10fc tempest-ProjectMemberTests-1774785373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:43:03 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-67c54db1-906a-446b-b6d6-9742f00e10fc tempest-ProjectMemberTests-1774785373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:43:03 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-67c54db1-906a-446b-b6d6-9742f00e10fc tempest-ProjectMemberTests-1774785373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:43:03 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-67c54db1-906a-446b-b6d6-9742f00e10fc tempest-ProjectMemberTests-1774785373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:43:03 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-67c54db1-906a-446b-b6d6-9742f00e10fc tempest-ProjectMemberTests-1774785373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:43:03 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-67c54db1-906a-446b-b6d6-9742f00e10fc tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:03 devstack sudo[114655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:43:03 devstack sudo[114655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:04 devstack sudo[114655]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:04 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-67c54db1-906a-446b-b6d6-9742f00e10fc tempest-ProjectMemberTests-1774785373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.302s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:04 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-67c54db1-906a-446b-b6d6-9742f00e10fc tempest-ProjectMemberTests-1774785373 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:43:04 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-67c54db1-906a-446b-b6d6-9742f00e10fc tempest-ProjectMemberTests-1774785373 None] Deleted volume successfully. Aug 26 14:43:04 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-67c54db1-906a-446b-b6d6-9742f00e10fc tempest-ProjectMemberTests-1774785373 None] Lock "cinder-5c94ddf0-6127-48f1-9ce1-9a5e467936d1-delete_volume" released by "delete_volume" :: held 1.660s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:43:05 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd7c87a6-0652-46d8-91be-a0ec7c7b84c6 tempest-ProjectMemberTests-1774785373 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:43:05 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-cd7c87a6-0652-46d8-91be-a0ec7c7b84c6 tempest-ProjectMemberTests-1774785373 None] Flow 'volume_create_manager' (f7499284-3c37-4fc6-8e54-7a70e31e9872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:43:05 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-cd7c87a6-0652-46d8-91be-a0ec7c7b84c6 tempest-ProjectMemberTests-1774785373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (339dc5f8-c799-41a7-a57e-6599832aeee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:43:05 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-cd7c87a6-0652-46d8-91be-a0ec7c7b84c6 tempest-ProjectMemberTests-1774785373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (339dc5f8-c799-41a7-a57e-6599832aeee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:43:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-368849994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae4b5b93-37a6-458a-94ca-235010373406,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8dd248190cb40cebc9daf2b89f48fd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:43:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:43:05Z,use_quota=True,user_id='ad0617c386b6460d8f790d85646880e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:43:05 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-cd7c87a6-0652-46d8-91be-a0ec7c7b84c6 tempest-ProjectMemberTests-1774785373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (601e235a-c253-4427-940d-34279138da37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:43:05 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-cd7c87a6-0652-46d8-91be-a0ec7c7b84c6 tempest-ProjectMemberTests-1774785373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (601e235a-c253-4427-940d-34279138da37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:43:05 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-cd7c87a6-0652-46d8-91be-a0ec7c7b84c6 tempest-ProjectMemberTests-1774785373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ad69ce0-66f7-4023-af74-43840fcc0854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:43:05 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-cd7c87a6-0652-46d8-91be-a0ec7c7b84c6 tempest-ProjectMemberTests-1774785373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ad69ce0-66f7-4023-af74-43840fcc0854) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae4b5b93-37a6-458a-94ca-235010373406', 'volume_name': 'volume-ae4b5b93-37a6-458a-94ca-235010373406', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:43:05 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-cd7c87a6-0652-46d8-91be-a0ec7c7b84c6 tempest-ProjectMemberTests-1774785373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6caeda7-8203-4531-8ed9-8b7c5107e002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:43:05 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-cd7c87a6-0652-46d8-91be-a0ec7c7b84c6 tempest-ProjectMemberTests-1774785373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6caeda7-8203-4531-8ed9-8b7c5107e002) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:43:05 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-cd7c87a6-0652-46d8-91be-a0ec7c7b84c6 tempest-ProjectMemberTests-1774785373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d400460e-fca4-44ac-9ad8-05700a4eb6ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:43:05 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-cd7c87a6-0652-46d8-91be-a0ec7c7b84c6 tempest-ProjectMemberTests-1774785373 None] Volume ae4b5b93-37a6-458a-94ca-235010373406: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae4b5b93-37a6-458a-94ca-235010373406', 'volume_size': 1} Aug 26 14:43:05 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-cd7c87a6-0652-46d8-91be-a0ec7c7b84c6 tempest-ProjectMemberTests-1774785373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:43:05 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-cd7c87a6-0652-46d8-91be-a0ec7c7b84c6 tempest-ProjectMemberTests-1774785373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:43:05 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-cd7c87a6-0652-46d8-91be-a0ec7c7b84c6 tempest-ProjectMemberTests-1774785373 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:43:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-368849994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae4b5b93-37a6-458a-94ca-235010373406,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8dd248190cb40cebc9daf2b89f48fd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:43:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:43:05Z,use_quota=True,user_id='ad0617c386b6460d8f790d85646880e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:43:05 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-cd7c87a6-0652-46d8-91be-a0ec7c7b84c6 tempest-ProjectMemberTests-1774785373 None] Creating volume ae4b5b93-37a6-458a-94ca-235010373406 {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:43:05 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-cd7c87a6-0652-46d8-91be-a0ec7c7b84c6 tempest-ProjectMemberTests-1774785373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:43:05 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-cd7c87a6-0652-46d8-91be-a0ec7c7b84c6 tempest-ProjectMemberTests-1774785373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:43:05 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-cd7c87a6-0652-46d8-91be-a0ec7c7b84c6 tempest-ProjectMemberTests-1774785373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:43:05 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-cd7c87a6-0652-46d8-91be-a0ec7c7b84c6 tempest-ProjectMemberTests-1774785373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:43:05 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-cd7c87a6-0652-46d8-91be-a0ec7c7b84c6 tempest-ProjectMemberTests-1774785373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:43:05 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-cd7c87a6-0652-46d8-91be-a0ec7c7b84c6 tempest-ProjectMemberTests-1774785373 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:43:05 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-cd7c87a6-0652-46d8-91be-a0ec7c7b84c6 tempest-ProjectMemberTests-1774785373 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:43:05 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-cd7c87a6-0652-46d8-91be-a0ec7c7b84c6 tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ae4b5b93-37a6-458a-94ca-235010373406 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:05 devstack sudo[114658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ae4b5b93-37a6-458a-94ca-235010373406 1073741824 Aug 26 14:43:05 devstack sudo[114658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:06 devstack sudo[114658]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:06 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-cd7c87a6-0652-46d8-91be-a0ec7c7b84c6 tempest-ProjectMemberTests-1774785373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ae4b5b93-37a6-458a-94ca-235010373406 1073741824" returned: 0 in 0.532s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:06 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-cd7c87a6-0652-46d8-91be-a0ec7c7b84c6 tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ae4b5b93-37a6-458a-94ca-235010373406 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:06 devstack sudo[114664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ae4b5b93-37a6-458a-94ca-235010373406 Aug 26 14:43:06 devstack sudo[114664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:06 devstack sudo[114664]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:06 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-cd7c87a6-0652-46d8-91be-a0ec7c7b84c6 tempest-ProjectMemberTests-1774785373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ae4b5b93-37a6-458a-94ca-235010373406" returned: 0 in 0.316s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:06 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-cd7c87a6-0652-46d8-91be-a0ec7c7b84c6 tempest-ProjectMemberTests-1774785373 None] <== create_volume: return (912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:43:06 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-cd7c87a6-0652-46d8-91be-a0ec7c7b84c6 tempest-ProjectMemberTests-1774785373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.924s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:43:06 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-cd7c87a6-0652-46d8-91be-a0ec7c7b84c6 tempest-ProjectMemberTests-1774785373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d400460e-fca4-44ac-9ad8-05700a4eb6ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae4b5b93-37a6-458a-94ca-235010373406', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:43:06 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-cd7c87a6-0652-46d8-91be-a0ec7c7b84c6 tempest-ProjectMemberTests-1774785373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51277bf9-7fc2-491e-bb05-d04854694a39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:43:06 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-cd7c87a6-0652-46d8-91be-a0ec7c7b84c6 tempest-ProjectMemberTests-1774785373 None] Volume volume-ae4b5b93-37a6-458a-94ca-235010373406 (ae4b5b93-37a6-458a-94ca-235010373406): created successfully Aug 26 14:43:06 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-cd7c87a6-0652-46d8-91be-a0ec7c7b84c6 tempest-ProjectMemberTests-1774785373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51277bf9-7fc2-491e-bb05-d04854694a39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:43:06 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-cd7c87a6-0652-46d8-91be-a0ec7c7b84c6 tempest-ProjectMemberTests-1774785373 None] Flow 'volume_create_manager' (f7499284-3c37-4fc6-8e54-7a70e31e9872) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:43:06 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-cd7c87a6-0652-46d8-91be-a0ec7c7b84c6 tempest-ProjectMemberTests-1774785373 None] Created volume successfully. Aug 26 14:43:07 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-22cd01de-0601-4257-85f7-11fa1ecb3754 tempest-ProjectMemberTests-1774785373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:43:07 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-22cd01de-0601-4257-85f7-11fa1ecb3754 tempest-ProjectMemberTests-1774785373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:43:07 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-22cd01de-0601-4257-85f7-11fa1ecb3754 tempest-ProjectMemberTests-1774785373 None] Creating offline snapshot 8f7d2e04-1d27-4844-a5b4-3afaf65371a6 of volume ae4b5b93-37a6-458a-94ca-235010373406 {{(pid=94394) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 14:43:07 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bb38983-375c-461a-816d-52d1daea81a2]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:43:07 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-22cd01de-0601-4257-85f7-11fa1ecb3754 tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ae4b5b93-37a6-458a-94ca-235010373406 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:07 devstack sudo[114667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ae4b5b93-37a6-458a-94ca-235010373406 Aug 26 14:43:07 devstack sudo[114667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:08 devstack sudo[114667]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:08 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-22cd01de-0601-4257-85f7-11fa1ecb3754 tempest-ProjectMemberTests-1774785373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ae4b5b93-37a6-458a-94ca-235010373406" returned: 0 in 0.403s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:08 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-22cd01de-0601-4257-85f7-11fa1ecb3754 tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ae4b5b93-37a6-458a-94ca-235010373406,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ae4b5b93-37a6-458a-94ca-235010373406.8f7d2e04-1d27-4844-a5b4-3afaf65371a6 1G {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:08 devstack sudo[114672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ae4b5b93-37a6-458a-94ca-235010373406,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ae4b5b93-37a6-458a-94ca-235010373406.8f7d2e04-1d27-4844-a5b4-3afaf65371a6 1G Aug 26 14:43:08 devstack sudo[114672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:08 devstack sudo[114672]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:08 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-22cd01de-0601-4257-85f7-11fa1ecb3754 tempest-ProjectMemberTests-1774785373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ae4b5b93-37a6-458a-94ca-235010373406,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ae4b5b93-37a6-458a-94ca-235010373406.8f7d2e04-1d27-4844-a5b4-3afaf65371a6 1G" returned: 0 in 0.583s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:08 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-22cd01de-0601-4257-85f7-11fa1ecb3754 tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae4b5b93-37a6-458a-94ca-235010373406 -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ae4b5b93-37a6-458a-94ca-235010373406.8f7d2e04-1d27-4844-a5b4-3afaf65371a6 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:08 devstack sudo[114678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae4b5b93-37a6-458a-94ca-235010373406 -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ae4b5b93-37a6-458a-94ca-235010373406.8f7d2e04-1d27-4844-a5b4-3afaf65371a6 Aug 26 14:43:08 devstack sudo[114678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:09 devstack sudo[114678]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:09 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-22cd01de-0601-4257-85f7-11fa1ecb3754 tempest-ProjectMemberTests-1774785373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae4b5b93-37a6-458a-94ca-235010373406 -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ae4b5b93-37a6-458a-94ca-235010373406.8f7d2e04-1d27-4844-a5b4-3afaf65371a6" returned: 0 in 0.400s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:09 devstack cinder-volume[94394]: WARNING cinder.volume.drivers.remotefs [None req-22cd01de-0601-4257-85f7-11fa1ecb3754 tempest-ProjectMemberTests-1774785373 None] /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ae4b5b93-37a6-458a-94ca-235010373406.8f7d2e04-1d27-4844-a5b4-3afaf65371a6 is being set with open permissions: ugo+rw Aug 26 14:43:09 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-22cd01de-0601-4257-85f7-11fa1ecb3754 tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ae4b5b93-37a6-458a-94ca-235010373406.8f7d2e04-1d27-4844-a5b4-3afaf65371a6 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:09 devstack sudo[114684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ae4b5b93-37a6-458a-94ca-235010373406.8f7d2e04-1d27-4844-a5b4-3afaf65371a6 Aug 26 14:43:09 devstack sudo[114684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:09 devstack sudo[114684]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:09 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-22cd01de-0601-4257-85f7-11fa1ecb3754 tempest-ProjectMemberTests-1774785373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ae4b5b93-37a6-458a-94ca-235010373406.8f7d2e04-1d27-4844-a5b4-3afaf65371a6" returned: 0 in 0.306s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:09 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-22cd01de-0601-4257-85f7-11fa1ecb3754 tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ae4b5b93-37a6-458a-94ca-235010373406.info {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:09 devstack sudo[114687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ae4b5b93-37a6-458a-94ca-235010373406.info Aug 26 14:43:09 devstack sudo[114687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:09 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0584daf-d947-470e-a3bc-2157ff968200 tempest-SnapshotDependencyTests-1763346707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:43:09 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-d0584daf-d947-470e-a3bc-2157ff968200 tempest-SnapshotDependencyTests-1763346707 None] Flow 'volume_create_manager' (4994c969-9d7d-418a-9271-9e4ff5b64367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:43:09 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-d0584daf-d947-470e-a3bc-2157ff968200 tempest-SnapshotDependencyTests-1763346707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26add831-fab6-44c7-9367-c85eece0a756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:43:09 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-d0584daf-d947-470e-a3bc-2157ff968200 tempest-SnapshotDependencyTests-1763346707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26add831-fab6-44c7-9367-c85eece0a756) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:43:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-412992462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b46cb88f-ab5a-4681-a203-ce75f06bbd58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8ad4d5ed98841b0a5cf9944f36b88d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:43:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:43:10Z,use_quota=True,user_id='cc50a370ea2f4305bd5e0e9f77600162',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:43:09 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-d0584daf-d947-470e-a3bc-2157ff968200 tempest-SnapshotDependencyTests-1763346707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02317911-2737-41a4-b85a-635cdeb34edc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:43:09 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-d0584daf-d947-470e-a3bc-2157ff968200 tempest-SnapshotDependencyTests-1763346707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02317911-2737-41a4-b85a-635cdeb34edc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:43:09 devstack sudo[114687]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:09 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-d0584daf-d947-470e-a3bc-2157ff968200 tempest-SnapshotDependencyTests-1763346707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dceb2b3-00ed-41ba-a556-eb9791418d85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:43:09 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-d0584daf-d947-470e-a3bc-2157ff968200 tempest-SnapshotDependencyTests-1763346707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dceb2b3-00ed-41ba-a556-eb9791418d85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b46cb88f-ab5a-4681-a203-ce75f06bbd58', 'volume_name': 'volume-b46cb88f-ab5a-4681-a203-ce75f06bbd58', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:43:09 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-d0584daf-d947-470e-a3bc-2157ff968200 tempest-SnapshotDependencyTests-1763346707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (220f6a27-643b-494f-bbdf-e4aec695e00e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:43:09 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-d0584daf-d947-470e-a3bc-2157ff968200 tempest-SnapshotDependencyTests-1763346707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (220f6a27-643b-494f-bbdf-e4aec695e00e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:43:09 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-d0584daf-d947-470e-a3bc-2157ff968200 tempest-SnapshotDependencyTests-1763346707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86aa2ef6-b1d9-4320-bc4b-ed2c862364dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:43:09 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-d0584daf-d947-470e-a3bc-2157ff968200 tempest-SnapshotDependencyTests-1763346707 None] Volume b46cb88f-ab5a-4681-a203-ce75f06bbd58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b46cb88f-ab5a-4681-a203-ce75f06bbd58', 'volume_size': 1} Aug 26 14:43:09 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-d0584daf-d947-470e-a3bc-2157ff968200 tempest-SnapshotDependencyTests-1763346707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:43:09 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-22cd01de-0601-4257-85f7-11fa1ecb3754 tempest-ProjectMemberTests-1774785373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ae4b5b93-37a6-458a-94ca-235010373406.info" returned: 0 in 0.332s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:09 devstack cinder-volume[94394]: WARNING cinder.volume.drivers.remotefs [None req-22cd01de-0601-4257-85f7-11fa1ecb3754 tempest-ProjectMemberTests-1774785373 None] /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ae4b5b93-37a6-458a-94ca-235010373406.info is being set with open permissions: ugo+rw Aug 26 14:43:09 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-22cd01de-0601-4257-85f7-11fa1ecb3754 tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ae4b5b93-37a6-458a-94ca-235010373406.info {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:09 devstack sudo[114690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ae4b5b93-37a6-458a-94ca-235010373406.info Aug 26 14:43:09 devstack sudo[114690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:10 devstack sudo[114690]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:10 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-22cd01de-0601-4257-85f7-11fa1ecb3754 tempest-ProjectMemberTests-1774785373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ae4b5b93-37a6-458a-94ca-235010373406.info" returned: 0 in 0.259s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:10 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-22cd01de-0601-4257-85f7-11fa1ecb3754 tempest-ProjectMemberTests-1774785373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.408s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:43:10 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-d0584daf-d947-470e-a3bc-2157ff968200 tempest-SnapshotDependencyTests-1763346707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.286s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:43:10 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-d0584daf-d947-470e-a3bc-2157ff968200 tempest-SnapshotDependencyTests-1763346707 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:43:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-412992462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b46cb88f-ab5a-4681-a203-ce75f06bbd58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8ad4d5ed98841b0a5cf9944f36b88d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:43:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:43:10Z,use_quota=True,user_id='cc50a370ea2f4305bd5e0e9f77600162',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:43:10 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-d0584daf-d947-470e-a3bc-2157ff968200 tempest-SnapshotDependencyTests-1763346707 None] Creating volume b46cb88f-ab5a-4681-a203-ce75f06bbd58 {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:43:10 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-d0584daf-d947-470e-a3bc-2157ff968200 tempest-SnapshotDependencyTests-1763346707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:43:10 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-d0584daf-d947-470e-a3bc-2157ff968200 tempest-SnapshotDependencyTests-1763346707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:43:10 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-d0584daf-d947-470e-a3bc-2157ff968200 tempest-SnapshotDependencyTests-1763346707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:43:10 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-d0584daf-d947-470e-a3bc-2157ff968200 tempest-SnapshotDependencyTests-1763346707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:43:10 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-d0584daf-d947-470e-a3bc-2157ff968200 tempest-SnapshotDependencyTests-1763346707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:43:10 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-d0584daf-d947-470e-a3bc-2157ff968200 tempest-SnapshotDependencyTests-1763346707 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:43:10 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-d0584daf-d947-470e-a3bc-2157ff968200 tempest-SnapshotDependencyTests-1763346707 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:43:10 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-d0584daf-d947-470e-a3bc-2157ff968200 tempest-SnapshotDependencyTests-1763346707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b46cb88f-ab5a-4681-a203-ce75f06bbd58 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:10 devstack sudo[114693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b46cb88f-ab5a-4681-a203-ce75f06bbd58 1073741824 Aug 26 14:43:10 devstack sudo[114693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:10 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-22cd01de-0601-4257-85f7-11fa1ecb3754 tempest-ProjectMemberTests-1774785373 None] Create snapshot completed successfully Aug 26 14:43:10 devstack sudo[114693]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:10 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-d0584daf-d947-470e-a3bc-2157ff968200 tempest-SnapshotDependencyTests-1763346707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b46cb88f-ab5a-4681-a203-ce75f06bbd58 1073741824" returned: 0 in 0.446s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:10 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-d0584daf-d947-470e-a3bc-2157ff968200 tempest-SnapshotDependencyTests-1763346707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b46cb88f-ab5a-4681-a203-ce75f06bbd58 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:10 devstack sudo[114700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b46cb88f-ab5a-4681-a203-ce75f06bbd58 Aug 26 14:43:10 devstack sudo[114700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:10 devstack sudo[114700]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:10 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-d0584daf-d947-470e-a3bc-2157ff968200 tempest-SnapshotDependencyTests-1763346707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b46cb88f-ab5a-4681-a203-ce75f06bbd58" returned: 0 in 0.277s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:10 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-d0584daf-d947-470e-a3bc-2157ff968200 tempest-SnapshotDependencyTests-1763346707 None] <== create_volume: return (765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:43:10 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-d0584daf-d947-470e-a3bc-2157ff968200 tempest-SnapshotDependencyTests-1763346707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.768s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:43:10 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-d0584daf-d947-470e-a3bc-2157ff968200 tempest-SnapshotDependencyTests-1763346707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86aa2ef6-b1d9-4320-bc4b-ed2c862364dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b46cb88f-ab5a-4681-a203-ce75f06bbd58', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:43:10 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-d0584daf-d947-470e-a3bc-2157ff968200 tempest-SnapshotDependencyTests-1763346707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0299619-4a6b-403a-a2f2-c406f79dcd8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:43:10 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-d0584daf-d947-470e-a3bc-2157ff968200 tempest-SnapshotDependencyTests-1763346707 None] Volume volume-b46cb88f-ab5a-4681-a203-ce75f06bbd58 (b46cb88f-ab5a-4681-a203-ce75f06bbd58): created successfully Aug 26 14:43:10 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-d0584daf-d947-470e-a3bc-2157ff968200 tempest-SnapshotDependencyTests-1763346707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0299619-4a6b-403a-a2f2-c406f79dcd8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:43:10 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-d0584daf-d947-470e-a3bc-2157ff968200 tempest-SnapshotDependencyTests-1763346707 None] Flow 'volume_create_manager' (4994c969-9d7d-418a-9271-9e4ff5b64367) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:43:10 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-931c6f76-c5a4-401c-85ec-265f0099c00e tempest-ProjectMemberTests-1774785373 None] Acquiring lock "cinder-8f7d2e04-1d27-4844-a5b4-3afaf65371a6-delete_snapshot" by "delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:43:10 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-d0584daf-d947-470e-a3bc-2157ff968200 tempest-SnapshotDependencyTests-1763346707 None] Created volume successfully. Aug 26 14:43:11 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-931c6f76-c5a4-401c-85ec-265f0099c00e tempest-ProjectMemberTests-1774785373 None] Lock "cinder-8f7d2e04-1d27-4844-a5b4-3afaf65371a6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:43:11 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-931c6f76-c5a4-401c-85ec-265f0099c00e tempest-ProjectMemberTests-1774785373 None] Acquiring lock "cinder-quobyte-ae4b5b93-37a6-458a-94ca-235010373406" by "delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:43:11 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-931c6f76-c5a4-401c-85ec-265f0099c00e tempest-ProjectMemberTests-1774785373 None] Lock "cinder-quobyte-ae4b5b93-37a6-458a-94ca-235010373406" acquired by "delete_snapshot" :: waited 0.028s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:43:11 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-931c6f76-c5a4-401c-85ec-265f0099c00e tempest-ProjectMemberTests-1774785373 None] Acquiring lock "cinder-quobyte-8f7d2e04-1d27-4844-a5b4-3afaf65371a6" by "_delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:43:11 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-931c6f76-c5a4-401c-85ec-265f0099c00e tempest-ProjectMemberTests-1774785373 None] Lock "cinder-quobyte-8f7d2e04-1d27-4844-a5b4-3afaf65371a6" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:43:11 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-931c6f76-c5a4-401c-85ec-265f0099c00e tempest-ProjectMemberTests-1774785373 None] Deleting offline snapshot 8f7d2e04-1d27-4844-a5b4-3afaf65371a6 of volume ae4b5b93-37a6-458a-94ca-235010373406 {{(pid=94394) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 14:43:11 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-931c6f76-c5a4-401c-85ec-265f0099c00e tempest-ProjectMemberTests-1774785373 None] snapshot_file for this snap is: volume-ae4b5b93-37a6-458a-94ca-235010373406.8f7d2e04-1d27-4844-a5b4-3afaf65371a6 {{(pid=94394) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 14:43:11 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ac14ac0-526d-4be7-a662-b9bd29f454eb tempest-ProjectReaderTests-1882876355 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:43:11 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-3ac14ac0-526d-4be7-a662-b9bd29f454eb tempest-ProjectReaderTests-1882876355 None] Flow 'volume_create_manager' (19e5e74b-a2d6-4ae2-a0be-8cfdc4bc2079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:43:11 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-3ac14ac0-526d-4be7-a662-b9bd29f454eb tempest-ProjectReaderTests-1882876355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c578621c-e96a-4e60-9bdb-c712e0755e8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:43:11 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[13ff565e-2190-490d-9ab6-ae035f3e4c12]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:43:11 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-931c6f76-c5a4-401c-85ec-265f0099c00e tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ae4b5b93-37a6-458a-94ca-235010373406.8f7d2e04-1d27-4844-a5b4-3afaf65371a6 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:11 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-3ac14ac0-526d-4be7-a662-b9bd29f454eb tempest-ProjectReaderTests-1882876355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c578621c-e96a-4e60-9bdb-c712e0755e8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:43:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1263074686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26639f24-eac2-4f8d-83a6-a6ca133b7059,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57364cca92024529a3a58d2a3e634ba3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:43:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:43:11Z,use_quota=True,user_id='23a9f0a2e5524f5485f0d17c6acdc640',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:43:11 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-3ac14ac0-526d-4be7-a662-b9bd29f454eb tempest-ProjectReaderTests-1882876355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a4cf596-a079-4592-9cac-0f9f2a907d18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:43:11 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-3ac14ac0-526d-4be7-a662-b9bd29f454eb tempest-ProjectReaderTests-1882876355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a4cf596-a079-4592-9cac-0f9f2a907d18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:43:11 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-3ac14ac0-526d-4be7-a662-b9bd29f454eb tempest-ProjectReaderTests-1882876355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b501cd0e-e08f-422c-85e5-9355a54271f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:43:11 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-3ac14ac0-526d-4be7-a662-b9bd29f454eb tempest-ProjectReaderTests-1882876355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b501cd0e-e08f-422c-85e5-9355a54271f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26639f24-eac2-4f8d-83a6-a6ca133b7059', 'volume_name': 'volume-26639f24-eac2-4f8d-83a6-a6ca133b7059', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:43:11 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-3ac14ac0-526d-4be7-a662-b9bd29f454eb tempest-ProjectReaderTests-1882876355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75628204-1df8-4732-aa45-32b1645751ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:43:11 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-3ac14ac0-526d-4be7-a662-b9bd29f454eb tempest-ProjectReaderTests-1882876355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75628204-1df8-4732-aa45-32b1645751ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:43:11 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-3ac14ac0-526d-4be7-a662-b9bd29f454eb tempest-ProjectReaderTests-1882876355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9282b24e-809d-4324-9aab-b5e23794c2c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:43:11 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-3ac14ac0-526d-4be7-a662-b9bd29f454eb tempest-ProjectReaderTests-1882876355 None] Volume 26639f24-eac2-4f8d-83a6-a6ca133b7059: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26639f24-eac2-4f8d-83a6-a6ca133b7059', 'volume_size': 1} Aug 26 14:43:11 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-3ac14ac0-526d-4be7-a662-b9bd29f454eb tempest-ProjectReaderTests-1882876355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:43:11 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-3ac14ac0-526d-4be7-a662-b9bd29f454eb tempest-ProjectReaderTests-1882876355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:43:11 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-3ac14ac0-526d-4be7-a662-b9bd29f454eb tempest-ProjectReaderTests-1882876355 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:43:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1263074686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26639f24-eac2-4f8d-83a6-a6ca133b7059,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57364cca92024529a3a58d2a3e634ba3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:43:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:43:11Z,use_quota=True,user_id='23a9f0a2e5524f5485f0d17c6acdc640',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:43:11 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-3ac14ac0-526d-4be7-a662-b9bd29f454eb tempest-ProjectReaderTests-1882876355 None] Creating volume 26639f24-eac2-4f8d-83a6-a6ca133b7059 {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:43:11 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-3ac14ac0-526d-4be7-a662-b9bd29f454eb tempest-ProjectReaderTests-1882876355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:43:11 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-3ac14ac0-526d-4be7-a662-b9bd29f454eb tempest-ProjectReaderTests-1882876355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:43:11 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-3ac14ac0-526d-4be7-a662-b9bd29f454eb tempest-ProjectReaderTests-1882876355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:43:11 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-3ac14ac0-526d-4be7-a662-b9bd29f454eb tempest-ProjectReaderTests-1882876355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:43:11 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-3ac14ac0-526d-4be7-a662-b9bd29f454eb tempest-ProjectReaderTests-1882876355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:43:11 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-3ac14ac0-526d-4be7-a662-b9bd29f454eb tempest-ProjectReaderTests-1882876355 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:43:11 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-3ac14ac0-526d-4be7-a662-b9bd29f454eb tempest-ProjectReaderTests-1882876355 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:43:11 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-3ac14ac0-526d-4be7-a662-b9bd29f454eb tempest-ProjectReaderTests-1882876355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-26639f24-eac2-4f8d-83a6-a6ca133b7059 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:11 devstack sudo[114704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-26639f24-eac2-4f8d-83a6-a6ca133b7059 1073741824 Aug 26 14:43:11 devstack sudo[114704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:11 devstack sudo[114703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ae4b5b93-37a6-458a-94ca-235010373406.8f7d2e04-1d27-4844-a5b4-3afaf65371a6 Aug 26 14:43:11 devstack sudo[114703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:11 devstack sudo[114703]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:11 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-931c6f76-c5a4-401c-85ec-265f0099c00e tempest-ProjectMemberTests-1774785373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ae4b5b93-37a6-458a-94ca-235010373406.8f7d2e04-1d27-4844-a5b4-3afaf65371a6" returned: 0 in 0.361s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:11 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-931c6f76-c5a4-401c-85ec-265f0099c00e tempest-ProjectMemberTests-1774785373 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ae4b5b93-37a6-458a-94ca-235010373406(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94394) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 14:43:11 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f37af2f-88b8-4d9b-a898-c2f5cfdc4e7a]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:43:11 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-931c6f76-c5a4-401c-85ec-265f0099c00e tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ae4b5b93-37a6-458a-94ca-235010373406 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:11 devstack sudo[114704]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:11 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-3ac14ac0-526d-4be7-a662-b9bd29f454eb tempest-ProjectReaderTests-1882876355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-26639f24-eac2-4f8d-83a6-a6ca133b7059 1073741824" returned: 0 in 0.424s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:11 devstack sudo[114715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ae4b5b93-37a6-458a-94ca-235010373406 Aug 26 14:43:11 devstack sudo[114715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:11 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-3ac14ac0-526d-4be7-a662-b9bd29f454eb tempest-ProjectReaderTests-1882876355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-26639f24-eac2-4f8d-83a6-a6ca133b7059 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:11 devstack sudo[114717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-26639f24-eac2-4f8d-83a6-a6ca133b7059 Aug 26 14:43:11 devstack sudo[114717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:11 devstack sudo[114715]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:11 devstack sudo[114717]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:11 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-931c6f76-c5a4-401c-85ec-265f0099c00e tempest-ProjectMemberTests-1774785373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ae4b5b93-37a6-458a-94ca-235010373406" returned: 0 in 0.405s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:11 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-931c6f76-c5a4-401c-85ec-265f0099c00e tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ae4b5b93-37a6-458a-94ca-235010373406.8f7d2e04-1d27-4844-a5b4-3afaf65371a6 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:11 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-3ac14ac0-526d-4be7-a662-b9bd29f454eb tempest-ProjectReaderTests-1882876355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-26639f24-eac2-4f8d-83a6-a6ca133b7059" returned: 0 in 0.276s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:11 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-3ac14ac0-526d-4be7-a662-b9bd29f454eb tempest-ProjectReaderTests-1882876355 None] <== create_volume: return (744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:43:11 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-3ac14ac0-526d-4be7-a662-b9bd29f454eb tempest-ProjectReaderTests-1882876355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.746s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:43:11 devstack sudo[114723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ae4b5b93-37a6-458a-94ca-235010373406.8f7d2e04-1d27-4844-a5b4-3afaf65371a6 Aug 26 14:43:11 devstack sudo[114723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:11 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-3ac14ac0-526d-4be7-a662-b9bd29f454eb tempest-ProjectReaderTests-1882876355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9282b24e-809d-4324-9aab-b5e23794c2c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26639f24-eac2-4f8d-83a6-a6ca133b7059', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:43:11 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-3ac14ac0-526d-4be7-a662-b9bd29f454eb tempest-ProjectReaderTests-1882876355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f99760cc-89a6-4cf5-8963-8b36c15b289e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:43:11 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-3ac14ac0-526d-4be7-a662-b9bd29f454eb tempest-ProjectReaderTests-1882876355 None] Volume volume-26639f24-eac2-4f8d-83a6-a6ca133b7059 (26639f24-eac2-4f8d-83a6-a6ca133b7059): created successfully Aug 26 14:43:11 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-3ac14ac0-526d-4be7-a662-b9bd29f454eb tempest-ProjectReaderTests-1882876355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f99760cc-89a6-4cf5-8963-8b36c15b289e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:43:12 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-3ac14ac0-526d-4be7-a662-b9bd29f454eb tempest-ProjectReaderTests-1882876355 None] Flow 'volume_create_manager' (19e5e74b-a2d6-4ae2-a0be-8cfdc4bc2079) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:43:12 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-3ac14ac0-526d-4be7-a662-b9bd29f454eb tempest-ProjectReaderTests-1882876355 None] Created volume successfully. Aug 26 14:43:12 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-42857e3b-518f-4156-b2c8-428c93d57c8a tempest-SnapshotDependencyTests-1763346707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:43:12 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-42857e3b-518f-4156-b2c8-428c93d57c8a tempest-SnapshotDependencyTests-1763346707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:43:12 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-42857e3b-518f-4156-b2c8-428c93d57c8a tempest-SnapshotDependencyTests-1763346707 None] Creating offline snapshot 2f4c3f07-740f-4cd8-9aa1-a03a4d8a9478 of volume b46cb88f-ab5a-4681-a203-ce75f06bbd58 {{(pid=94394) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 14:43:12 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[edead8fa-2f41-41ae-a38c-a4e6cc1156ab]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:43:12 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-42857e3b-518f-4156-b2c8-428c93d57c8a tempest-SnapshotDependencyTests-1763346707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b46cb88f-ab5a-4681-a203-ce75f06bbd58 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:12 devstack sudo[114725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b46cb88f-ab5a-4681-a203-ce75f06bbd58 Aug 26 14:43:12 devstack sudo[114725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:12 devstack sudo[114723]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:12 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-931c6f76-c5a4-401c-85ec-265f0099c00e tempest-ProjectMemberTests-1774785373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ae4b5b93-37a6-458a-94ca-235010373406.8f7d2e04-1d27-4844-a5b4-3afaf65371a6" returned: 0 in 0.373s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:12 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-931c6f76-c5a4-401c-85ec-265f0099c00e tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ae4b5b93-37a6-458a-94ca-235010373406.8f7d2e04-1d27-4844-a5b4-3afaf65371a6 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:12 devstack sudo[114730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ae4b5b93-37a6-458a-94ca-235010373406.8f7d2e04-1d27-4844-a5b4-3afaf65371a6 Aug 26 14:43:12 devstack sudo[114730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:12 devstack sudo[114725]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:12 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-42857e3b-518f-4156-b2c8-428c93d57c8a tempest-SnapshotDependencyTests-1763346707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b46cb88f-ab5a-4681-a203-ce75f06bbd58" returned: 0 in 0.364s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:12 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-42857e3b-518f-4156-b2c8-428c93d57c8a tempest-SnapshotDependencyTests-1763346707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b46cb88f-ab5a-4681-a203-ce75f06bbd58,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b46cb88f-ab5a-4681-a203-ce75f06bbd58.2f4c3f07-740f-4cd8-9aa1-a03a4d8a9478 1G {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:12 devstack sudo[114735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b46cb88f-ab5a-4681-a203-ce75f06bbd58,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b46cb88f-ab5a-4681-a203-ce75f06bbd58.2f4c3f07-740f-4cd8-9aa1-a03a4d8a9478 1G Aug 26 14:43:12 devstack sudo[114735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:12 devstack sudo[114730]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:12 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-931c6f76-c5a4-401c-85ec-265f0099c00e tempest-ProjectMemberTests-1774785373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ae4b5b93-37a6-458a-94ca-235010373406.8f7d2e04-1d27-4844-a5b4-3afaf65371a6" returned: 0 in 0.245s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:12 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-931c6f76-c5a4-401c-85ec-265f0099c00e tempest-ProjectMemberTests-1774785373 None] Lock "cinder-quobyte-8f7d2e04-1d27-4844-a5b4-3afaf65371a6" released by "_delete_snapshot" :: held 1.505s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:43:12 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-931c6f76-c5a4-401c-85ec-265f0099c00e tempest-ProjectMemberTests-1774785373 None] Lock "cinder-quobyte-ae4b5b93-37a6-458a-94ca-235010373406" released by "delete_snapshot" :: held 1.535s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:43:12 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-931c6f76-c5a4-401c-85ec-265f0099c00e tempest-ProjectMemberTests-1774785373 None] Created reservations ['83789397-7eff-4cf7-9a76-25517e622212', '179d77db-903e-4d2d-a636-a411f1c88c21', 'd6ebf545-fea9-4dac-81a7-6c1abc47b7e8', '8f786c80-f4e6-444a-b302-7105ff0126c9'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:43:12 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-931c6f76-c5a4-401c-85ec-265f0099c00e tempest-ProjectMemberTests-1774785373 None] Delete snapshot completed successfully. Aug 26 14:43:12 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-931c6f76-c5a4-401c-85ec-265f0099c00e tempest-ProjectMemberTests-1774785373 None] Lock "cinder-8f7d2e04-1d27-4844-a5b4-3afaf65371a6-delete_snapshot" released by "delete_snapshot" :: held 1.684s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:43:12 devstack sudo[114735]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:12 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-42857e3b-518f-4156-b2c8-428c93d57c8a tempest-SnapshotDependencyTests-1763346707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b46cb88f-ab5a-4681-a203-ce75f06bbd58,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b46cb88f-ab5a-4681-a203-ce75f06bbd58.2f4c3f07-740f-4cd8-9aa1-a03a4d8a9478 1G" returned: 0 in 0.390s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:12 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-42857e3b-518f-4156-b2c8-428c93d57c8a tempest-SnapshotDependencyTests-1763346707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b46cb88f-ab5a-4681-a203-ce75f06bbd58 -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b46cb88f-ab5a-4681-a203-ce75f06bbd58.2f4c3f07-740f-4cd8-9aa1-a03a4d8a9478 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:12 devstack sudo[114741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b46cb88f-ab5a-4681-a203-ce75f06bbd58 -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b46cb88f-ab5a-4681-a203-ce75f06bbd58.2f4c3f07-740f-4cd8-9aa1-a03a4d8a9478 Aug 26 14:43:12 devstack sudo[114741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:13 devstack sudo[114741]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:13 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-c115157a-b74b-43d7-ac62-573f18c2cc5c tempest-ProjectMemberTests-1774785373 None] Acquiring lock "cinder-ae4b5b93-37a6-458a-94ca-235010373406-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:43:13 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-42857e3b-518f-4156-b2c8-428c93d57c8a tempest-SnapshotDependencyTests-1763346707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b46cb88f-ab5a-4681-a203-ce75f06bbd58 -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b46cb88f-ab5a-4681-a203-ce75f06bbd58.2f4c3f07-740f-4cd8-9aa1-a03a4d8a9478" returned: 0 in 0.344s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:13 devstack cinder-volume[94394]: WARNING cinder.volume.drivers.remotefs [None req-42857e3b-518f-4156-b2c8-428c93d57c8a tempest-SnapshotDependencyTests-1763346707 None] /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b46cb88f-ab5a-4681-a203-ce75f06bbd58.2f4c3f07-740f-4cd8-9aa1-a03a4d8a9478 is being set with open permissions: ugo+rw Aug 26 14:43:13 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-42857e3b-518f-4156-b2c8-428c93d57c8a tempest-SnapshotDependencyTests-1763346707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b46cb88f-ab5a-4681-a203-ce75f06bbd58.2f4c3f07-740f-4cd8-9aa1-a03a4d8a9478 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:13 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-c115157a-b74b-43d7-ac62-573f18c2cc5c tempest-ProjectMemberTests-1774785373 None] Lock "cinder-ae4b5b93-37a6-458a-94ca-235010373406-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:43:13 devstack sudo[114747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b46cb88f-ab5a-4681-a203-ce75f06bbd58.2f4c3f07-740f-4cd8-9aa1-a03a4d8a9478 Aug 26 14:43:13 devstack sudo[114747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:13 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-c115157a-b74b-43d7-ac62-573f18c2cc5c tempest-ProjectMemberTests-1774785373 None] Acquiring lock "cinder-quobyte-ae4b5b93-37a6-458a-94ca-235010373406" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:43:13 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-c115157a-b74b-43d7-ac62-573f18c2cc5c tempest-ProjectMemberTests-1774785373 None] Lock "cinder-quobyte-ae4b5b93-37a6-458a-94ca-235010373406" acquired by "delete_volume" :: waited 0.022s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:43:13 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[627fe3b0-bcf8-4ca4-b36f-4c0819d278f2]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:43:13 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-c115157a-b74b-43d7-ac62-573f18c2cc5c tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ae4b5b93-37a6-458a-94ca-235010373406 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:13 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-18f02dfd-11a9-4873-86c9-129f02057afe tempest-ProjectReaderTests-1882876355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:43:13 devstack sudo[114749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ae4b5b93-37a6-458a-94ca-235010373406 Aug 26 14:43:13 devstack sudo[114749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:13 devstack sudo[114747]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:13 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-42857e3b-518f-4156-b2c8-428c93d57c8a tempest-SnapshotDependencyTests-1763346707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b46cb88f-ab5a-4681-a203-ce75f06bbd58.2f4c3f07-740f-4cd8-9aa1-a03a4d8a9478" returned: 0 in 0.276s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:13 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-42857e3b-518f-4156-b2c8-428c93d57c8a tempest-SnapshotDependencyTests-1763346707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b46cb88f-ab5a-4681-a203-ce75f06bbd58.info {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:13 devstack sudo[114752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b46cb88f-ab5a-4681-a203-ce75f06bbd58.info Aug 26 14:43:13 devstack sudo[114752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:13 devstack sudo[114749]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:13 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-c115157a-b74b-43d7-ac62-573f18c2cc5c tempest-ProjectMemberTests-1774785373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ae4b5b93-37a6-458a-94ca-235010373406" returned: 0 in 0.365s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:13 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-c115157a-b74b-43d7-ac62-573f18c2cc5c tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ae4b5b93-37a6-458a-94ca-235010373406 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:13 devstack sudo[114758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ae4b5b93-37a6-458a-94ca-235010373406 Aug 26 14:43:13 devstack sudo[114758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:13 devstack sudo[114752]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:13 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-42857e3b-518f-4156-b2c8-428c93d57c8a tempest-SnapshotDependencyTests-1763346707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b46cb88f-ab5a-4681-a203-ce75f06bbd58.info" returned: 0 in 0.250s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:13 devstack cinder-volume[94394]: WARNING cinder.volume.drivers.remotefs [None req-42857e3b-518f-4156-b2c8-428c93d57c8a tempest-SnapshotDependencyTests-1763346707 None] /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b46cb88f-ab5a-4681-a203-ce75f06bbd58.info is being set with open permissions: ugo+rw Aug 26 14:43:13 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-42857e3b-518f-4156-b2c8-428c93d57c8a tempest-SnapshotDependencyTests-1763346707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b46cb88f-ab5a-4681-a203-ce75f06bbd58.info {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:13 devstack sudo[114760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b46cb88f-ab5a-4681-a203-ce75f06bbd58.info Aug 26 14:43:13 devstack sudo[114760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:13 devstack sudo[114758]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:13 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-c115157a-b74b-43d7-ac62-573f18c2cc5c tempest-ProjectMemberTests-1774785373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-ae4b5b93-37a6-458a-94ca-235010373406" returned: 0 in 0.240s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:13 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-c115157a-b74b-43d7-ac62-573f18c2cc5c tempest-ProjectMemberTests-1774785373 None] Lock "cinder-quobyte-ae4b5b93-37a6-458a-94ca-235010373406" released by "delete_volume" :: held 0.678s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:43:13 devstack sudo[114760]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:13 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-42857e3b-518f-4156-b2c8-428c93d57c8a tempest-SnapshotDependencyTests-1763346707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b46cb88f-ab5a-4681-a203-ce75f06bbd58.info" returned: 0 in 0.255s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:14 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-42857e3b-518f-4156-b2c8-428c93d57c8a tempest-SnapshotDependencyTests-1763346707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.973s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:43:14 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-18f02dfd-11a9-4873-86c9-129f02057afe tempest-ProjectReaderTests-1882876355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.649s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:43:14 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-c115157a-b74b-43d7-ac62-573f18c2cc5c tempest-ProjectMemberTests-1774785373 None] Created reservations ['abdd1fdb-e00f-4907-bb56-91414546e049', '107f49c6-8372-4276-b0f0-27d44d44b18c', '1364216d-103a-4a0d-9d7a-c838b14b9786', '6581f1b9-3c8b-472e-a5f6-4a6e902760e9'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:43:14 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-18f02dfd-11a9-4873-86c9-129f02057afe tempest-ProjectReaderTests-1882876355 None] Creating offline snapshot c0206f9c-5a05-4270-99ae-80c0d1948c2e of volume 26639f24-eac2-4f8d-83a6-a6ca133b7059 {{(pid=94394) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 14:43:14 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-42857e3b-518f-4156-b2c8-428c93d57c8a tempest-SnapshotDependencyTests-1763346707 None] Create snapshot completed successfully Aug 26 14:43:14 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[28a38eca-5311-4c42-a3bd-34ac864406ad]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:43:14 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-18f02dfd-11a9-4873-86c9-129f02057afe tempest-ProjectReaderTests-1882876355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-26639f24-eac2-4f8d-83a6-a6ca133b7059 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:14 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-c115157a-b74b-43d7-ac62-573f18c2cc5c tempest-ProjectMemberTests-1774785373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:43:14 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-c115157a-b74b-43d7-ac62-573f18c2cc5c tempest-ProjectMemberTests-1774785373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:43:14 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-c115157a-b74b-43d7-ac62-573f18c2cc5c tempest-ProjectMemberTests-1774785373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:43:14 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-c115157a-b74b-43d7-ac62-573f18c2cc5c tempest-ProjectMemberTests-1774785373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:43:14 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-c115157a-b74b-43d7-ac62-573f18c2cc5c tempest-ProjectMemberTests-1774785373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:43:14 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-c115157a-b74b-43d7-ac62-573f18c2cc5c tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:14 devstack sudo[114764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-26639f24-eac2-4f8d-83a6-a6ca133b7059 Aug 26 14:43:14 devstack sudo[114764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:14 devstack sudo[114765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:43:14 devstack sudo[114765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:14 devstack sudo[114765]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:14 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-c115157a-b74b-43d7-ac62-573f18c2cc5c tempest-ProjectMemberTests-1774785373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.282s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:14 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-c115157a-b74b-43d7-ac62-573f18c2cc5c tempest-ProjectMemberTests-1774785373 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:43:14 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-c115157a-b74b-43d7-ac62-573f18c2cc5c tempest-ProjectMemberTests-1774785373 None] Deleted volume successfully. Aug 26 14:43:14 devstack sudo[114764]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:14 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-18f02dfd-11a9-4873-86c9-129f02057afe tempest-ProjectReaderTests-1882876355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-26639f24-eac2-4f8d-83a6-a6ca133b7059" returned: 0 in 0.401s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:14 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-18f02dfd-11a9-4873-86c9-129f02057afe tempest-ProjectReaderTests-1882876355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-26639f24-eac2-4f8d-83a6-a6ca133b7059,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-26639f24-eac2-4f8d-83a6-a6ca133b7059.c0206f9c-5a05-4270-99ae-80c0d1948c2e 1G {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:14 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-c115157a-b74b-43d7-ac62-573f18c2cc5c tempest-ProjectMemberTests-1774785373 None] Lock "cinder-ae4b5b93-37a6-458a-94ca-235010373406-delete_volume" released by "delete_volume" :: held 1.281s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:43:14 devstack sudo[114772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-26639f24-eac2-4f8d-83a6-a6ca133b7059,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-26639f24-eac2-4f8d-83a6-a6ca133b7059.c0206f9c-5a05-4270-99ae-80c0d1948c2e 1G Aug 26 14:43:14 devstack sudo[114772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:14 devstack sudo[114772]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:14 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-18f02dfd-11a9-4873-86c9-129f02057afe tempest-ProjectReaderTests-1882876355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-26639f24-eac2-4f8d-83a6-a6ca133b7059,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-26639f24-eac2-4f8d-83a6-a6ca133b7059.c0206f9c-5a05-4270-99ae-80c0d1948c2e 1G" returned: 0 in 0.442s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:14 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-18f02dfd-11a9-4873-86c9-129f02057afe tempest-ProjectReaderTests-1882876355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26639f24-eac2-4f8d-83a6-a6ca133b7059 -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-26639f24-eac2-4f8d-83a6-a6ca133b7059.c0206f9c-5a05-4270-99ae-80c0d1948c2e {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:14 devstack sudo[114778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26639f24-eac2-4f8d-83a6-a6ca133b7059 -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-26639f24-eac2-4f8d-83a6-a6ca133b7059.c0206f9c-5a05-4270-99ae-80c0d1948c2e Aug 26 14:43:14 devstack sudo[114778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:15 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9db11ee-7795-471c-9db4-fa66139388c8 tempest-SnapshotDependencyTests-1763346707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:43:15 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-b9db11ee-7795-471c-9db4-fa66139388c8 tempest-SnapshotDependencyTests-1763346707 None] Flow 'volume_create_manager' (e7032c02-a01e-41a3-93b1-37aaf2b3f797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:43:15 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-b9db11ee-7795-471c-9db4-fa66139388c8 tempest-SnapshotDependencyTests-1763346707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14d21ceb-dfcc-4ceb-ade9-896d40089298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:43:15 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-b9db11ee-7795-471c-9db4-fa66139388c8 tempest-SnapshotDependencyTests-1763346707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14d21ceb-dfcc-4ceb-ade9-896d40089298) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:43:14Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47608d8e-6d8f-4e7e-bb37-5f59f824df68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8ad4d5ed98841b0a5cf9944f36b88d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:43:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=2f4c3f07-740f-4cd8-9aa1-a03a4d8a9478,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:43:15Z,use_quota=True,user_id='cc50a370ea2f4305bd5e0e9f77600162',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:43:15 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-b9db11ee-7795-471c-9db4-fa66139388c8 tempest-SnapshotDependencyTests-1763346707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a53d4b95-901e-484e-8b79-90fb47d1f0ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:43:15 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-b9db11ee-7795-471c-9db4-fa66139388c8 tempest-SnapshotDependencyTests-1763346707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a53d4b95-901e-484e-8b79-90fb47d1f0ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:43:15 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-b9db11ee-7795-471c-9db4-fa66139388c8 tempest-SnapshotDependencyTests-1763346707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d03191fa-227c-49f6-8d45-f607b93e4832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:43:15 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-b9db11ee-7795-471c-9db4-fa66139388c8 tempest-SnapshotDependencyTests-1763346707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d03191fa-227c-49f6-8d45-f607b93e4832) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '47608d8e-6d8f-4e7e-bb37-5f59f824df68', 'volume_name': 'volume-47608d8e-6d8f-4e7e-bb37-5f59f824df68', 'volume_size': 1, 'snapshot_id': '2f4c3f07-740f-4cd8-9aa1-a03a4d8a9478'}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:43:15 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-b9db11ee-7795-471c-9db4-fa66139388c8 tempest-SnapshotDependencyTests-1763346707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdb089e4-778d-4bb8-a662-0eca001cdb47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:43:15 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-b9db11ee-7795-471c-9db4-fa66139388c8 tempest-SnapshotDependencyTests-1763346707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdb089e4-778d-4bb8-a662-0eca001cdb47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:43:15 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-b9db11ee-7795-471c-9db4-fa66139388c8 tempest-SnapshotDependencyTests-1763346707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b890cc8-6874-4fbb-b7bb-63ae9eece2b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:43:15 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-b9db11ee-7795-471c-9db4-fa66139388c8 tempest-SnapshotDependencyTests-1763346707 None] Volume 47608d8e-6d8f-4e7e-bb37-5f59f824df68: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-47608d8e-6d8f-4e7e-bb37-5f59f824df68', 'volume_size': 1, 'snapshot_id': '2f4c3f07-740f-4cd8-9aa1-a03a4d8a9478'} Aug 26 14:43:15 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-de4790e2-9ef0-4f36-9d33-1fb9779794b4 tempest-ProjectMemberTests-1774785373 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:43:15 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-de4790e2-9ef0-4f36-9d33-1fb9779794b4 tempest-ProjectMemberTests-1774785373 None] Flow 'volume_create_manager' (3a6a801a-c17b-4f50-a6e3-7e3eee4136b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:43:15 devstack sudo[114778]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:15 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-de4790e2-9ef0-4f36-9d33-1fb9779794b4 tempest-ProjectMemberTests-1774785373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d64146f1-2488-46d4-8d7d-f688aec69bb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:43:15 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-18f02dfd-11a9-4873-86c9-129f02057afe tempest-ProjectReaderTests-1882876355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26639f24-eac2-4f8d-83a6-a6ca133b7059 -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-26639f24-eac2-4f8d-83a6-a6ca133b7059.c0206f9c-5a05-4270-99ae-80c0d1948c2e" returned: 0 in 0.309s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:15 devstack cinder-volume[94394]: WARNING cinder.volume.drivers.remotefs [None req-18f02dfd-11a9-4873-86c9-129f02057afe tempest-ProjectReaderTests-1882876355 None] /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-26639f24-eac2-4f8d-83a6-a6ca133b7059.c0206f9c-5a05-4270-99ae-80c0d1948c2e is being set with open permissions: ugo+rw Aug 26 14:43:15 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-18f02dfd-11a9-4873-86c9-129f02057afe tempest-ProjectReaderTests-1882876355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-26639f24-eac2-4f8d-83a6-a6ca133b7059.c0206f9c-5a05-4270-99ae-80c0d1948c2e {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:15 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-b9db11ee-7795-471c-9db4-fa66139388c8 tempest-SnapshotDependencyTests-1763346707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:43:15 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-de4790e2-9ef0-4f36-9d33-1fb9779794b4 tempest-ProjectMemberTests-1774785373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d64146f1-2488-46d4-8d7d-f688aec69bb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:43:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1372521400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5efd68d6-e817-4332-a155-f5f387ea4695,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8dd248190cb40cebc9daf2b89f48fd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:43:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:43:15Z,use_quota=True,user_id='ad0617c386b6460d8f790d85646880e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:43:15 devstack sudo[114783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-26639f24-eac2-4f8d-83a6-a6ca133b7059.c0206f9c-5a05-4270-99ae-80c0d1948c2e Aug 26 14:43:15 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-de4790e2-9ef0-4f36-9d33-1fb9779794b4 tempest-ProjectMemberTests-1774785373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5df2ddbe-9bf9-4e14-8be6-d1a54cb76470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:43:15 devstack sudo[114783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:15 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-de4790e2-9ef0-4f36-9d33-1fb9779794b4 tempest-ProjectMemberTests-1774785373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5df2ddbe-9bf9-4e14-8be6-d1a54cb76470) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:43:15 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-de4790e2-9ef0-4f36-9d33-1fb9779794b4 tempest-ProjectMemberTests-1774785373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0ce9adf-0395-4bef-8e62-40fe851b68e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:43:15 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-de4790e2-9ef0-4f36-9d33-1fb9779794b4 tempest-ProjectMemberTests-1774785373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0ce9adf-0395-4bef-8e62-40fe851b68e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5efd68d6-e817-4332-a155-f5f387ea4695', 'volume_name': 'volume-5efd68d6-e817-4332-a155-f5f387ea4695', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:43:15 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-de4790e2-9ef0-4f36-9d33-1fb9779794b4 tempest-ProjectMemberTests-1774785373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f019ec97-a531-41fc-8898-35e1411c7827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:43:15 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-de4790e2-9ef0-4f36-9d33-1fb9779794b4 tempest-ProjectMemberTests-1774785373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f019ec97-a531-41fc-8898-35e1411c7827) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:43:15 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-de4790e2-9ef0-4f36-9d33-1fb9779794b4 tempest-ProjectMemberTests-1774785373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88620c1b-73e7-4d9f-8d49-07bd3295fd0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:43:15 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-de4790e2-9ef0-4f36-9d33-1fb9779794b4 tempest-ProjectMemberTests-1774785373 None] Volume 5efd68d6-e817-4332-a155-f5f387ea4695: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5efd68d6-e817-4332-a155-f5f387ea4695', 'volume_size': 1} Aug 26 14:43:15 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-de4790e2-9ef0-4f36-9d33-1fb9779794b4 tempest-ProjectMemberTests-1774785373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:43:15 devstack sudo[114783]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:15 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-18f02dfd-11a9-4873-86c9-129f02057afe tempest-ProjectReaderTests-1882876355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-26639f24-eac2-4f8d-83a6-a6ca133b7059.c0206f9c-5a05-4270-99ae-80c0d1948c2e" returned: 0 in 0.243s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:15 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-18f02dfd-11a9-4873-86c9-129f02057afe tempest-ProjectReaderTests-1882876355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-26639f24-eac2-4f8d-83a6-a6ca133b7059.info {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:15 devstack sudo[114786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-26639f24-eac2-4f8d-83a6-a6ca133b7059.info Aug 26 14:43:15 devstack sudo[114786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:15 devstack sudo[114786]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:15 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-18f02dfd-11a9-4873-86c9-129f02057afe tempest-ProjectReaderTests-1882876355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-26639f24-eac2-4f8d-83a6-a6ca133b7059.info" returned: 0 in 0.248s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:15 devstack cinder-volume[94394]: WARNING cinder.volume.drivers.remotefs [None req-18f02dfd-11a9-4873-86c9-129f02057afe tempest-ProjectReaderTests-1882876355 None] /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-26639f24-eac2-4f8d-83a6-a6ca133b7059.info is being set with open permissions: ugo+rw Aug 26 14:43:15 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-18f02dfd-11a9-4873-86c9-129f02057afe tempest-ProjectReaderTests-1882876355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-26639f24-eac2-4f8d-83a6-a6ca133b7059.info {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:15 devstack sudo[114789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-26639f24-eac2-4f8d-83a6-a6ca133b7059.info Aug 26 14:43:15 devstack sudo[114789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:15 devstack sudo[114789]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:15 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-18f02dfd-11a9-4873-86c9-129f02057afe tempest-ProjectReaderTests-1882876355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-26639f24-eac2-4f8d-83a6-a6ca133b7059.info" returned: 0 in 0.243s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:15 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-18f02dfd-11a9-4873-86c9-129f02057afe tempest-ProjectReaderTests-1882876355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.970s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:43:15 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-b9db11ee-7795-471c-9db4-fa66139388c8 tempest-SnapshotDependencyTests-1763346707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.764s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:43:15 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-b9db11ee-7795-471c-9db4-fa66139388c8 tempest-SnapshotDependencyTests-1763346707 None] Acquiring lock "cinder-quobyte-2f4c3f07-740f-4cd8-9aa1-a03a4d8a9478-47608d8e-6d8f-4e7e-bb37-5f59f824df68" by "_create_volume_from_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:43:16 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-b9db11ee-7795-471c-9db4-fa66139388c8 tempest-SnapshotDependencyTests-1763346707 None] Lock "cinder-quobyte-2f4c3f07-740f-4cd8-9aa1-a03a4d8a9478-47608d8e-6d8f-4e7e-bb37-5f59f824df68" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:43:16 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-b9db11ee-7795-471c-9db4-fa66139388c8 tempest-SnapshotDependencyTests-1763346707 None] Creating volume 47608d8e-6d8f-4e7e-bb37-5f59f824df68 from snapshot 2f4c3f07-740f-4cd8-9aa1-a03a4d8a9478 {{(pid=94394) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Aug 26 14:43:16 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-b9db11ee-7795-471c-9db4-fa66139388c8 tempest-SnapshotDependencyTests-1763346707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:43:16 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-b9db11ee-7795-471c-9db4-fa66139388c8 tempest-SnapshotDependencyTests-1763346707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:43:16 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-b9db11ee-7795-471c-9db4-fa66139388c8 tempest-SnapshotDependencyTests-1763346707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:43:16 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-b9db11ee-7795-471c-9db4-fa66139388c8 tempest-SnapshotDependencyTests-1763346707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:43:16 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-b9db11ee-7795-471c-9db4-fa66139388c8 tempest-SnapshotDependencyTests-1763346707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:43:16 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-b9db11ee-7795-471c-9db4-fa66139388c8 tempest-SnapshotDependencyTests-1763346707 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:43:16 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-b9db11ee-7795-471c-9db4-fa66139388c8 tempest-SnapshotDependencyTests-1763346707 None] Acquiring lock "cinder-quobyte-47608d8e-6d8f-4e7e-bb37-5f59f824df68" by "_copy_volume_from_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:43:16 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-18f02dfd-11a9-4873-86c9-129f02057afe tempest-ProjectReaderTests-1882876355 None] Create snapshot completed successfully Aug 26 14:43:16 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-b9db11ee-7795-471c-9db4-fa66139388c8 tempest-SnapshotDependencyTests-1763346707 None] Lock "cinder-quobyte-47608d8e-6d8f-4e7e-bb37-5f59f824df68" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:43:16 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-b9db11ee-7795-471c-9db4-fa66139388c8 tempest-SnapshotDependencyTests-1763346707 None] snapshot: 2f4c3f07-740f-4cd8-9aa1-a03a4d8a9478, volume: 47608d8e-6d8f-4e7e-bb37-5f59f824df68, {{(pid=94394) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 26 14:43:16 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-b9db11ee-7795-471c-9db4-fa66139388c8 tempest-SnapshotDependencyTests-1763346707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:43:16 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-b9db11ee-7795-471c-9db4-fa66139388c8 tempest-SnapshotDependencyTests-1763346707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:43:16 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-b9db11ee-7795-471c-9db4-fa66139388c8 tempest-SnapshotDependencyTests-1763346707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:43:16 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-b9db11ee-7795-471c-9db4-fa66139388c8 tempest-SnapshotDependencyTests-1763346707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:43:16 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-b9db11ee-7795-471c-9db4-fa66139388c8 tempest-SnapshotDependencyTests-1763346707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:43:16 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b43cda6-9473-40e3-b4db-56bf455071e4]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:43:16 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-b9db11ee-7795-471c-9db4-fa66139388c8 tempest-SnapshotDependencyTests-1763346707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b46cb88f-ab5a-4681-a203-ce75f06bbd58.2f4c3f07-740f-4cd8-9aa1-a03a4d8a9478 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:16 devstack sudo[114792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b46cb88f-ab5a-4681-a203-ce75f06bbd58.2f4c3f07-740f-4cd8-9aa1-a03a4d8a9478 Aug 26 14:43:16 devstack sudo[114792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:16 devstack sudo[114792]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:16 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-b9db11ee-7795-471c-9db4-fa66139388c8 tempest-SnapshotDependencyTests-1763346707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b46cb88f-ab5a-4681-a203-ce75f06bbd58.2f4c3f07-740f-4cd8-9aa1-a03a4d8a9478" returned: 0 in 0.350s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:16 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-b9db11ee-7795-471c-9db4-fa66139388c8 tempest-SnapshotDependencyTests-1763346707 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b46cb88f-ab5a-4681-a203-ce75f06bbd58(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94394) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 14:43:16 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[5296c3e8-bc5b-4d0b-adea-d6c930ce24ca]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:43:16 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-b9db11ee-7795-471c-9db4-fa66139388c8 tempest-SnapshotDependencyTests-1763346707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b46cb88f-ab5a-4681-a203-ce75f06bbd58 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:16 devstack sudo[114797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b46cb88f-ab5a-4681-a203-ce75f06bbd58 Aug 26 14:43:16 devstack sudo[114797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:16 devstack sudo[114797]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:16 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-b9db11ee-7795-471c-9db4-fa66139388c8 tempest-SnapshotDependencyTests-1763346707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b46cb88f-ab5a-4681-a203-ce75f06bbd58" returned: 0 in 0.349s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:16 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-b9db11ee-7795-471c-9db4-fa66139388c8 tempest-SnapshotDependencyTests-1763346707 None] will copy from snapshot at /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b46cb88f-ab5a-4681-a203-ce75f06bbd58 {{(pid=94394) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 26 14:43:16 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-b9db11ee-7795-471c-9db4-fa66139388c8 tempest-SnapshotDependencyTests-1763346707 None] Creating direct copy from snapshot {{(pid=94394) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 26 14:43:16 devstack cinder-volume[94394]: DEBUG cinder.utils [None req-b9db11ee-7795-471c-9db4-fa66139388c8 tempest-SnapshotDependencyTests-1763346707 None] Path /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-47608d8e-6d8f-4e7e-bb37-5f59f824df68 not found in is_blk_device check {{(pid=94394) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 26 14:43:16 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-b9db11ee-7795-471c-9db4-fa66139388c8 tempest-SnapshotDependencyTests-1763346707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b46cb88f-ab5a-4681-a203-ce75f06bbd58 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-47608d8e-6d8f-4e7e-bb37-5f59f824df68 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:16 devstack sudo[114803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b46cb88f-ab5a-4681-a203-ce75f06bbd58 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-47608d8e-6d8f-4e7e-bb37-5f59f824df68 Aug 26 14:43:16 devstack sudo[114803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:16 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-56a5d89e-8d8d-4ec0-9c0a-203b139de5b3 tempest-ProjectReaderTests-1882876355 None] Acquiring lock "cinder-c0206f9c-5a05-4270-99ae-80c0d1948c2e-delete_snapshot" by "delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:43:16 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-56a5d89e-8d8d-4ec0-9c0a-203b139de5b3 tempest-ProjectReaderTests-1882876355 None] Lock "cinder-c0206f9c-5a05-4270-99ae-80c0d1948c2e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:43:16 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-56a5d89e-8d8d-4ec0-9c0a-203b139de5b3 tempest-ProjectReaderTests-1882876355 None] Acquiring lock "cinder-quobyte-26639f24-eac2-4f8d-83a6-a6ca133b7059" by "delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:43:16 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-56a5d89e-8d8d-4ec0-9c0a-203b139de5b3 tempest-ProjectReaderTests-1882876355 None] Lock "cinder-quobyte-26639f24-eac2-4f8d-83a6-a6ca133b7059" acquired by "delete_snapshot" :: waited 0.018s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:43:16 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-56a5d89e-8d8d-4ec0-9c0a-203b139de5b3 tempest-ProjectReaderTests-1882876355 None] Acquiring lock "cinder-quobyte-c0206f9c-5a05-4270-99ae-80c0d1948c2e" by "_delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:43:16 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-56a5d89e-8d8d-4ec0-9c0a-203b139de5b3 tempest-ProjectReaderTests-1882876355 None] Lock "cinder-quobyte-c0206f9c-5a05-4270-99ae-80c0d1948c2e" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:43:16 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-56a5d89e-8d8d-4ec0-9c0a-203b139de5b3 tempest-ProjectReaderTests-1882876355 None] Deleting offline snapshot c0206f9c-5a05-4270-99ae-80c0d1948c2e of volume 26639f24-eac2-4f8d-83a6-a6ca133b7059 {{(pid=94394) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 14:43:16 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-56a5d89e-8d8d-4ec0-9c0a-203b139de5b3 tempest-ProjectReaderTests-1882876355 None] snapshot_file for this snap is: volume-26639f24-eac2-4f8d-83a6-a6ca133b7059.c0206f9c-5a05-4270-99ae-80c0d1948c2e {{(pid=94394) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 14:43:17 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[3967bb43-09d6-47c8-a1b1-b27ec93481b0]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:43:17 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-56a5d89e-8d8d-4ec0-9c0a-203b139de5b3 tempest-ProjectReaderTests-1882876355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-26639f24-eac2-4f8d-83a6-a6ca133b7059.c0206f9c-5a05-4270-99ae-80c0d1948c2e {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:17 devstack sudo[114805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-26639f24-eac2-4f8d-83a6-a6ca133b7059.c0206f9c-5a05-4270-99ae-80c0d1948c2e Aug 26 14:43:17 devstack sudo[114805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:17 devstack sudo[114805]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:17 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-56a5d89e-8d8d-4ec0-9c0a-203b139de5b3 tempest-ProjectReaderTests-1882876355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-26639f24-eac2-4f8d-83a6-a6ca133b7059.c0206f9c-5a05-4270-99ae-80c0d1948c2e" returned: 0 in 0.453s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:17 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-56a5d89e-8d8d-4ec0-9c0a-203b139de5b3 tempest-ProjectReaderTests-1882876355 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-26639f24-eac2-4f8d-83a6-a6ca133b7059(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94394) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 14:43:17 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3e09351-b807-4a36-b71c-6087e7602c55]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:43:17 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-56a5d89e-8d8d-4ec0-9c0a-203b139de5b3 tempest-ProjectReaderTests-1882876355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-26639f24-eac2-4f8d-83a6-a6ca133b7059 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:17 devstack sudo[114821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-26639f24-eac2-4f8d-83a6-a6ca133b7059 Aug 26 14:43:17 devstack sudo[114821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:18 devstack sudo[114821]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:18 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-56a5d89e-8d8d-4ec0-9c0a-203b139de5b3 tempest-ProjectReaderTests-1882876355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-26639f24-eac2-4f8d-83a6-a6ca133b7059" returned: 0 in 0.943s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:18 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-56a5d89e-8d8d-4ec0-9c0a-203b139de5b3 tempest-ProjectReaderTests-1882876355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-26639f24-eac2-4f8d-83a6-a6ca133b7059.c0206f9c-5a05-4270-99ae-80c0d1948c2e {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:18 devstack sudo[114826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-26639f24-eac2-4f8d-83a6-a6ca133b7059.c0206f9c-5a05-4270-99ae-80c0d1948c2e Aug 26 14:43:18 devstack sudo[114826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:19 devstack sudo[114826]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:19 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-56a5d89e-8d8d-4ec0-9c0a-203b139de5b3 tempest-ProjectReaderTests-1882876355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-26639f24-eac2-4f8d-83a6-a6ca133b7059.c0206f9c-5a05-4270-99ae-80c0d1948c2e" returned: 0 in 0.874s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:19 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-56a5d89e-8d8d-4ec0-9c0a-203b139de5b3 tempest-ProjectReaderTests-1882876355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-26639f24-eac2-4f8d-83a6-a6ca133b7059.c0206f9c-5a05-4270-99ae-80c0d1948c2e {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:19 devstack sudo[114833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-26639f24-eac2-4f8d-83a6-a6ca133b7059.c0206f9c-5a05-4270-99ae-80c0d1948c2e Aug 26 14:43:19 devstack sudo[114833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:19 devstack sudo[114833]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:19 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-56a5d89e-8d8d-4ec0-9c0a-203b139de5b3 tempest-ProjectReaderTests-1882876355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-26639f24-eac2-4f8d-83a6-a6ca133b7059.c0206f9c-5a05-4270-99ae-80c0d1948c2e" returned: 0 in 0.586s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:19 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-56a5d89e-8d8d-4ec0-9c0a-203b139de5b3 tempest-ProjectReaderTests-1882876355 None] Lock "cinder-quobyte-c0206f9c-5a05-4270-99ae-80c0d1948c2e" released by "_delete_snapshot" :: held 3.020s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:43:20 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-56a5d89e-8d8d-4ec0-9c0a-203b139de5b3 tempest-ProjectReaderTests-1882876355 None] Lock "cinder-quobyte-26639f24-eac2-4f8d-83a6-a6ca133b7059" released by "delete_snapshot" :: held 3.047s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:43:20 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-56a5d89e-8d8d-4ec0-9c0a-203b139de5b3 tempest-ProjectReaderTests-1882876355 None] Created reservations ['bd6b8bcf-3a3f-48f9-a02c-db44b2fd9897', 'f53d1b64-ebc2-467a-8eeb-904c163ec5fa', 'af22b19d-ae7a-47b3-8fa2-a785f7eefb73', 'f5e78ad2-9c79-44b7-ab0e-87290ce50b38'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:43:20 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-56a5d89e-8d8d-4ec0-9c0a-203b139de5b3 tempest-ProjectReaderTests-1882876355 None] Delete snapshot completed successfully. Aug 26 14:43:20 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-56a5d89e-8d8d-4ec0-9c0a-203b139de5b3 tempest-ProjectReaderTests-1882876355 None] Lock "cinder-c0206f9c-5a05-4270-99ae-80c0d1948c2e-delete_snapshot" released by "delete_snapshot" :: held 3.380s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:43:21 devstack sudo[114803]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:21 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-b9db11ee-7795-471c-9db4-fa66139388c8 tempest-SnapshotDependencyTests-1763346707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b46cb88f-ab5a-4681-a203-ce75f06bbd58 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-47608d8e-6d8f-4e7e-bb37-5f59f824df68" returned: 0 in 4.473s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:21 devstack cinder-volume[94394]: DEBUG cinder.image.image_utils [None req-b9db11ee-7795-471c-9db4-fa66139388c8 tempest-SnapshotDependencyTests-1763346707 None] Image conversion details: src /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b46cb88f-ab5a-4681-a203-ce75f06bbd58, size 1024.00 MB, duration 4.47 sec, destination /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-47608d8e-6d8f-4e7e-bb37-5f59f824df68 {{(pid=94394) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 14:43:21 devstack cinder-volume[94394]: INFO cinder.image.image_utils [None req-b9db11ee-7795-471c-9db4-fa66139388c8 tempest-SnapshotDependencyTests-1763346707 None] Converted 1024.00 MB image at 228.89 MB/s Aug 26 14:43:21 devstack cinder-volume[94394]: WARNING cinder.volume.drivers.remotefs [None req-b9db11ee-7795-471c-9db4-fa66139388c8 tempest-SnapshotDependencyTests-1763346707 None] /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-47608d8e-6d8f-4e7e-bb37-5f59f824df68 is being set with open permissions: ugo+rw Aug 26 14:43:21 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-b9db11ee-7795-471c-9db4-fa66139388c8 tempest-SnapshotDependencyTests-1763346707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-47608d8e-6d8f-4e7e-bb37-5f59f824df68 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:21 devstack sudo[114837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-47608d8e-6d8f-4e7e-bb37-5f59f824df68 Aug 26 14:43:21 devstack sudo[114837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:21 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-2212eea1-9f97-4cf8-8f45-8fdae67cf12a tempest-ProjectReaderTests-1882876355 None] Acquiring lock "cinder-26639f24-eac2-4f8d-83a6-a6ca133b7059-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:43:21 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-2212eea1-9f97-4cf8-8f45-8fdae67cf12a tempest-ProjectReaderTests-1882876355 None] Lock "cinder-26639f24-eac2-4f8d-83a6-a6ca133b7059-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:43:21 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-2212eea1-9f97-4cf8-8f45-8fdae67cf12a tempest-ProjectReaderTests-1882876355 None] Acquiring lock "cinder-quobyte-26639f24-eac2-4f8d-83a6-a6ca133b7059" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:43:21 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-2212eea1-9f97-4cf8-8f45-8fdae67cf12a tempest-ProjectReaderTests-1882876355 None] Lock "cinder-quobyte-26639f24-eac2-4f8d-83a6-a6ca133b7059" acquired by "delete_volume" :: waited 0.014s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:43:21 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[df39ac71-7ba9-4a79-aced-e9b3151e4cd3]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:43:21 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-2212eea1-9f97-4cf8-8f45-8fdae67cf12a tempest-ProjectReaderTests-1882876355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-26639f24-eac2-4f8d-83a6-a6ca133b7059 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:21 devstack sudo[114837]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:21 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-b9db11ee-7795-471c-9db4-fa66139388c8 tempest-SnapshotDependencyTests-1763346707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-47608d8e-6d8f-4e7e-bb37-5f59f824df68" returned: 0 in 0.287s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:21 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-b9db11ee-7795-471c-9db4-fa66139388c8 tempest-SnapshotDependencyTests-1763346707 None] Lock "cinder-quobyte-47608d8e-6d8f-4e7e-bb37-5f59f824df68" released by "_copy_volume_from_snapshot" :: held 5.531s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:43:21 devstack sudo[114839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-26639f24-eac2-4f8d-83a6-a6ca133b7059 Aug 26 14:43:21 devstack sudo[114839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:21 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-b9db11ee-7795-471c-9db4-fa66139388c8 tempest-SnapshotDependencyTests-1763346707 None] Lock "cinder-quobyte-2f4c3f07-740f-4cd8-9aa1-a03a4d8a9478-47608d8e-6d8f-4e7e-bb37-5f59f824df68" released by "_create_volume_from_snapshot" :: held 5.595s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:43:21 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-b9db11ee-7795-471c-9db4-fa66139388c8 tempest-SnapshotDependencyTests-1763346707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.617s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:43:21 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-de4790e2-9ef0-4f36-9d33-1fb9779794b4 tempest-ProjectMemberTests-1774785373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.339s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:43:21 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-de4790e2-9ef0-4f36-9d33-1fb9779794b4 tempest-ProjectMemberTests-1774785373 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:43:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1372521400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5efd68d6-e817-4332-a155-f5f387ea4695,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8dd248190cb40cebc9daf2b89f48fd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:43:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:43:15Z,use_quota=True,user_id='ad0617c386b6460d8f790d85646880e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:43:21 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-de4790e2-9ef0-4f36-9d33-1fb9779794b4 tempest-ProjectMemberTests-1774785373 None] Creating volume 5efd68d6-e817-4332-a155-f5f387ea4695 {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:43:21 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-de4790e2-9ef0-4f36-9d33-1fb9779794b4 tempest-ProjectMemberTests-1774785373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:43:21 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-de4790e2-9ef0-4f36-9d33-1fb9779794b4 tempest-ProjectMemberTests-1774785373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:43:21 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-de4790e2-9ef0-4f36-9d33-1fb9779794b4 tempest-ProjectMemberTests-1774785373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:43:21 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-de4790e2-9ef0-4f36-9d33-1fb9779794b4 tempest-ProjectMemberTests-1774785373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:43:21 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-de4790e2-9ef0-4f36-9d33-1fb9779794b4 tempest-ProjectMemberTests-1774785373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:43:21 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-de4790e2-9ef0-4f36-9d33-1fb9779794b4 tempest-ProjectMemberTests-1774785373 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:43:21 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-de4790e2-9ef0-4f36-9d33-1fb9779794b4 tempest-ProjectMemberTests-1774785373 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:43:21 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-de4790e2-9ef0-4f36-9d33-1fb9779794b4 tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5efd68d6-e817-4332-a155-f5f387ea4695 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:21 devstack sudo[114842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5efd68d6-e817-4332-a155-f5f387ea4695 1073741824 Aug 26 14:43:21 devstack sudo[114842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:21 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-b9db11ee-7795-471c-9db4-fa66139388c8 tempest-SnapshotDependencyTests-1763346707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b890cc8-6874-4fbb-b7bb-63ae9eece2b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47608d8e-6d8f-4e7e-bb37-5f59f824df68', 'volume_size': 1, 'snapshot_id': '2f4c3f07-740f-4cd8-9aa1-a03a4d8a9478'}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:43:21 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-b9db11ee-7795-471c-9db4-fa66139388c8 tempest-SnapshotDependencyTests-1763346707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd1ccafe-8f28-422f-93c6-71631f239439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:43:21 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-b9db11ee-7795-471c-9db4-fa66139388c8 tempest-SnapshotDependencyTests-1763346707 None] Volume volume-47608d8e-6d8f-4e7e-bb37-5f59f824df68 (47608d8e-6d8f-4e7e-bb37-5f59f824df68): created successfully Aug 26 14:43:21 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-b9db11ee-7795-471c-9db4-fa66139388c8 tempest-SnapshotDependencyTests-1763346707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd1ccafe-8f28-422f-93c6-71631f239439) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:43:21 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-b9db11ee-7795-471c-9db4-fa66139388c8 tempest-SnapshotDependencyTests-1763346707 None] Flow 'volume_create_manager' (e7032c02-a01e-41a3-93b1-37aaf2b3f797) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:43:21 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-b9db11ee-7795-471c-9db4-fa66139388c8 tempest-SnapshotDependencyTests-1763346707 None] Created volume successfully. Aug 26 14:43:21 devstack sudo[114839]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:21 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-2212eea1-9f97-4cf8-8f45-8fdae67cf12a tempest-ProjectReaderTests-1882876355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-26639f24-eac2-4f8d-83a6-a6ca133b7059" returned: 0 in 0.357s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:21 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-2212eea1-9f97-4cf8-8f45-8fdae67cf12a tempest-ProjectReaderTests-1882876355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-26639f24-eac2-4f8d-83a6-a6ca133b7059 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:21 devstack sudo[114847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-26639f24-eac2-4f8d-83a6-a6ca133b7059 Aug 26 14:43:21 devstack sudo[114847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:22 devstack sudo[114842]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:22 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-de4790e2-9ef0-4f36-9d33-1fb9779794b4 tempest-ProjectMemberTests-1774785373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5efd68d6-e817-4332-a155-f5f387ea4695 1073741824" returned: 0 in 0.440s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:22 devstack sudo[114847]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:22 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-2212eea1-9f97-4cf8-8f45-8fdae67cf12a tempest-ProjectReaderTests-1882876355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-26639f24-eac2-4f8d-83a6-a6ca133b7059" returned: 0 in 0.266s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:22 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-2212eea1-9f97-4cf8-8f45-8fdae67cf12a tempest-ProjectReaderTests-1882876355 None] Lock "cinder-quobyte-26639f24-eac2-4f8d-83a6-a6ca133b7059" released by "delete_volume" :: held 0.694s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:43:22 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-de4790e2-9ef0-4f36-9d33-1fb9779794b4 tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5efd68d6-e817-4332-a155-f5f387ea4695 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:22 devstack sudo[114853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5efd68d6-e817-4332-a155-f5f387ea4695 Aug 26 14:43:22 devstack sudo[114853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:22 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-2212eea1-9f97-4cf8-8f45-8fdae67cf12a tempest-ProjectReaderTests-1882876355 None] Created reservations ['8364f139-8f4f-4d68-9d6a-fe9c92e617c5', '7eb7e3a4-18e8-44b1-a6b7-0973b4fc1947', '02cb7928-c5c8-45ac-8ff3-88fe3782081d', '4b0b4c19-0396-498c-b7ca-29d695eb5e74'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:43:22 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-2212eea1-9f97-4cf8-8f45-8fdae67cf12a tempest-ProjectReaderTests-1882876355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:43:22 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-2212eea1-9f97-4cf8-8f45-8fdae67cf12a tempest-ProjectReaderTests-1882876355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:43:22 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-2212eea1-9f97-4cf8-8f45-8fdae67cf12a tempest-ProjectReaderTests-1882876355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:43:22 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-2212eea1-9f97-4cf8-8f45-8fdae67cf12a tempest-ProjectReaderTests-1882876355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:43:22 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-2212eea1-9f97-4cf8-8f45-8fdae67cf12a tempest-ProjectReaderTests-1882876355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:43:22 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-2212eea1-9f97-4cf8-8f45-8fdae67cf12a tempest-ProjectReaderTests-1882876355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:22 devstack sudo[114855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:43:22 devstack sudo[114855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:22 devstack sudo[114853]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:22 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-de4790e2-9ef0-4f36-9d33-1fb9779794b4 tempest-ProjectMemberTests-1774785373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5efd68d6-e817-4332-a155-f5f387ea4695" returned: 0 in 0.244s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:22 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-de4790e2-9ef0-4f36-9d33-1fb9779794b4 tempest-ProjectMemberTests-1774785373 None] <== create_volume: return (748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:43:22 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-de4790e2-9ef0-4f36-9d33-1fb9779794b4 tempest-ProjectMemberTests-1774785373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.753s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:43:22 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-de4790e2-9ef0-4f36-9d33-1fb9779794b4 tempest-ProjectMemberTests-1774785373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88620c1b-73e7-4d9f-8d49-07bd3295fd0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5efd68d6-e817-4332-a155-f5f387ea4695', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:43:22 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-de4790e2-9ef0-4f36-9d33-1fb9779794b4 tempest-ProjectMemberTests-1774785373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c3de37c-d515-405b-9285-bee4bcb6a708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:43:22 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-de4790e2-9ef0-4f36-9d33-1fb9779794b4 tempest-ProjectMemberTests-1774785373 None] Volume volume-5efd68d6-e817-4332-a155-f5f387ea4695 (5efd68d6-e817-4332-a155-f5f387ea4695): created successfully Aug 26 14:43:22 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-de4790e2-9ef0-4f36-9d33-1fb9779794b4 tempest-ProjectMemberTests-1774785373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c3de37c-d515-405b-9285-bee4bcb6a708) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:43:22 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-de4790e2-9ef0-4f36-9d33-1fb9779794b4 tempest-ProjectMemberTests-1774785373 None] Flow 'volume_create_manager' (3a6a801a-c17b-4f50-a6e3-7e3eee4136b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:43:22 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-de4790e2-9ef0-4f36-9d33-1fb9779794b4 tempest-ProjectMemberTests-1774785373 None] Created volume successfully. Aug 26 14:43:22 devstack sudo[114855]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:22 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-2212eea1-9f97-4cf8-8f45-8fdae67cf12a tempest-ProjectReaderTests-1882876355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.258s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:22 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-2212eea1-9f97-4cf8-8f45-8fdae67cf12a tempest-ProjectReaderTests-1882876355 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:43:22 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-2212eea1-9f97-4cf8-8f45-8fdae67cf12a tempest-ProjectReaderTests-1882876355 None] Deleted volume successfully. Aug 26 14:43:22 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-2212eea1-9f97-4cf8-8f45-8fdae67cf12a tempest-ProjectReaderTests-1882876355 None] Lock "cinder-26639f24-eac2-4f8d-83a6-a6ca133b7059-delete_volume" released by "delete_volume" :: held 1.186s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:43:22 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-3b02f84c-ace8-4fcc-965e-2722afe3fc24 tempest-SnapshotDependencyTests-1763346707 None] Acquiring lock "cinder-2f4c3f07-740f-4cd8-9aa1-a03a4d8a9478-delete_snapshot" by "delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:43:22 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-3b02f84c-ace8-4fcc-965e-2722afe3fc24 tempest-SnapshotDependencyTests-1763346707 None] Lock "cinder-2f4c3f07-740f-4cd8-9aa1-a03a4d8a9478-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:43:22 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-3b02f84c-ace8-4fcc-965e-2722afe3fc24 tempest-SnapshotDependencyTests-1763346707 None] Acquiring lock "cinder-quobyte-b46cb88f-ab5a-4681-a203-ce75f06bbd58" by "delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:43:22 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-3b02f84c-ace8-4fcc-965e-2722afe3fc24 tempest-SnapshotDependencyTests-1763346707 None] Lock "cinder-quobyte-b46cb88f-ab5a-4681-a203-ce75f06bbd58" acquired by "delete_snapshot" :: waited 0.017s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:43:22 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-3b02f84c-ace8-4fcc-965e-2722afe3fc24 tempest-SnapshotDependencyTests-1763346707 None] Acquiring lock "cinder-quobyte-2f4c3f07-740f-4cd8-9aa1-a03a4d8a9478" by "_delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:43:22 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-3b02f84c-ace8-4fcc-965e-2722afe3fc24 tempest-SnapshotDependencyTests-1763346707 None] Lock "cinder-quobyte-2f4c3f07-740f-4cd8-9aa1-a03a4d8a9478" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:43:22 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-3b02f84c-ace8-4fcc-965e-2722afe3fc24 tempest-SnapshotDependencyTests-1763346707 None] Deleting offline snapshot 2f4c3f07-740f-4cd8-9aa1-a03a4d8a9478 of volume b46cb88f-ab5a-4681-a203-ce75f06bbd58 {{(pid=94394) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 14:43:22 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-3b02f84c-ace8-4fcc-965e-2722afe3fc24 tempest-SnapshotDependencyTests-1763346707 None] snapshot_file for this snap is: volume-b46cb88f-ab5a-4681-a203-ce75f06bbd58.2f4c3f07-740f-4cd8-9aa1-a03a4d8a9478 {{(pid=94394) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 14:43:22 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[066a9b52-163a-43fb-ba5c-019200dc39fa]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:43:22 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-3b02f84c-ace8-4fcc-965e-2722afe3fc24 tempest-SnapshotDependencyTests-1763346707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b46cb88f-ab5a-4681-a203-ce75f06bbd58.2f4c3f07-740f-4cd8-9aa1-a03a4d8a9478 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:22 devstack sudo[114859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b46cb88f-ab5a-4681-a203-ce75f06bbd58.2f4c3f07-740f-4cd8-9aa1-a03a4d8a9478 Aug 26 14:43:22 devstack sudo[114859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:22 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-5acb6255-6cee-4f63-a811-82e2aafdcdee tempest-ProjectMemberTests-1774785373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:43:22 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-5acb6255-6cee-4f63-a811-82e2aafdcdee tempest-ProjectMemberTests-1774785373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:43:22 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-5acb6255-6cee-4f63-a811-82e2aafdcdee tempest-ProjectMemberTests-1774785373 None] Creating offline snapshot 5ebf3940-0299-48e4-99f1-121be28db34b of volume 5efd68d6-e817-4332-a155-f5f387ea4695 {{(pid=94394) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 14:43:22 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4f754d3-6cd2-4a5d-a46a-1684bba7b5e3]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:43:22 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-5acb6255-6cee-4f63-a811-82e2aafdcdee tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5efd68d6-e817-4332-a155-f5f387ea4695 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:23 devstack sudo[114862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5efd68d6-e817-4332-a155-f5f387ea4695 Aug 26 14:43:23 devstack sudo[114862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:23 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-429659cf-6c94-4b99-9c76-152b3f95aae7 tempest-ProjectReaderTests-1882876355 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:43:23 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-429659cf-6c94-4b99-9c76-152b3f95aae7 tempest-ProjectReaderTests-1882876355 None] Flow 'volume_create_manager' (1b379bed-4096-40f4-9b02-1749c7c2d579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:43:23 devstack sudo[114859]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:23 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-429659cf-6c94-4b99-9c76-152b3f95aae7 tempest-ProjectReaderTests-1882876355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d6a3af6-5dce-414b-8bcc-ffd43cee4a83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:43:23 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-3b02f84c-ace8-4fcc-965e-2722afe3fc24 tempest-SnapshotDependencyTests-1763346707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b46cb88f-ab5a-4681-a203-ce75f06bbd58.2f4c3f07-740f-4cd8-9aa1-a03a4d8a9478" returned: 0 in 0.432s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:23 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-3b02f84c-ace8-4fcc-965e-2722afe3fc24 tempest-SnapshotDependencyTests-1763346707 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b46cb88f-ab5a-4681-a203-ce75f06bbd58(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94394) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 14:43:23 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-429659cf-6c94-4b99-9c76-152b3f95aae7 tempest-ProjectReaderTests-1882876355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d6a3af6-5dce-414b-8bcc-ffd43cee4a83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:43:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-368351731',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9da374be-a708-44fe-9b81-63ecaf04cd74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57364cca92024529a3a58d2a3e634ba3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:43:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:43:23Z,use_quota=True,user_id='23a9f0a2e5524f5485f0d17c6acdc640',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:43:23 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-429659cf-6c94-4b99-9c76-152b3f95aae7 tempest-ProjectReaderTests-1882876355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56f88b4d-480c-4120-b42b-68ee0e270e49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:43:23 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-429659cf-6c94-4b99-9c76-152b3f95aae7 tempest-ProjectReaderTests-1882876355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56f88b4d-480c-4120-b42b-68ee0e270e49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:43:23 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-429659cf-6c94-4b99-9c76-152b3f95aae7 tempest-ProjectReaderTests-1882876355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b3365c7-0ab1-489f-83cf-ec75fcc275f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:43:23 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-429659cf-6c94-4b99-9c76-152b3f95aae7 tempest-ProjectReaderTests-1882876355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b3365c7-0ab1-489f-83cf-ec75fcc275f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9da374be-a708-44fe-9b81-63ecaf04cd74', 'volume_name': 'volume-9da374be-a708-44fe-9b81-63ecaf04cd74', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:43:23 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-429659cf-6c94-4b99-9c76-152b3f95aae7 tempest-ProjectReaderTests-1882876355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4d7084f-da1d-49cc-a460-88fcde93efb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:43:23 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-429659cf-6c94-4b99-9c76-152b3f95aae7 tempest-ProjectReaderTests-1882876355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4d7084f-da1d-49cc-a460-88fcde93efb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:43:23 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-429659cf-6c94-4b99-9c76-152b3f95aae7 tempest-ProjectReaderTests-1882876355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8606cc08-8c33-48cb-aac1-a5485feebc6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:43:23 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-429659cf-6c94-4b99-9c76-152b3f95aae7 tempest-ProjectReaderTests-1882876355 None] Volume 9da374be-a708-44fe-9b81-63ecaf04cd74: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9da374be-a708-44fe-9b81-63ecaf04cd74', 'volume_size': 1} Aug 26 14:43:23 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-429659cf-6c94-4b99-9c76-152b3f95aae7 tempest-ProjectReaderTests-1882876355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:43:23 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b5bc03d-55b1-4ac0-9997-9ae99337bec1]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:43:23 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-3b02f84c-ace8-4fcc-965e-2722afe3fc24 tempest-SnapshotDependencyTests-1763346707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b46cb88f-ab5a-4681-a203-ce75f06bbd58 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:23 devstack sudo[114867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b46cb88f-ab5a-4681-a203-ce75f06bbd58 Aug 26 14:43:23 devstack sudo[114867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:23 devstack sudo[114862]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:23 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-5acb6255-6cee-4f63-a811-82e2aafdcdee tempest-ProjectMemberTests-1774785373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5efd68d6-e817-4332-a155-f5f387ea4695" returned: 0 in 0.390s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:23 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-5acb6255-6cee-4f63-a811-82e2aafdcdee tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5efd68d6-e817-4332-a155-f5f387ea4695,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5efd68d6-e817-4332-a155-f5f387ea4695.5ebf3940-0299-48e4-99f1-121be28db34b 1G {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:23 devstack sudo[114872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5efd68d6-e817-4332-a155-f5f387ea4695,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5efd68d6-e817-4332-a155-f5f387ea4695.5ebf3940-0299-48e4-99f1-121be28db34b 1G Aug 26 14:43:23 devstack sudo[114872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:23 devstack sudo[114872]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:23 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-5acb6255-6cee-4f63-a811-82e2aafdcdee tempest-ProjectMemberTests-1774785373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5efd68d6-e817-4332-a155-f5f387ea4695,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5efd68d6-e817-4332-a155-f5f387ea4695.5ebf3940-0299-48e4-99f1-121be28db34b 1G" returned: 0 in 0.374s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:23 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-5acb6255-6cee-4f63-a811-82e2aafdcdee tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5efd68d6-e817-4332-a155-f5f387ea4695 -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5efd68d6-e817-4332-a155-f5f387ea4695.5ebf3940-0299-48e4-99f1-121be28db34b {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:23 devstack sudo[114867]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:23 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-3b02f84c-ace8-4fcc-965e-2722afe3fc24 tempest-SnapshotDependencyTests-1763346707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b46cb88f-ab5a-4681-a203-ce75f06bbd58" returned: 0 in 0.548s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:23 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-3b02f84c-ace8-4fcc-965e-2722afe3fc24 tempest-SnapshotDependencyTests-1763346707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b46cb88f-ab5a-4681-a203-ce75f06bbd58.2f4c3f07-740f-4cd8-9aa1-a03a4d8a9478 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:23 devstack sudo[114882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5efd68d6-e817-4332-a155-f5f387ea4695 -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5efd68d6-e817-4332-a155-f5f387ea4695.5ebf3940-0299-48e4-99f1-121be28db34b Aug 26 14:43:23 devstack sudo[114882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:23 devstack sudo[114883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b46cb88f-ab5a-4681-a203-ce75f06bbd58.2f4c3f07-740f-4cd8-9aa1-a03a4d8a9478 Aug 26 14:43:23 devstack sudo[114883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:24 devstack sudo[114882]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:24 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-5acb6255-6cee-4f63-a811-82e2aafdcdee tempest-ProjectMemberTests-1774785373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5efd68d6-e817-4332-a155-f5f387ea4695 -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5efd68d6-e817-4332-a155-f5f387ea4695.5ebf3940-0299-48e4-99f1-121be28db34b" returned: 0 in 0.311s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:24 devstack cinder-volume[94394]: WARNING cinder.volume.drivers.remotefs [None req-5acb6255-6cee-4f63-a811-82e2aafdcdee tempest-ProjectMemberTests-1774785373 None] /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5efd68d6-e817-4332-a155-f5f387ea4695.5ebf3940-0299-48e4-99f1-121be28db34b is being set with open permissions: ugo+rw Aug 26 14:43:24 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-5acb6255-6cee-4f63-a811-82e2aafdcdee tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5efd68d6-e817-4332-a155-f5f387ea4695.5ebf3940-0299-48e4-99f1-121be28db34b {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:24 devstack sudo[114892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5efd68d6-e817-4332-a155-f5f387ea4695.5ebf3940-0299-48e4-99f1-121be28db34b Aug 26 14:43:24 devstack sudo[114892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:24 devstack sudo[114883]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:24 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-3b02f84c-ace8-4fcc-965e-2722afe3fc24 tempest-SnapshotDependencyTests-1763346707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b46cb88f-ab5a-4681-a203-ce75f06bbd58.2f4c3f07-740f-4cd8-9aa1-a03a4d8a9478" returned: 0 in 0.348s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:24 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-3b02f84c-ace8-4fcc-965e-2722afe3fc24 tempest-SnapshotDependencyTests-1763346707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b46cb88f-ab5a-4681-a203-ce75f06bbd58.2f4c3f07-740f-4cd8-9aa1-a03a4d8a9478 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:24 devstack sudo[114894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b46cb88f-ab5a-4681-a203-ce75f06bbd58.2f4c3f07-740f-4cd8-9aa1-a03a4d8a9478 Aug 26 14:43:24 devstack sudo[114894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:24 devstack sudo[114892]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:24 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-5acb6255-6cee-4f63-a811-82e2aafdcdee tempest-ProjectMemberTests-1774785373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5efd68d6-e817-4332-a155-f5f387ea4695.5ebf3940-0299-48e4-99f1-121be28db34b" returned: 0 in 0.246s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:24 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-5acb6255-6cee-4f63-a811-82e2aafdcdee tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5efd68d6-e817-4332-a155-f5f387ea4695.info {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:24 devstack sudo[114898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5efd68d6-e817-4332-a155-f5f387ea4695.info Aug 26 14:43:24 devstack sudo[114898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:24 devstack sudo[114894]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:24 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-3b02f84c-ace8-4fcc-965e-2722afe3fc24 tempest-SnapshotDependencyTests-1763346707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b46cb88f-ab5a-4681-a203-ce75f06bbd58.2f4c3f07-740f-4cd8-9aa1-a03a4d8a9478" returned: 0 in 0.250s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:24 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-3b02f84c-ace8-4fcc-965e-2722afe3fc24 tempest-SnapshotDependencyTests-1763346707 None] Lock "cinder-quobyte-2f4c3f07-740f-4cd8-9aa1-a03a4d8a9478" released by "_delete_snapshot" :: held 1.724s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:43:24 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-3b02f84c-ace8-4fcc-965e-2722afe3fc24 tempest-SnapshotDependencyTests-1763346707 None] Lock "cinder-quobyte-b46cb88f-ab5a-4681-a203-ce75f06bbd58" released by "delete_snapshot" :: held 1.752s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:43:24 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-3b02f84c-ace8-4fcc-965e-2722afe3fc24 tempest-SnapshotDependencyTests-1763346707 None] Created reservations ['9927cc5d-08e5-40c2-a2a8-8c47cf23e411', '300af038-f46e-4095-8d76-008eb92e285c', '0b12937a-4514-4230-ac0a-3818e27a99d6', 'fc1f27f6-deb1-40d7-8155-eb91c03478df'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:43:24 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-3b02f84c-ace8-4fcc-965e-2722afe3fc24 tempest-SnapshotDependencyTests-1763346707 None] Delete snapshot completed successfully. Aug 26 14:43:24 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-3b02f84c-ace8-4fcc-965e-2722afe3fc24 tempest-SnapshotDependencyTests-1763346707 None] Lock "cinder-2f4c3f07-740f-4cd8-9aa1-a03a4d8a9478-delete_snapshot" released by "delete_snapshot" :: held 1.882s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:43:24 devstack sudo[114898]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:24 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-5acb6255-6cee-4f63-a811-82e2aafdcdee tempest-ProjectMemberTests-1774785373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5efd68d6-e817-4332-a155-f5f387ea4695.info" returned: 0 in 0.252s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:24 devstack cinder-volume[94394]: WARNING cinder.volume.drivers.remotefs [None req-5acb6255-6cee-4f63-a811-82e2aafdcdee tempest-ProjectMemberTests-1774785373 None] /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5efd68d6-e817-4332-a155-f5f387ea4695.info is being set with open permissions: ugo+rw Aug 26 14:43:24 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-5acb6255-6cee-4f63-a811-82e2aafdcdee tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5efd68d6-e817-4332-a155-f5f387ea4695.info {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:24 devstack sudo[114901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5efd68d6-e817-4332-a155-f5f387ea4695.info Aug 26 14:43:24 devstack sudo[114901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:24 devstack sudo[114901]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:24 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-5acb6255-6cee-4f63-a811-82e2aafdcdee tempest-ProjectMemberTests-1774785373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5efd68d6-e817-4332-a155-f5f387ea4695.info" returned: 0 in 0.236s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:24 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-5acb6255-6cee-4f63-a811-82e2aafdcdee tempest-ProjectMemberTests-1774785373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.888s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:43:24 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-429659cf-6c94-4b99-9c76-152b3f95aae7 tempest-ProjectReaderTests-1882876355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.629s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:43:24 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-429659cf-6c94-4b99-9c76-152b3f95aae7 tempest-ProjectReaderTests-1882876355 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:43:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-368351731',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9da374be-a708-44fe-9b81-63ecaf04cd74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57364cca92024529a3a58d2a3e634ba3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:43:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:43:23Z,use_quota=True,user_id='23a9f0a2e5524f5485f0d17c6acdc640',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:43:24 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-429659cf-6c94-4b99-9c76-152b3f95aae7 tempest-ProjectReaderTests-1882876355 None] Creating volume 9da374be-a708-44fe-9b81-63ecaf04cd74 {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:43:24 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-429659cf-6c94-4b99-9c76-152b3f95aae7 tempest-ProjectReaderTests-1882876355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:43:24 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-429659cf-6c94-4b99-9c76-152b3f95aae7 tempest-ProjectReaderTests-1882876355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:43:24 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-429659cf-6c94-4b99-9c76-152b3f95aae7 tempest-ProjectReaderTests-1882876355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:43:24 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-429659cf-6c94-4b99-9c76-152b3f95aae7 tempest-ProjectReaderTests-1882876355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:43:24 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-429659cf-6c94-4b99-9c76-152b3f95aae7 tempest-ProjectReaderTests-1882876355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:43:24 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-429659cf-6c94-4b99-9c76-152b3f95aae7 tempest-ProjectReaderTests-1882876355 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:43:24 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-429659cf-6c94-4b99-9c76-152b3f95aae7 tempest-ProjectReaderTests-1882876355 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:43:24 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-429659cf-6c94-4b99-9c76-152b3f95aae7 tempest-ProjectReaderTests-1882876355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9da374be-a708-44fe-9b81-63ecaf04cd74 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:24 devstack sudo[114904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9da374be-a708-44fe-9b81-63ecaf04cd74 1073741824 Aug 26 14:43:24 devstack sudo[114904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:24 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-5acb6255-6cee-4f63-a811-82e2aafdcdee tempest-ProjectMemberTests-1774785373 None] Create snapshot completed successfully Aug 26 14:43:24 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-157b97b1-bc46-4221-8067-f00d501a0913 tempest-SnapshotDependencyTests-1763346707 None] Acquiring lock "cinder-b46cb88f-ab5a-4681-a203-ce75f06bbd58-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:43:24 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-157b97b1-bc46-4221-8067-f00d501a0913 tempest-SnapshotDependencyTests-1763346707 None] Lock "cinder-b46cb88f-ab5a-4681-a203-ce75f06bbd58-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:43:24 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-157b97b1-bc46-4221-8067-f00d501a0913 tempest-SnapshotDependencyTests-1763346707 None] Acquiring lock "cinder-quobyte-b46cb88f-ab5a-4681-a203-ce75f06bbd58" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:43:25 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-f7933bde-4df0-4578-93b0-aeb55abd7ff4 tempest-ProjectMemberTests-1774785373 None] Acquiring lock "cinder-5ebf3940-0299-48e4-99f1-121be28db34b-delete_snapshot" by "delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:43:25 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-157b97b1-bc46-4221-8067-f00d501a0913 tempest-SnapshotDependencyTests-1763346707 None] Lock "cinder-quobyte-b46cb88f-ab5a-4681-a203-ce75f06bbd58" acquired by "delete_volume" :: waited 0.045s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:43:25 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-f7933bde-4df0-4578-93b0-aeb55abd7ff4 tempest-ProjectMemberTests-1774785373 None] Lock "cinder-5ebf3940-0299-48e4-99f1-121be28db34b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.068s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:43:25 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-f7933bde-4df0-4578-93b0-aeb55abd7ff4 tempest-ProjectMemberTests-1774785373 None] Acquiring lock "cinder-quobyte-5efd68d6-e817-4332-a155-f5f387ea4695" by "delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:43:25 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-f7933bde-4df0-4578-93b0-aeb55abd7ff4 tempest-ProjectMemberTests-1774785373 None] Lock "cinder-quobyte-5efd68d6-e817-4332-a155-f5f387ea4695" acquired by "delete_snapshot" :: waited 0.018s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:43:25 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-f7933bde-4df0-4578-93b0-aeb55abd7ff4 tempest-ProjectMemberTests-1774785373 None] Acquiring lock "cinder-quobyte-5ebf3940-0299-48e4-99f1-121be28db34b" by "_delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:43:25 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[11e8ae9c-8502-4ee1-a314-2dbcff87ac9c]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:43:25 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-157b97b1-bc46-4221-8067-f00d501a0913 tempest-SnapshotDependencyTests-1763346707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b46cb88f-ab5a-4681-a203-ce75f06bbd58 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:25 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-f7933bde-4df0-4578-93b0-aeb55abd7ff4 tempest-ProjectMemberTests-1774785373 None] Lock "cinder-quobyte-5ebf3940-0299-48e4-99f1-121be28db34b" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:43:25 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-f7933bde-4df0-4578-93b0-aeb55abd7ff4 tempest-ProjectMemberTests-1774785373 None] Deleting offline snapshot 5ebf3940-0299-48e4-99f1-121be28db34b of volume 5efd68d6-e817-4332-a155-f5f387ea4695 {{(pid=94394) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 14:43:25 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-f7933bde-4df0-4578-93b0-aeb55abd7ff4 tempest-ProjectMemberTests-1774785373 None] snapshot_file for this snap is: volume-5efd68d6-e817-4332-a155-f5f387ea4695.5ebf3940-0299-48e4-99f1-121be28db34b {{(pid=94394) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 14:43:25 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c5266b3-cfa9-4bd7-8347-407488b6c32d]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:43:25 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-f7933bde-4df0-4578-93b0-aeb55abd7ff4 tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5efd68d6-e817-4332-a155-f5f387ea4695.5ebf3940-0299-48e4-99f1-121be28db34b {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:25 devstack sudo[114908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b46cb88f-ab5a-4681-a203-ce75f06bbd58 Aug 26 14:43:25 devstack sudo[114908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:25 devstack sudo[114910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5efd68d6-e817-4332-a155-f5f387ea4695.5ebf3940-0299-48e4-99f1-121be28db34b Aug 26 14:43:25 devstack sudo[114910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:25 devstack sudo[114904]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:25 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-429659cf-6c94-4b99-9c76-152b3f95aae7 tempest-ProjectReaderTests-1882876355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9da374be-a708-44fe-9b81-63ecaf04cd74 1073741824" returned: 0 in 0.494s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:25 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-429659cf-6c94-4b99-9c76-152b3f95aae7 tempest-ProjectReaderTests-1882876355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9da374be-a708-44fe-9b81-63ecaf04cd74 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:25 devstack sudo[114913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9da374be-a708-44fe-9b81-63ecaf04cd74 Aug 26 14:43:25 devstack sudo[114913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:25 devstack sudo[114908]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:25 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-157b97b1-bc46-4221-8067-f00d501a0913 tempest-SnapshotDependencyTests-1763346707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b46cb88f-ab5a-4681-a203-ce75f06bbd58" returned: 0 in 0.395s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:25 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-157b97b1-bc46-4221-8067-f00d501a0913 tempest-SnapshotDependencyTests-1763346707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b46cb88f-ab5a-4681-a203-ce75f06bbd58 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:25 devstack sudo[114910]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:25 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-f7933bde-4df0-4578-93b0-aeb55abd7ff4 tempest-ProjectMemberTests-1774785373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5efd68d6-e817-4332-a155-f5f387ea4695.5ebf3940-0299-48e4-99f1-121be28db34b" returned: 0 in 0.363s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:25 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-f7933bde-4df0-4578-93b0-aeb55abd7ff4 tempest-ProjectMemberTests-1774785373 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5efd68d6-e817-4332-a155-f5f387ea4695(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94394) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 14:43:25 devstack sudo[114921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b46cb88f-ab5a-4681-a203-ce75f06bbd58 Aug 26 14:43:25 devstack sudo[114921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:25 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[d074033a-d4a4-4ccd-bc45-e1d63691536a]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:43:25 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-f7933bde-4df0-4578-93b0-aeb55abd7ff4 tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5efd68d6-e817-4332-a155-f5f387ea4695 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:25 devstack sudo[114913]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:25 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-429659cf-6c94-4b99-9c76-152b3f95aae7 tempest-ProjectReaderTests-1882876355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9da374be-a708-44fe-9b81-63ecaf04cd74" returned: 0 in 0.251s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:25 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-429659cf-6c94-4b99-9c76-152b3f95aae7 tempest-ProjectReaderTests-1882876355 None] <== create_volume: return (786ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:43:25 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-429659cf-6c94-4b99-9c76-152b3f95aae7 tempest-ProjectReaderTests-1882876355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.789s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:43:25 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-429659cf-6c94-4b99-9c76-152b3f95aae7 tempest-ProjectReaderTests-1882876355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8606cc08-8c33-48cb-aac1-a5485feebc6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9da374be-a708-44fe-9b81-63ecaf04cd74', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:43:25 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-429659cf-6c94-4b99-9c76-152b3f95aae7 tempest-ProjectReaderTests-1882876355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (faec3a29-5ea5-42ba-89a8-4a1adf0bbc2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:43:25 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-429659cf-6c94-4b99-9c76-152b3f95aae7 tempest-ProjectReaderTests-1882876355 None] Volume volume-9da374be-a708-44fe-9b81-63ecaf04cd74 (9da374be-a708-44fe-9b81-63ecaf04cd74): created successfully Aug 26 14:43:25 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-429659cf-6c94-4b99-9c76-152b3f95aae7 tempest-ProjectReaderTests-1882876355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (faec3a29-5ea5-42ba-89a8-4a1adf0bbc2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:43:25 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-429659cf-6c94-4b99-9c76-152b3f95aae7 tempest-ProjectReaderTests-1882876355 None] Flow 'volume_create_manager' (1b379bed-4096-40f4-9b02-1749c7c2d579) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:43:25 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-429659cf-6c94-4b99-9c76-152b3f95aae7 tempest-ProjectReaderTests-1882876355 None] Created volume successfully. Aug 26 14:43:25 devstack sudo[114924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5efd68d6-e817-4332-a155-f5f387ea4695 Aug 26 14:43:25 devstack sudo[114924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:25 devstack sudo[114921]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:25 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-157b97b1-bc46-4221-8067-f00d501a0913 tempest-SnapshotDependencyTests-1763346707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b46cb88f-ab5a-4681-a203-ce75f06bbd58" returned: 0 in 0.279s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:25 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-157b97b1-bc46-4221-8067-f00d501a0913 tempest-SnapshotDependencyTests-1763346707 None] Lock "cinder-quobyte-b46cb88f-ab5a-4681-a203-ce75f06bbd58" released by "delete_volume" :: held 0.761s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:43:25 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-157b97b1-bc46-4221-8067-f00d501a0913 tempest-SnapshotDependencyTests-1763346707 None] Created reservations ['0863c6a8-3cfa-41b5-b08c-7559d4342a42', 'e78749ce-4dab-41a3-9b21-ed4e3c145704', 'b0739b2b-73c0-4bcd-ab60-799fb9dc2532', '6e1c0176-56a2-49c2-8191-0c88997f6a16'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:43:25 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-157b97b1-bc46-4221-8067-f00d501a0913 tempest-SnapshotDependencyTests-1763346707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:43:25 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-157b97b1-bc46-4221-8067-f00d501a0913 tempest-SnapshotDependencyTests-1763346707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:43:25 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-157b97b1-bc46-4221-8067-f00d501a0913 tempest-SnapshotDependencyTests-1763346707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:43:25 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-157b97b1-bc46-4221-8067-f00d501a0913 tempest-SnapshotDependencyTests-1763346707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:43:25 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-157b97b1-bc46-4221-8067-f00d501a0913 tempest-SnapshotDependencyTests-1763346707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:43:25 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-157b97b1-bc46-4221-8067-f00d501a0913 tempest-SnapshotDependencyTests-1763346707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:25 devstack sudo[114924]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:25 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-f7933bde-4df0-4578-93b0-aeb55abd7ff4 tempest-ProjectMemberTests-1774785373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5efd68d6-e817-4332-a155-f5f387ea4695" returned: 0 in 0.382s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:25 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-f7933bde-4df0-4578-93b0-aeb55abd7ff4 tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5efd68d6-e817-4332-a155-f5f387ea4695.5ebf3940-0299-48e4-99f1-121be28db34b {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:25 devstack sudo[114930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:43:25 devstack sudo[114930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:25 devstack sudo[114931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5efd68d6-e817-4332-a155-f5f387ea4695.5ebf3940-0299-48e4-99f1-121be28db34b Aug 26 14:43:25 devstack sudo[114931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:26 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-55906dc2-0f6e-43ca-8bcd-81dd0e1aa49d tempest-SnapshotDependencyTests-1763346707 None] Acquiring lock "cinder-47608d8e-6d8f-4e7e-bb37-5f59f824df68-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:43:26 devstack sudo[114930]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:26 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-55906dc2-0f6e-43ca-8bcd-81dd0e1aa49d tempest-SnapshotDependencyTests-1763346707 None] Lock "cinder-47608d8e-6d8f-4e7e-bb37-5f59f824df68-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:43:26 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-157b97b1-bc46-4221-8067-f00d501a0913 tempest-SnapshotDependencyTests-1763346707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.281s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:26 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-157b97b1-bc46-4221-8067-f00d501a0913 tempest-SnapshotDependencyTests-1763346707 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:43:26 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-157b97b1-bc46-4221-8067-f00d501a0913 tempest-SnapshotDependencyTests-1763346707 None] Deleted volume successfully. Aug 26 14:43:26 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-157b97b1-bc46-4221-8067-f00d501a0913 tempest-SnapshotDependencyTests-1763346707 None] Lock "cinder-b46cb88f-ab5a-4681-a203-ce75f06bbd58-delete_volume" released by "delete_volume" :: held 1.298s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:43:26 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-55906dc2-0f6e-43ca-8bcd-81dd0e1aa49d tempest-SnapshotDependencyTests-1763346707 None] Acquiring lock "cinder-quobyte-47608d8e-6d8f-4e7e-bb37-5f59f824df68" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:43:26 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-55906dc2-0f6e-43ca-8bcd-81dd0e1aa49d tempest-SnapshotDependencyTests-1763346707 None] Lock "cinder-quobyte-47608d8e-6d8f-4e7e-bb37-5f59f824df68" acquired by "delete_volume" :: waited 0.016s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:43:26 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[83fcbe2f-a321-482f-bd1f-db0a2e424249]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:43:26 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-55906dc2-0f6e-43ca-8bcd-81dd0e1aa49d tempest-SnapshotDependencyTests-1763346707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-47608d8e-6d8f-4e7e-bb37-5f59f824df68 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:26 devstack sudo[114931]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:26 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-f7933bde-4df0-4578-93b0-aeb55abd7ff4 tempest-ProjectMemberTests-1774785373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5efd68d6-e817-4332-a155-f5f387ea4695.5ebf3940-0299-48e4-99f1-121be28db34b" returned: 0 in 0.428s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:26 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-f7933bde-4df0-4578-93b0-aeb55abd7ff4 tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5efd68d6-e817-4332-a155-f5f387ea4695.5ebf3940-0299-48e4-99f1-121be28db34b {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:26 devstack sudo[114940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5efd68d6-e817-4332-a155-f5f387ea4695.5ebf3940-0299-48e4-99f1-121be28db34b Aug 26 14:43:26 devstack sudo[114940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:26 devstack sudo[114939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-47608d8e-6d8f-4e7e-bb37-5f59f824df68 Aug 26 14:43:26 devstack sudo[114939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:26 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-d24e9340-a315-4086-a514-93029470c885 tempest-ProjectReaderTests-1882876355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:43:26 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-d24e9340-a315-4086-a514-93029470c885 tempest-ProjectReaderTests-1882876355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:43:26 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-d24e9340-a315-4086-a514-93029470c885 tempest-ProjectReaderTests-1882876355 None] Creating offline snapshot b49f7e2a-5435-493d-befa-fe4af97be571 of volume 9da374be-a708-44fe-9b81-63ecaf04cd74 {{(pid=94394) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 14:43:26 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e503754-7afa-4025-905e-1e6f30d1f765]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:43:26 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-d24e9340-a315-4086-a514-93029470c885 tempest-ProjectReaderTests-1882876355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9da374be-a708-44fe-9b81-63ecaf04cd74 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:26 devstack sudo[114943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9da374be-a708-44fe-9b81-63ecaf04cd74 Aug 26 14:43:26 devstack sudo[114943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:26 devstack sudo[114940]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:26 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-f7933bde-4df0-4578-93b0-aeb55abd7ff4 tempest-ProjectMemberTests-1774785373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5efd68d6-e817-4332-a155-f5f387ea4695.5ebf3940-0299-48e4-99f1-121be28db34b" returned: 0 in 0.271s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:26 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-f7933bde-4df0-4578-93b0-aeb55abd7ff4 tempest-ProjectMemberTests-1774785373 None] Lock "cinder-quobyte-5ebf3940-0299-48e4-99f1-121be28db34b" released by "_delete_snapshot" :: held 1.541s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:43:26 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-f7933bde-4df0-4578-93b0-aeb55abd7ff4 tempest-ProjectMemberTests-1774785373 None] Lock "cinder-quobyte-5efd68d6-e817-4332-a155-f5f387ea4695" released by "delete_snapshot" :: held 1.575s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:43:26 devstack sudo[114939]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:26 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-55906dc2-0f6e-43ca-8bcd-81dd0e1aa49d tempest-SnapshotDependencyTests-1763346707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-47608d8e-6d8f-4e7e-bb37-5f59f824df68" returned: 0 in 0.394s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:26 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-55906dc2-0f6e-43ca-8bcd-81dd0e1aa49d tempest-SnapshotDependencyTests-1763346707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-47608d8e-6d8f-4e7e-bb37-5f59f824df68 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:26 devstack sudo[114949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-47608d8e-6d8f-4e7e-bb37-5f59f824df68 Aug 26 14:43:26 devstack sudo[114949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:26 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-f7933bde-4df0-4578-93b0-aeb55abd7ff4 tempest-ProjectMemberTests-1774785373 None] Created reservations ['40c0f85d-5e9e-41ef-b894-cb7944c9e2f6', 'f4c49cd1-ec85-4291-8453-fdad2c069c3a', 'ff17e46a-c84b-4018-8438-75017fe3c64d', '8d465a3d-d463-4aca-8f41-1c33cd497906'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:43:26 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-f7933bde-4df0-4578-93b0-aeb55abd7ff4 tempest-ProjectMemberTests-1774785373 None] Delete snapshot completed successfully. Aug 26 14:43:26 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-f7933bde-4df0-4578-93b0-aeb55abd7ff4 tempest-ProjectMemberTests-1774785373 None] Lock "cinder-5ebf3940-0299-48e4-99f1-121be28db34b-delete_snapshot" released by "delete_snapshot" :: held 1.752s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:43:26 devstack sudo[114943]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:26 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-d24e9340-a315-4086-a514-93029470c885 tempest-ProjectReaderTests-1882876355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9da374be-a708-44fe-9b81-63ecaf04cd74" returned: 0 in 0.394s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:26 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-d24e9340-a315-4086-a514-93029470c885 tempest-ProjectReaderTests-1882876355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9da374be-a708-44fe-9b81-63ecaf04cd74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9da374be-a708-44fe-9b81-63ecaf04cd74.b49f7e2a-5435-493d-befa-fe4af97be571 1G {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:26 devstack sudo[114954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9da374be-a708-44fe-9b81-63ecaf04cd74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9da374be-a708-44fe-9b81-63ecaf04cd74.b49f7e2a-5435-493d-befa-fe4af97be571 1G Aug 26 14:43:26 devstack sudo[114954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:26 devstack sudo[114949]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:26 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-55906dc2-0f6e-43ca-8bcd-81dd0e1aa49d tempest-SnapshotDependencyTests-1763346707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-47608d8e-6d8f-4e7e-bb37-5f59f824df68" returned: 0 in 0.278s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:26 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-55906dc2-0f6e-43ca-8bcd-81dd0e1aa49d tempest-SnapshotDependencyTests-1763346707 None] Lock "cinder-quobyte-47608d8e-6d8f-4e7e-bb37-5f59f824df68" released by "delete_volume" :: held 0.719s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:43:27 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-55906dc2-0f6e-43ca-8bcd-81dd0e1aa49d tempest-SnapshotDependencyTests-1763346707 None] Created reservations ['04a728f6-809e-4673-8ca4-016c718b6336', '03b4d907-c7fc-4be6-9c9c-be5f7341327b', '53e8ed90-6d76-4476-b408-634017250aad', '95f6a6b9-6c25-4e89-95c3-386629cbeb88'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:43:27 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-55906dc2-0f6e-43ca-8bcd-81dd0e1aa49d tempest-SnapshotDependencyTests-1763346707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:43:27 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-55906dc2-0f6e-43ca-8bcd-81dd0e1aa49d tempest-SnapshotDependencyTests-1763346707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:43:27 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-55906dc2-0f6e-43ca-8bcd-81dd0e1aa49d tempest-SnapshotDependencyTests-1763346707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:43:27 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-55906dc2-0f6e-43ca-8bcd-81dd0e1aa49d tempest-SnapshotDependencyTests-1763346707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:43:27 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-55906dc2-0f6e-43ca-8bcd-81dd0e1aa49d tempest-SnapshotDependencyTests-1763346707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:43:27 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-55906dc2-0f6e-43ca-8bcd-81dd0e1aa49d tempest-SnapshotDependencyTests-1763346707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:27 devstack sudo[114957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:43:27 devstack sudo[114957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:27 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-80af3cea-7b41-4e54-ac88-97e49a42a1d8 tempest-ProjectMemberTests-1774785373 None] Acquiring lock "cinder-5efd68d6-e817-4332-a155-f5f387ea4695-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:43:27 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-80af3cea-7b41-4e54-ac88-97e49a42a1d8 tempest-ProjectMemberTests-1774785373 None] Lock "cinder-5efd68d6-e817-4332-a155-f5f387ea4695-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:43:27 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-80af3cea-7b41-4e54-ac88-97e49a42a1d8 tempest-ProjectMemberTests-1774785373 None] Acquiring lock "cinder-quobyte-5efd68d6-e817-4332-a155-f5f387ea4695" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:43:27 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-80af3cea-7b41-4e54-ac88-97e49a42a1d8 tempest-ProjectMemberTests-1774785373 None] Lock "cinder-quobyte-5efd68d6-e817-4332-a155-f5f387ea4695" acquired by "delete_volume" :: waited 0.018s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:43:27 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[853b0d4e-721d-4614-8c40-0894100179f2]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:43:27 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-80af3cea-7b41-4e54-ac88-97e49a42a1d8 tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5efd68d6-e817-4332-a155-f5f387ea4695 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:27 devstack sudo[114957]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:27 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-55906dc2-0f6e-43ca-8bcd-81dd0e1aa49d tempest-SnapshotDependencyTests-1763346707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.296s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:27 devstack sudo[114954]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:27 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-55906dc2-0f6e-43ca-8bcd-81dd0e1aa49d tempest-SnapshotDependencyTests-1763346707 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:43:27 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-d24e9340-a315-4086-a514-93029470c885 tempest-ProjectReaderTests-1882876355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9da374be-a708-44fe-9b81-63ecaf04cd74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9da374be-a708-44fe-9b81-63ecaf04cd74.b49f7e2a-5435-493d-befa-fe4af97be571 1G" returned: 0 in 0.520s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:27 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-d24e9340-a315-4086-a514-93029470c885 tempest-ProjectReaderTests-1882876355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9da374be-a708-44fe-9b81-63ecaf04cd74 -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9da374be-a708-44fe-9b81-63ecaf04cd74.b49f7e2a-5435-493d-befa-fe4af97be571 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:27 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-55906dc2-0f6e-43ca-8bcd-81dd0e1aa49d tempest-SnapshotDependencyTests-1763346707 None] Deleted volume successfully. Aug 26 14:43:27 devstack sudo[114964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9da374be-a708-44fe-9b81-63ecaf04cd74 -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9da374be-a708-44fe-9b81-63ecaf04cd74.b49f7e2a-5435-493d-befa-fe4af97be571 Aug 26 14:43:27 devstack sudo[114964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:27 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-55906dc2-0f6e-43ca-8bcd-81dd0e1aa49d tempest-SnapshotDependencyTests-1763346707 None] Lock "cinder-47608d8e-6d8f-4e7e-bb37-5f59f824df68-delete_volume" released by "delete_volume" :: held 1.263s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:43:27 devstack sudo[114963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5efd68d6-e817-4332-a155-f5f387ea4695 Aug 26 14:43:27 devstack sudo[114963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:27 devstack sudo[114964]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:27 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-d24e9340-a315-4086-a514-93029470c885 tempest-ProjectReaderTests-1882876355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9da374be-a708-44fe-9b81-63ecaf04cd74 -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9da374be-a708-44fe-9b81-63ecaf04cd74.b49f7e2a-5435-493d-befa-fe4af97be571" returned: 0 in 0.346s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:27 devstack cinder-volume[94394]: WARNING cinder.volume.drivers.remotefs [None req-d24e9340-a315-4086-a514-93029470c885 tempest-ProjectReaderTests-1882876355 None] /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9da374be-a708-44fe-9b81-63ecaf04cd74.b49f7e2a-5435-493d-befa-fe4af97be571 is being set with open permissions: ugo+rw Aug 26 14:43:27 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-d24e9340-a315-4086-a514-93029470c885 tempest-ProjectReaderTests-1882876355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9da374be-a708-44fe-9b81-63ecaf04cd74.b49f7e2a-5435-493d-befa-fe4af97be571 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:27 devstack sudo[114963]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:27 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-80af3cea-7b41-4e54-ac88-97e49a42a1d8 tempest-ProjectMemberTests-1774785373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5efd68d6-e817-4332-a155-f5f387ea4695" returned: 0 in 0.406s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:27 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-80af3cea-7b41-4e54-ac88-97e49a42a1d8 tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5efd68d6-e817-4332-a155-f5f387ea4695 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:27 devstack sudo[114974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9da374be-a708-44fe-9b81-63ecaf04cd74.b49f7e2a-5435-493d-befa-fe4af97be571 Aug 26 14:43:27 devstack sudo[114974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:27 devstack sudo[114975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5efd68d6-e817-4332-a155-f5f387ea4695 Aug 26 14:43:27 devstack sudo[114975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:27 devstack sudo[114974]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:28 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-d24e9340-a315-4086-a514-93029470c885 tempest-ProjectReaderTests-1882876355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9da374be-a708-44fe-9b81-63ecaf04cd74.b49f7e2a-5435-493d-befa-fe4af97be571" returned: 0 in 0.254s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:28 devstack sudo[114975]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:28 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-80af3cea-7b41-4e54-ac88-97e49a42a1d8 tempest-ProjectMemberTests-1774785373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-5efd68d6-e817-4332-a155-f5f387ea4695" returned: 0 in 0.256s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:28 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-d24e9340-a315-4086-a514-93029470c885 tempest-ProjectReaderTests-1882876355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9da374be-a708-44fe-9b81-63ecaf04cd74.info {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:28 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-80af3cea-7b41-4e54-ac88-97e49a42a1d8 tempest-ProjectMemberTests-1774785373 None] Lock "cinder-quobyte-5efd68d6-e817-4332-a155-f5f387ea4695" released by "delete_volume" :: held 0.753s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:43:28 devstack sudo[114980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9da374be-a708-44fe-9b81-63ecaf04cd74.info Aug 26 14:43:28 devstack sudo[114980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:28 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-80af3cea-7b41-4e54-ac88-97e49a42a1d8 tempest-ProjectMemberTests-1774785373 None] Created reservations ['2ab5fd80-7b50-438b-86fc-7d93866eba78', '659e80b6-033b-4872-9a9a-e7cc5086ac57', '2eaec5e1-c031-41f0-bf27-8e44db2ee392', '9a2f92b2-5d61-47d6-8e8b-922682691a4f'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:43:28 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-80af3cea-7b41-4e54-ac88-97e49a42a1d8 tempest-ProjectMemberTests-1774785373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:43:28 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-80af3cea-7b41-4e54-ac88-97e49a42a1d8 tempest-ProjectMemberTests-1774785373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:43:28 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-80af3cea-7b41-4e54-ac88-97e49a42a1d8 tempest-ProjectMemberTests-1774785373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:43:28 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-80af3cea-7b41-4e54-ac88-97e49a42a1d8 tempest-ProjectMemberTests-1774785373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:43:28 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-80af3cea-7b41-4e54-ac88-97e49a42a1d8 tempest-ProjectMemberTests-1774785373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:43:28 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-80af3cea-7b41-4e54-ac88-97e49a42a1d8 tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:28 devstack sudo[114983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:43:28 devstack sudo[114983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:28 devstack sudo[114980]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:28 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-d24e9340-a315-4086-a514-93029470c885 tempest-ProjectReaderTests-1882876355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9da374be-a708-44fe-9b81-63ecaf04cd74.info" returned: 0 in 0.420s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:28 devstack cinder-volume[94394]: WARNING cinder.volume.drivers.remotefs [None req-d24e9340-a315-4086-a514-93029470c885 tempest-ProjectReaderTests-1882876355 None] /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9da374be-a708-44fe-9b81-63ecaf04cd74.info is being set with open permissions: ugo+rw Aug 26 14:43:28 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-d24e9340-a315-4086-a514-93029470c885 tempest-ProjectReaderTests-1882876355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9da374be-a708-44fe-9b81-63ecaf04cd74.info {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:28 devstack sudo[114986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9da374be-a708-44fe-9b81-63ecaf04cd74.info Aug 26 14:43:28 devstack sudo[114986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:28 devstack sudo[114983]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:28 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-80af3cea-7b41-4e54-ac88-97e49a42a1d8 tempest-ProjectMemberTests-1774785373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.268s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:28 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-80af3cea-7b41-4e54-ac88-97e49a42a1d8 tempest-ProjectMemberTests-1774785373 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:43:28 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-80af3cea-7b41-4e54-ac88-97e49a42a1d8 tempest-ProjectMemberTests-1774785373 None] Deleted volume successfully. Aug 26 14:43:28 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-80af3cea-7b41-4e54-ac88-97e49a42a1d8 tempest-ProjectMemberTests-1774785373 None] Lock "cinder-5efd68d6-e817-4332-a155-f5f387ea4695-delete_volume" released by "delete_volume" :: held 1.419s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:43:28 devstack sudo[114986]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:28 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-d24e9340-a315-4086-a514-93029470c885 tempest-ProjectReaderTests-1882876355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9da374be-a708-44fe-9b81-63ecaf04cd74.info" returned: 0 in 0.321s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:28 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-d24e9340-a315-4086-a514-93029470c885 tempest-ProjectReaderTests-1882876355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.366s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:43:28 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-d24e9340-a315-4086-a514-93029470c885 tempest-ProjectReaderTests-1882876355 None] Create snapshot completed successfully Aug 26 14:43:28 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-21480aa3-c9f3-4b84-af84-2163bb2dde29 tempest-ProjectMemberTests-1774785373 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:43:28 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-21480aa3-c9f3-4b84-af84-2163bb2dde29 tempest-ProjectMemberTests-1774785373 None] Flow 'volume_create_manager' (d1fa69f5-401f-4884-ad5a-7f7e171746b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:43:28 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-21480aa3-c9f3-4b84-af84-2163bb2dde29 tempest-ProjectMemberTests-1774785373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00695021-c6cb-4bb2-a49e-1aa29c8c6dc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:43:28 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-21480aa3-c9f3-4b84-af84-2163bb2dde29 tempest-ProjectMemberTests-1774785373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00695021-c6cb-4bb2-a49e-1aa29c8c6dc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:43:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1787913502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10a1ebe0-3d44-4384-878a-7c51c22fa65f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8dd248190cb40cebc9daf2b89f48fd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:43:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:43:29Z,use_quota=True,user_id='ad0617c386b6460d8f790d85646880e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:43:28 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-21480aa3-c9f3-4b84-af84-2163bb2dde29 tempest-ProjectMemberTests-1774785373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (341e77b5-43b7-4bee-af08-d62258595507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:43:28 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-21480aa3-c9f3-4b84-af84-2163bb2dde29 tempest-ProjectMemberTests-1774785373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (341e77b5-43b7-4bee-af08-d62258595507) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:43:28 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-21480aa3-c9f3-4b84-af84-2163bb2dde29 tempest-ProjectMemberTests-1774785373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90603ee6-ab51-4330-809b-e59128170c9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:43:28 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-21480aa3-c9f3-4b84-af84-2163bb2dde29 tempest-ProjectMemberTests-1774785373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90603ee6-ab51-4330-809b-e59128170c9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10a1ebe0-3d44-4384-878a-7c51c22fa65f', 'volume_name': 'volume-10a1ebe0-3d44-4384-878a-7c51c22fa65f', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:43:28 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-21480aa3-c9f3-4b84-af84-2163bb2dde29 tempest-ProjectMemberTests-1774785373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b55fd106-2836-4053-b85a-309a5b46d221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:43:28 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-21480aa3-c9f3-4b84-af84-2163bb2dde29 tempest-ProjectMemberTests-1774785373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b55fd106-2836-4053-b85a-309a5b46d221) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:43:28 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-21480aa3-c9f3-4b84-af84-2163bb2dde29 tempest-ProjectMemberTests-1774785373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12fff99d-14bb-4d1f-91a4-fce6adaaaa0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:43:28 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-21480aa3-c9f3-4b84-af84-2163bb2dde29 tempest-ProjectMemberTests-1774785373 None] Volume 10a1ebe0-3d44-4384-878a-7c51c22fa65f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10a1ebe0-3d44-4384-878a-7c51c22fa65f', 'volume_size': 1} Aug 26 14:43:28 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-21480aa3-c9f3-4b84-af84-2163bb2dde29 tempest-ProjectMemberTests-1774785373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:43:28 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-21480aa3-c9f3-4b84-af84-2163bb2dde29 tempest-ProjectMemberTests-1774785373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:43:28 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-21480aa3-c9f3-4b84-af84-2163bb2dde29 tempest-ProjectMemberTests-1774785373 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:43:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1787913502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10a1ebe0-3d44-4384-878a-7c51c22fa65f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8dd248190cb40cebc9daf2b89f48fd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:43:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:43:29Z,use_quota=True,user_id='ad0617c386b6460d8f790d85646880e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:43:28 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-21480aa3-c9f3-4b84-af84-2163bb2dde29 tempest-ProjectMemberTests-1774785373 None] Creating volume 10a1ebe0-3d44-4384-878a-7c51c22fa65f {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:43:29 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-21480aa3-c9f3-4b84-af84-2163bb2dde29 tempest-ProjectMemberTests-1774785373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:43:29 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-21480aa3-c9f3-4b84-af84-2163bb2dde29 tempest-ProjectMemberTests-1774785373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:43:29 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-21480aa3-c9f3-4b84-af84-2163bb2dde29 tempest-ProjectMemberTests-1774785373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:43:29 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-21480aa3-c9f3-4b84-af84-2163bb2dde29 tempest-ProjectMemberTests-1774785373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:43:29 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-21480aa3-c9f3-4b84-af84-2163bb2dde29 tempest-ProjectMemberTests-1774785373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:43:29 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-21480aa3-c9f3-4b84-af84-2163bb2dde29 tempest-ProjectMemberTests-1774785373 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:43:29 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-21480aa3-c9f3-4b84-af84-2163bb2dde29 tempest-ProjectMemberTests-1774785373 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:43:29 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-21480aa3-c9f3-4b84-af84-2163bb2dde29 tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-10a1ebe0-3d44-4384-878a-7c51c22fa65f 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:29 devstack sudo[114990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-10a1ebe0-3d44-4384-878a-7c51c22fa65f 1073741824 Aug 26 14:43:29 devstack sudo[114990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:29 devstack sudo[114990]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:29 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-21480aa3-c9f3-4b84-af84-2163bb2dde29 tempest-ProjectMemberTests-1774785373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-10a1ebe0-3d44-4384-878a-7c51c22fa65f 1073741824" returned: 0 in 0.445s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:29 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-21480aa3-c9f3-4b84-af84-2163bb2dde29 tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-10a1ebe0-3d44-4384-878a-7c51c22fa65f {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:29 devstack sudo[114997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-10a1ebe0-3d44-4384-878a-7c51c22fa65f Aug 26 14:43:29 devstack sudo[114997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:29 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-7dbe9223-16b3-4a6a-bde4-406e82fefe78 tempest-ProjectReaderTests-1882876355 None] Acquiring lock "cinder-b49f7e2a-5435-493d-befa-fe4af97be571-delete_snapshot" by "delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:43:29 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-7dbe9223-16b3-4a6a-bde4-406e82fefe78 tempest-ProjectReaderTests-1882876355 None] Lock "cinder-b49f7e2a-5435-493d-befa-fe4af97be571-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:43:29 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-7dbe9223-16b3-4a6a-bde4-406e82fefe78 tempest-ProjectReaderTests-1882876355 None] Acquiring lock "cinder-quobyte-9da374be-a708-44fe-9b81-63ecaf04cd74" by "delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:43:29 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-7dbe9223-16b3-4a6a-bde4-406e82fefe78 tempest-ProjectReaderTests-1882876355 None] Lock "cinder-quobyte-9da374be-a708-44fe-9b81-63ecaf04cd74" acquired by "delete_snapshot" :: waited 0.017s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:43:29 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-7dbe9223-16b3-4a6a-bde4-406e82fefe78 tempest-ProjectReaderTests-1882876355 None] Acquiring lock "cinder-quobyte-b49f7e2a-5435-493d-befa-fe4af97be571" by "_delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:43:29 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-7dbe9223-16b3-4a6a-bde4-406e82fefe78 tempest-ProjectReaderTests-1882876355 None] Lock "cinder-quobyte-b49f7e2a-5435-493d-befa-fe4af97be571" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:43:29 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-7dbe9223-16b3-4a6a-bde4-406e82fefe78 tempest-ProjectReaderTests-1882876355 None] Deleting offline snapshot b49f7e2a-5435-493d-befa-fe4af97be571 of volume 9da374be-a708-44fe-9b81-63ecaf04cd74 {{(pid=94394) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 14:43:29 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-7dbe9223-16b3-4a6a-bde4-406e82fefe78 tempest-ProjectReaderTests-1882876355 None] snapshot_file for this snap is: volume-9da374be-a708-44fe-9b81-63ecaf04cd74.b49f7e2a-5435-493d-befa-fe4af97be571 {{(pid=94394) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 14:43:29 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca4f4860-5b1b-4b5d-95d4-594f8ebc1182]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:43:29 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-7dbe9223-16b3-4a6a-bde4-406e82fefe78 tempest-ProjectReaderTests-1882876355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9da374be-a708-44fe-9b81-63ecaf04cd74.b49f7e2a-5435-493d-befa-fe4af97be571 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:29 devstack sudo[114997]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:29 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-21480aa3-c9f3-4b84-af84-2163bb2dde29 tempest-ProjectMemberTests-1774785373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-10a1ebe0-3d44-4384-878a-7c51c22fa65f" returned: 0 in 0.316s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:29 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-21480aa3-c9f3-4b84-af84-2163bb2dde29 tempest-ProjectMemberTests-1774785373 None] <== create_volume: return (805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:43:29 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-21480aa3-c9f3-4b84-af84-2163bb2dde29 tempest-ProjectMemberTests-1774785373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.808s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:43:29 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-21480aa3-c9f3-4b84-af84-2163bb2dde29 tempest-ProjectMemberTests-1774785373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12fff99d-14bb-4d1f-91a4-fce6adaaaa0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10a1ebe0-3d44-4384-878a-7c51c22fa65f', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:43:29 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-21480aa3-c9f3-4b84-af84-2163bb2dde29 tempest-ProjectMemberTests-1774785373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6f0d22b-22e1-4a9e-855b-f78153120247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:43:29 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-21480aa3-c9f3-4b84-af84-2163bb2dde29 tempest-ProjectMemberTests-1774785373 None] Volume volume-10a1ebe0-3d44-4384-878a-7c51c22fa65f (10a1ebe0-3d44-4384-878a-7c51c22fa65f): created successfully Aug 26 14:43:29 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-21480aa3-c9f3-4b84-af84-2163bb2dde29 tempest-ProjectMemberTests-1774785373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6f0d22b-22e1-4a9e-855b-f78153120247) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:43:29 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-21480aa3-c9f3-4b84-af84-2163bb2dde29 tempest-ProjectMemberTests-1774785373 None] Flow 'volume_create_manager' (d1fa69f5-401f-4884-ad5a-7f7e171746b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:43:29 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-21480aa3-c9f3-4b84-af84-2163bb2dde29 tempest-ProjectMemberTests-1774785373 None] Created volume successfully. Aug 26 14:43:29 devstack sudo[115000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9da374be-a708-44fe-9b81-63ecaf04cd74.b49f7e2a-5435-493d-befa-fe4af97be571 Aug 26 14:43:29 devstack sudo[115000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:30 devstack sudo[115000]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:30 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-7dbe9223-16b3-4a6a-bde4-406e82fefe78 tempest-ProjectReaderTests-1882876355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9da374be-a708-44fe-9b81-63ecaf04cd74.b49f7e2a-5435-493d-befa-fe4af97be571" returned: 0 in 0.416s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:30 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-7dbe9223-16b3-4a6a-bde4-406e82fefe78 tempest-ProjectReaderTests-1882876355 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9da374be-a708-44fe-9b81-63ecaf04cd74(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94394) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 14:43:30 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[81fc3679-d257-40c9-8bc6-655e509a0841]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:43:30 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-7dbe9223-16b3-4a6a-bde4-406e82fefe78 tempest-ProjectReaderTests-1882876355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9da374be-a708-44fe-9b81-63ecaf04cd74 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:30 devstack sudo[115005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9da374be-a708-44fe-9b81-63ecaf04cd74 Aug 26 14:43:30 devstack sudo[115005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:30 devstack sudo[115005]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:30 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-7dbe9223-16b3-4a6a-bde4-406e82fefe78 tempest-ProjectReaderTests-1882876355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9da374be-a708-44fe-9b81-63ecaf04cd74" returned: 0 in 0.354s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:30 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-7dbe9223-16b3-4a6a-bde4-406e82fefe78 tempest-ProjectReaderTests-1882876355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9da374be-a708-44fe-9b81-63ecaf04cd74.b49f7e2a-5435-493d-befa-fe4af97be571 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:30 devstack sudo[115010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9da374be-a708-44fe-9b81-63ecaf04cd74.b49f7e2a-5435-493d-befa-fe4af97be571 Aug 26 14:43:30 devstack sudo[115010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:30 devstack sudo[115010]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:30 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-7dbe9223-16b3-4a6a-bde4-406e82fefe78 tempest-ProjectReaderTests-1882876355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9da374be-a708-44fe-9b81-63ecaf04cd74.b49f7e2a-5435-493d-befa-fe4af97be571" returned: 0 in 0.354s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:30 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-7dbe9223-16b3-4a6a-bde4-406e82fefe78 tempest-ProjectReaderTests-1882876355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9da374be-a708-44fe-9b81-63ecaf04cd74.b49f7e2a-5435-493d-befa-fe4af97be571 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:30 devstack sudo[115017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9da374be-a708-44fe-9b81-63ecaf04cd74.b49f7e2a-5435-493d-befa-fe4af97be571 Aug 26 14:43:30 devstack sudo[115017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:31 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-1d04004f-aaf1-4a31-b546-47f16e79f94a tempest-ProjectMemberTests-1774785373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:43:31 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-1d04004f-aaf1-4a31-b546-47f16e79f94a tempest-ProjectMemberTests-1774785373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:43:31 devstack sudo[115017]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:31 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-7dbe9223-16b3-4a6a-bde4-406e82fefe78 tempest-ProjectReaderTests-1882876355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9da374be-a708-44fe-9b81-63ecaf04cd74.b49f7e2a-5435-493d-befa-fe4af97be571" returned: 0 in 0.356s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:31 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-1d04004f-aaf1-4a31-b546-47f16e79f94a tempest-ProjectMemberTests-1774785373 None] Creating offline snapshot 62d5bcf0-aac3-45a8-972a-38e642f811e2 of volume 10a1ebe0-3d44-4384-878a-7c51c22fa65f {{(pid=94394) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 14:43:31 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-7dbe9223-16b3-4a6a-bde4-406e82fefe78 tempest-ProjectReaderTests-1882876355 None] Lock "cinder-quobyte-b49f7e2a-5435-493d-befa-fe4af97be571" released by "_delete_snapshot" :: held 1.597s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:43:31 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-7dbe9223-16b3-4a6a-bde4-406e82fefe78 tempest-ProjectReaderTests-1882876355 None] Lock "cinder-quobyte-9da374be-a708-44fe-9b81-63ecaf04cd74" released by "delete_snapshot" :: held 1.629s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:43:31 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9965318-3af4-44a1-88ea-31e6d356f648]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:43:31 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-1d04004f-aaf1-4a31-b546-47f16e79f94a tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-10a1ebe0-3d44-4384-878a-7c51c22fa65f {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:31 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-7dbe9223-16b3-4a6a-bde4-406e82fefe78 tempest-ProjectReaderTests-1882876355 None] Created reservations ['d174c56c-10c5-4de6-9d09-da93db6a477c', '6da8bc20-c6ac-4e38-9ccf-529aca6a8d27', 'd3a8cf67-4f68-4605-98ec-e5ecd6b8cb38', '90b124d4-240a-46ef-858e-75fe9703f0d9'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:43:31 devstack sudo[115020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-10a1ebe0-3d44-4384-878a-7c51c22fa65f Aug 26 14:43:31 devstack sudo[115020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:31 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-7dbe9223-16b3-4a6a-bde4-406e82fefe78 tempest-ProjectReaderTests-1882876355 None] Delete snapshot completed successfully. Aug 26 14:43:31 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-7dbe9223-16b3-4a6a-bde4-406e82fefe78 tempest-ProjectReaderTests-1882876355 None] Lock "cinder-b49f7e2a-5435-493d-befa-fe4af97be571-delete_snapshot" released by "delete_snapshot" :: held 1.791s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:43:31 devstack sudo[115020]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:31 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-1d04004f-aaf1-4a31-b546-47f16e79f94a tempest-ProjectMemberTests-1774785373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-10a1ebe0-3d44-4384-878a-7c51c22fa65f" returned: 0 in 0.377s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:31 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-1d04004f-aaf1-4a31-b546-47f16e79f94a tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-10a1ebe0-3d44-4384-878a-7c51c22fa65f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-10a1ebe0-3d44-4384-878a-7c51c22fa65f.62d5bcf0-aac3-45a8-972a-38e642f811e2 1G {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:31 devstack sudo[115025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-10a1ebe0-3d44-4384-878a-7c51c22fa65f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-10a1ebe0-3d44-4384-878a-7c51c22fa65f.62d5bcf0-aac3-45a8-972a-38e642f811e2 1G Aug 26 14:43:31 devstack sudo[115025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:31 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-2e92261c-22d6-44ad-9a5c-e714b36332f4 tempest-ProjectReaderTests-1882876355 None] Acquiring lock "cinder-9da374be-a708-44fe-9b81-63ecaf04cd74-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:43:31 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-2e92261c-22d6-44ad-9a5c-e714b36332f4 tempest-ProjectReaderTests-1882876355 None] Lock "cinder-9da374be-a708-44fe-9b81-63ecaf04cd74-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:43:31 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-2e92261c-22d6-44ad-9a5c-e714b36332f4 tempest-ProjectReaderTests-1882876355 None] Acquiring lock "cinder-quobyte-9da374be-a708-44fe-9b81-63ecaf04cd74" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:43:31 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-2e92261c-22d6-44ad-9a5c-e714b36332f4 tempest-ProjectReaderTests-1882876355 None] Lock "cinder-quobyte-9da374be-a708-44fe-9b81-63ecaf04cd74" acquired by "delete_volume" :: waited 0.021s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:43:32 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[591266c7-f310-4688-93fe-43ff7ee3c906]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:43:32 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-2e92261c-22d6-44ad-9a5c-e714b36332f4 tempest-ProjectReaderTests-1882876355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9da374be-a708-44fe-9b81-63ecaf04cd74 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:32 devstack sudo[115029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9da374be-a708-44fe-9b81-63ecaf04cd74 Aug 26 14:43:32 devstack sudo[115029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:32 devstack sudo[115025]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:32 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-1d04004f-aaf1-4a31-b546-47f16e79f94a tempest-ProjectMemberTests-1774785373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-10a1ebe0-3d44-4384-878a-7c51c22fa65f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-10a1ebe0-3d44-4384-878a-7c51c22fa65f.62d5bcf0-aac3-45a8-972a-38e642f811e2 1G" returned: 0 in 0.557s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:32 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-1d04004f-aaf1-4a31-b546-47f16e79f94a tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10a1ebe0-3d44-4384-878a-7c51c22fa65f -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-10a1ebe0-3d44-4384-878a-7c51c22fa65f.62d5bcf0-aac3-45a8-972a-38e642f811e2 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:32 devstack sudo[115033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10a1ebe0-3d44-4384-878a-7c51c22fa65f -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-10a1ebe0-3d44-4384-878a-7c51c22fa65f.62d5bcf0-aac3-45a8-972a-38e642f811e2 Aug 26 14:43:32 devstack sudo[115033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:32 devstack sudo[115029]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:32 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-2e92261c-22d6-44ad-9a5c-e714b36332f4 tempest-ProjectReaderTests-1882876355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9da374be-a708-44fe-9b81-63ecaf04cd74" returned: 0 in 0.417s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:32 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-2e92261c-22d6-44ad-9a5c-e714b36332f4 tempest-ProjectReaderTests-1882876355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9da374be-a708-44fe-9b81-63ecaf04cd74 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:32 devstack sudo[115038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9da374be-a708-44fe-9b81-63ecaf04cd74 Aug 26 14:43:32 devstack sudo[115038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:32 devstack sudo[115033]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:32 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-1d04004f-aaf1-4a31-b546-47f16e79f94a tempest-ProjectMemberTests-1774785373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10a1ebe0-3d44-4384-878a-7c51c22fa65f -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-10a1ebe0-3d44-4384-878a-7c51c22fa65f.62d5bcf0-aac3-45a8-972a-38e642f811e2" returned: 0 in 0.308s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:32 devstack cinder-volume[94394]: WARNING cinder.volume.drivers.remotefs [None req-1d04004f-aaf1-4a31-b546-47f16e79f94a tempest-ProjectMemberTests-1774785373 None] /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-10a1ebe0-3d44-4384-878a-7c51c22fa65f.62d5bcf0-aac3-45a8-972a-38e642f811e2 is being set with open permissions: ugo+rw Aug 26 14:43:32 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-1d04004f-aaf1-4a31-b546-47f16e79f94a tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-10a1ebe0-3d44-4384-878a-7c51c22fa65f.62d5bcf0-aac3-45a8-972a-38e642f811e2 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:32 devstack sudo[115043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-10a1ebe0-3d44-4384-878a-7c51c22fa65f.62d5bcf0-aac3-45a8-972a-38e642f811e2 Aug 26 14:43:32 devstack sudo[115043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:32 devstack sudo[115038]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:32 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-2e92261c-22d6-44ad-9a5c-e714b36332f4 tempest-ProjectReaderTests-1882876355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9da374be-a708-44fe-9b81-63ecaf04cd74" returned: 0 in 0.277s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:32 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-2e92261c-22d6-44ad-9a5c-e714b36332f4 tempest-ProjectReaderTests-1882876355 None] Lock "cinder-quobyte-9da374be-a708-44fe-9b81-63ecaf04cd74" released by "delete_volume" :: held 0.767s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:43:32 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-2e92261c-22d6-44ad-9a5c-e714b36332f4 tempest-ProjectReaderTests-1882876355 None] Created reservations ['2d5d1785-2f11-4c56-a145-2a6e1adc7223', 'ea0a6fef-3f46-47a7-93ce-914691cdde88', '03c791e4-cb52-4e99-8664-71948ab9cf72', '6a5f582a-9241-4cc1-9758-c153c921cc83'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:43:32 devstack sudo[115043]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:32 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-1d04004f-aaf1-4a31-b546-47f16e79f94a tempest-ProjectMemberTests-1774785373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-10a1ebe0-3d44-4384-878a-7c51c22fa65f.62d5bcf0-aac3-45a8-972a-38e642f811e2" returned: 0 in 0.274s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:32 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-2e92261c-22d6-44ad-9a5c-e714b36332f4 tempest-ProjectReaderTests-1882876355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:43:32 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-2e92261c-22d6-44ad-9a5c-e714b36332f4 tempest-ProjectReaderTests-1882876355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:43:32 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-2e92261c-22d6-44ad-9a5c-e714b36332f4 tempest-ProjectReaderTests-1882876355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:43:32 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-2e92261c-22d6-44ad-9a5c-e714b36332f4 tempest-ProjectReaderTests-1882876355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:43:32 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-2e92261c-22d6-44ad-9a5c-e714b36332f4 tempest-ProjectReaderTests-1882876355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:43:32 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-2e92261c-22d6-44ad-9a5c-e714b36332f4 tempest-ProjectReaderTests-1882876355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:32 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-1d04004f-aaf1-4a31-b546-47f16e79f94a tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-10a1ebe0-3d44-4384-878a-7c51c22fa65f.info {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:32 devstack sudo[115047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:43:32 devstack sudo[115047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:32 devstack sudo[115048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-10a1ebe0-3d44-4384-878a-7c51c22fa65f.info Aug 26 14:43:32 devstack sudo[115048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:33 devstack sudo[115047]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-2e92261c-22d6-44ad-9a5c-e714b36332f4 tempest-ProjectReaderTests-1882876355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.301s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:33 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-2e92261c-22d6-44ad-9a5c-e714b36332f4 tempest-ProjectReaderTests-1882876355 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:43:33 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-2e92261c-22d6-44ad-9a5c-e714b36332f4 tempest-ProjectReaderTests-1882876355 None] Deleted volume successfully. Aug 26 14:43:33 devstack sudo[115048]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-1d04004f-aaf1-4a31-b546-47f16e79f94a tempest-ProjectMemberTests-1774785373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-10a1ebe0-3d44-4384-878a-7c51c22fa65f.info" returned: 0 in 0.317s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:33 devstack cinder-volume[94394]: WARNING cinder.volume.drivers.remotefs [None req-1d04004f-aaf1-4a31-b546-47f16e79f94a tempest-ProjectMemberTests-1774785373 None] /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-10a1ebe0-3d44-4384-878a-7c51c22fa65f.info is being set with open permissions: ugo+rw Aug 26 14:43:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-1d04004f-aaf1-4a31-b546-47f16e79f94a tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-10a1ebe0-3d44-4384-878a-7c51c22fa65f.info {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:33 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-2e92261c-22d6-44ad-9a5c-e714b36332f4 tempest-ProjectReaderTests-1882876355 None] Lock "cinder-9da374be-a708-44fe-9b81-63ecaf04cd74-delete_volume" released by "delete_volume" :: held 1.409s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:43:33 devstack sudo[115053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-10a1ebe0-3d44-4384-878a-7c51c22fa65f.info Aug 26 14:43:33 devstack sudo[115053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:33 devstack sudo[115053]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:33 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-62882f3a-5f4a-4e52-bc3a-89420244297b tempest-ProjectReaderTests-1882876355 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:43:33 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-62882f3a-5f4a-4e52-bc3a-89420244297b tempest-ProjectReaderTests-1882876355 None] Flow 'volume_create_manager' (39ea1b8b-aada-45ae-b4ed-e71442c6b181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:43:33 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-62882f3a-5f4a-4e52-bc3a-89420244297b tempest-ProjectReaderTests-1882876355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4e41997-4461-4f6b-91d6-5fc5fc2a6336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:43:33 devstack cinder-volume[94394]: DEBUG oslo_service.periodic_task [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94394) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 14:43:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:43:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:43:33 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:43:33 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:43:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:43:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-1d04004f-aaf1-4a31-b546-47f16e79f94a tempest-ProjectMemberTests-1774785373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-10a1ebe0-3d44-4384-878a-7c51c22fa65f.info" returned: 0 in 0.374s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:33 devstack sudo[115057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:43:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-1d04004f-aaf1-4a31-b546-47f16e79f94a tempest-ProjectMemberTests-1774785373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.359s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:43:33 devstack sudo[115057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:33 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-62882f3a-5f4a-4e52-bc3a-89420244297b tempest-ProjectReaderTests-1882876355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4e41997-4461-4f6b-91d6-5fc5fc2a6336) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:43:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1729029906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07aa4f73-30c2-423d-9e06-394e7eee1da6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57364cca92024529a3a58d2a3e634ba3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:43:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:43:33Z,use_quota=True,user_id='23a9f0a2e5524f5485f0d17c6acdc640',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:43:33 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-62882f3a-5f4a-4e52-bc3a-89420244297b tempest-ProjectReaderTests-1882876355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8aa4aee2-5cc6-46f4-9b5f-9d5553245613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:43:33 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-62882f3a-5f4a-4e52-bc3a-89420244297b tempest-ProjectReaderTests-1882876355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8aa4aee2-5cc6-46f4-9b5f-9d5553245613) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:43:33 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-62882f3a-5f4a-4e52-bc3a-89420244297b tempest-ProjectReaderTests-1882876355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c74a6a7a-f4af-4d7f-b2e9-3d974381646a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:43:33 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-62882f3a-5f4a-4e52-bc3a-89420244297b tempest-ProjectReaderTests-1882876355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c74a6a7a-f4af-4d7f-b2e9-3d974381646a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07aa4f73-30c2-423d-9e06-394e7eee1da6', 'volume_name': 'volume-07aa4f73-30c2-423d-9e06-394e7eee1da6', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:43:33 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-62882f3a-5f4a-4e52-bc3a-89420244297b tempest-ProjectReaderTests-1882876355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fec0426-ae41-4b2a-a61c-86e4fd541023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:43:33 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-62882f3a-5f4a-4e52-bc3a-89420244297b tempest-ProjectReaderTests-1882876355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fec0426-ae41-4b2a-a61c-86e4fd541023) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:43:33 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-62882f3a-5f4a-4e52-bc3a-89420244297b tempest-ProjectReaderTests-1882876355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (886643fa-d695-4bf3-b9ae-0a2a33cf8536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:43:33 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-62882f3a-5f4a-4e52-bc3a-89420244297b tempest-ProjectReaderTests-1882876355 None] Volume 07aa4f73-30c2-423d-9e06-394e7eee1da6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07aa4f73-30c2-423d-9e06-394e7eee1da6', 'volume_size': 1} Aug 26 14:43:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-62882f3a-5f4a-4e52-bc3a-89420244297b tempest-ProjectReaderTests-1882876355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:43:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-62882f3a-5f4a-4e52-bc3a-89420244297b tempest-ProjectReaderTests-1882876355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:43:33 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-62882f3a-5f4a-4e52-bc3a-89420244297b tempest-ProjectReaderTests-1882876355 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:43:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1729029906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07aa4f73-30c2-423d-9e06-394e7eee1da6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57364cca92024529a3a58d2a3e634ba3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:43:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:43:33Z,use_quota=True,user_id='23a9f0a2e5524f5485f0d17c6acdc640',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:43:33 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-62882f3a-5f4a-4e52-bc3a-89420244297b tempest-ProjectReaderTests-1882876355 None] Creating volume 07aa4f73-30c2-423d-9e06-394e7eee1da6 {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:43:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-62882f3a-5f4a-4e52-bc3a-89420244297b tempest-ProjectReaderTests-1882876355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:43:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-62882f3a-5f4a-4e52-bc3a-89420244297b tempest-ProjectReaderTests-1882876355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:43:33 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-62882f3a-5f4a-4e52-bc3a-89420244297b tempest-ProjectReaderTests-1882876355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:43:33 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-62882f3a-5f4a-4e52-bc3a-89420244297b tempest-ProjectReaderTests-1882876355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:43:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-62882f3a-5f4a-4e52-bc3a-89420244297b tempest-ProjectReaderTests-1882876355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:43:33 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-62882f3a-5f4a-4e52-bc3a-89420244297b tempest-ProjectReaderTests-1882876355 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:43:33 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-62882f3a-5f4a-4e52-bc3a-89420244297b tempest-ProjectReaderTests-1882876355 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:43:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-62882f3a-5f4a-4e52-bc3a-89420244297b tempest-ProjectReaderTests-1882876355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-07aa4f73-30c2-423d-9e06-394e7eee1da6 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:33 devstack sudo[115059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-07aa4f73-30c2-423d-9e06-394e7eee1da6 1073741824 Aug 26 14:43:33 devstack sudo[115059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:33 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-1d04004f-aaf1-4a31-b546-47f16e79f94a tempest-ProjectMemberTests-1774785373 None] Create snapshot completed successfully Aug 26 14:43:33 devstack sudo[115057]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.265s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:33 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:43:33 devstack cinder-volume[94394]: DEBUG oslo_service.periodic_task [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Running periodic task VolumeManager._thread_info {{(pid=94394) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 14:43:33 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] thread count: 28 {{(pid=94394) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 14:43:33 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] thread info: [<_MainThread(MainThread, started 126600738033792)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94394) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 14:43:34 devstack sudo[115059]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:34 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-62882f3a-5f4a-4e52-bc3a-89420244297b tempest-ProjectReaderTests-1882876355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-07aa4f73-30c2-423d-9e06-394e7eee1da6 1073741824" returned: 0 in 0.428s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:34 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-62882f3a-5f4a-4e52-bc3a-89420244297b tempest-ProjectReaderTests-1882876355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-07aa4f73-30c2-423d-9e06-394e7eee1da6 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:34 devstack sudo[115066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-07aa4f73-30c2-423d-9e06-394e7eee1da6 Aug 26 14:43:34 devstack sudo[115066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:34 devstack sudo[115066]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:34 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-62882f3a-5f4a-4e52-bc3a-89420244297b tempest-ProjectReaderTests-1882876355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-07aa4f73-30c2-423d-9e06-394e7eee1da6" returned: 0 in 0.281s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:34 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-62882f3a-5f4a-4e52-bc3a-89420244297b tempest-ProjectReaderTests-1882876355 None] <== create_volume: return (754ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:43:34 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-62882f3a-5f4a-4e52-bc3a-89420244297b tempest-ProjectReaderTests-1882876355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.756s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:43:34 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-62882f3a-5f4a-4e52-bc3a-89420244297b tempest-ProjectReaderTests-1882876355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (886643fa-d695-4bf3-b9ae-0a2a33cf8536) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07aa4f73-30c2-423d-9e06-394e7eee1da6', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:43:34 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-62882f3a-5f4a-4e52-bc3a-89420244297b tempest-ProjectReaderTests-1882876355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7515d27-f2cb-4013-8a7e-97015f4f981b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:43:34 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-f1a25801-ad65-4b20-8bfe-dabd85ba6e68 tempest-ProjectMemberTests-1774785373 None] Acquiring lock "cinder-62d5bcf0-aac3-45a8-972a-38e642f811e2-delete_snapshot" by "delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:43:34 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-62882f3a-5f4a-4e52-bc3a-89420244297b tempest-ProjectReaderTests-1882876355 None] Volume volume-07aa4f73-30c2-423d-9e06-394e7eee1da6 (07aa4f73-30c2-423d-9e06-394e7eee1da6): created successfully Aug 26 14:43:34 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-62882f3a-5f4a-4e52-bc3a-89420244297b tempest-ProjectReaderTests-1882876355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7515d27-f2cb-4013-8a7e-97015f4f981b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:43:34 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-62882f3a-5f4a-4e52-bc3a-89420244297b tempest-ProjectReaderTests-1882876355 None] Flow 'volume_create_manager' (39ea1b8b-aada-45ae-b4ed-e71442c6b181) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:43:34 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-f1a25801-ad65-4b20-8bfe-dabd85ba6e68 tempest-ProjectMemberTests-1774785373 None] Lock "cinder-62d5bcf0-aac3-45a8-972a-38e642f811e2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:43:34 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-f1a25801-ad65-4b20-8bfe-dabd85ba6e68 tempest-ProjectMemberTests-1774785373 None] Acquiring lock "cinder-quobyte-10a1ebe0-3d44-4384-878a-7c51c22fa65f" by "delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:43:34 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-62882f3a-5f4a-4e52-bc3a-89420244297b tempest-ProjectReaderTests-1882876355 None] Created volume successfully. Aug 26 14:43:34 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-f1a25801-ad65-4b20-8bfe-dabd85ba6e68 tempest-ProjectMemberTests-1774785373 None] Lock "cinder-quobyte-10a1ebe0-3d44-4384-878a-7c51c22fa65f" acquired by "delete_snapshot" :: waited 0.033s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:43:34 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-f1a25801-ad65-4b20-8bfe-dabd85ba6e68 tempest-ProjectMemberTests-1774785373 None] Acquiring lock "cinder-quobyte-62d5bcf0-aac3-45a8-972a-38e642f811e2" by "_delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:43:34 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-f1a25801-ad65-4b20-8bfe-dabd85ba6e68 tempest-ProjectMemberTests-1774785373 None] Lock "cinder-quobyte-62d5bcf0-aac3-45a8-972a-38e642f811e2" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:43:34 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-f1a25801-ad65-4b20-8bfe-dabd85ba6e68 tempest-ProjectMemberTests-1774785373 None] Deleting offline snapshot 62d5bcf0-aac3-45a8-972a-38e642f811e2 of volume 10a1ebe0-3d44-4384-878a-7c51c22fa65f {{(pid=94394) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 14:43:34 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-f1a25801-ad65-4b20-8bfe-dabd85ba6e68 tempest-ProjectMemberTests-1774785373 None] snapshot_file for this snap is: volume-10a1ebe0-3d44-4384-878a-7c51c22fa65f.62d5bcf0-aac3-45a8-972a-38e642f811e2 {{(pid=94394) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 14:43:34 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[557a81ab-c0c7-452d-9ad0-2b90969d2cfb]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:43:34 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-f1a25801-ad65-4b20-8bfe-dabd85ba6e68 tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-10a1ebe0-3d44-4384-878a-7c51c22fa65f.62d5bcf0-aac3-45a8-972a-38e642f811e2 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:34 devstack sudo[115083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-10a1ebe0-3d44-4384-878a-7c51c22fa65f.62d5bcf0-aac3-45a8-972a-38e642f811e2 Aug 26 14:43:34 devstack sudo[115083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:35 devstack sudo[115083]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:35 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-f1a25801-ad65-4b20-8bfe-dabd85ba6e68 tempest-ProjectMemberTests-1774785373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-10a1ebe0-3d44-4384-878a-7c51c22fa65f.62d5bcf0-aac3-45a8-972a-38e642f811e2" returned: 0 in 0.393s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:35 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-f1a25801-ad65-4b20-8bfe-dabd85ba6e68 tempest-ProjectMemberTests-1774785373 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-10a1ebe0-3d44-4384-878a-7c51c22fa65f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94394) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 14:43:35 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[142fced9-3cb0-42fd-8195-0ed9a0f4caa1]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:43:35 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-f1a25801-ad65-4b20-8bfe-dabd85ba6e68 tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-10a1ebe0-3d44-4384-878a-7c51c22fa65f {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:35 devstack sudo[115110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-10a1ebe0-3d44-4384-878a-7c51c22fa65f Aug 26 14:43:35 devstack sudo[115110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:35 devstack sudo[115110]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:35 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-f1a25801-ad65-4b20-8bfe-dabd85ba6e68 tempest-ProjectMemberTests-1774785373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-10a1ebe0-3d44-4384-878a-7c51c22fa65f" returned: 0 in 0.375s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:35 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-f1a25801-ad65-4b20-8bfe-dabd85ba6e68 tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-10a1ebe0-3d44-4384-878a-7c51c22fa65f.62d5bcf0-aac3-45a8-972a-38e642f811e2 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:35 devstack sudo[115115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-10a1ebe0-3d44-4384-878a-7c51c22fa65f.62d5bcf0-aac3-45a8-972a-38e642f811e2 Aug 26 14:43:35 devstack sudo[115115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:35 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-0b845bda-928e-40bf-9a90-5fdd875e277a tempest-ProjectReaderTests-1882876355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:43:35 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-0b845bda-928e-40bf-9a90-5fdd875e277a tempest-ProjectReaderTests-1882876355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:43:35 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-0b845bda-928e-40bf-9a90-5fdd875e277a tempest-ProjectReaderTests-1882876355 None] Creating offline snapshot b5bba92f-347e-4876-961e-1b6fbd3428c6 of volume 07aa4f73-30c2-423d-9e06-394e7eee1da6 {{(pid=94394) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 14:43:35 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e497901-baa7-4fc5-98be-46b1cf3b6844]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:43:35 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-0b845bda-928e-40bf-9a90-5fdd875e277a tempest-ProjectReaderTests-1882876355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-07aa4f73-30c2-423d-9e06-394e7eee1da6 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:35 devstack sudo[115115]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:35 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-f1a25801-ad65-4b20-8bfe-dabd85ba6e68 tempest-ProjectMemberTests-1774785373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-10a1ebe0-3d44-4384-878a-7c51c22fa65f.62d5bcf0-aac3-45a8-972a-38e642f811e2" returned: 0 in 0.477s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:35 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-f1a25801-ad65-4b20-8bfe-dabd85ba6e68 tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-10a1ebe0-3d44-4384-878a-7c51c22fa65f.62d5bcf0-aac3-45a8-972a-38e642f811e2 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:35 devstack sudo[115121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-10a1ebe0-3d44-4384-878a-7c51c22fa65f.62d5bcf0-aac3-45a8-972a-38e642f811e2 Aug 26 14:43:35 devstack sudo[115121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:36 devstack sudo[115120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-07aa4f73-30c2-423d-9e06-394e7eee1da6 Aug 26 14:43:36 devstack sudo[115120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:36 devstack sudo[115121]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:36 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-f1a25801-ad65-4b20-8bfe-dabd85ba6e68 tempest-ProjectMemberTests-1774785373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-10a1ebe0-3d44-4384-878a-7c51c22fa65f.62d5bcf0-aac3-45a8-972a-38e642f811e2" returned: 0 in 0.287s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:36 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-f1a25801-ad65-4b20-8bfe-dabd85ba6e68 tempest-ProjectMemberTests-1774785373 None] Lock "cinder-quobyte-62d5bcf0-aac3-45a8-972a-38e642f811e2" released by "_delete_snapshot" :: held 1.643s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:43:36 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-f1a25801-ad65-4b20-8bfe-dabd85ba6e68 tempest-ProjectMemberTests-1774785373 None] Lock "cinder-quobyte-10a1ebe0-3d44-4384-878a-7c51c22fa65f" released by "delete_snapshot" :: held 1.680s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:43:36 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-f1a25801-ad65-4b20-8bfe-dabd85ba6e68 tempest-ProjectMemberTests-1774785373 None] Created reservations ['d722d12a-a49b-4927-8382-f6fd7a196183', '7d60accf-9d0c-415d-a8fa-277ad4d506fd', '6a2d3303-a499-4dd3-baea-5b6dd041b711', 'c874c753-5a7e-4a8c-9138-ab930bf1cac9'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:43:36 devstack sudo[115120]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:36 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-0b845bda-928e-40bf-9a90-5fdd875e277a tempest-ProjectReaderTests-1882876355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-07aa4f73-30c2-423d-9e06-394e7eee1da6" returned: 0 in 0.425s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:36 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-0b845bda-928e-40bf-9a90-5fdd875e277a tempest-ProjectReaderTests-1882876355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-07aa4f73-30c2-423d-9e06-394e7eee1da6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-07aa4f73-30c2-423d-9e06-394e7eee1da6.b5bba92f-347e-4876-961e-1b6fbd3428c6 1G {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:36 devstack sudo[115128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-07aa4f73-30c2-423d-9e06-394e7eee1da6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-07aa4f73-30c2-423d-9e06-394e7eee1da6.b5bba92f-347e-4876-961e-1b6fbd3428c6 1G Aug 26 14:43:36 devstack sudo[115128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:36 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-f1a25801-ad65-4b20-8bfe-dabd85ba6e68 tempest-ProjectMemberTests-1774785373 None] Delete snapshot completed successfully. Aug 26 14:43:36 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-f1a25801-ad65-4b20-8bfe-dabd85ba6e68 tempest-ProjectMemberTests-1774785373 None] Lock "cinder-62d5bcf0-aac3-45a8-972a-38e642f811e2-delete_snapshot" released by "delete_snapshot" :: held 1.884s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:43:36 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-73414059-f39b-4786-8879-dd535c4a7530 tempest-ProjectMemberTests-1774785373 None] Acquiring lock "cinder-10a1ebe0-3d44-4384-878a-7c51c22fa65f-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:43:36 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-73414059-f39b-4786-8879-dd535c4a7530 tempest-ProjectMemberTests-1774785373 None] Lock "cinder-10a1ebe0-3d44-4384-878a-7c51c22fa65f-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:43:36 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-73414059-f39b-4786-8879-dd535c4a7530 tempest-ProjectMemberTests-1774785373 None] Acquiring lock "cinder-quobyte-10a1ebe0-3d44-4384-878a-7c51c22fa65f" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:43:36 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-73414059-f39b-4786-8879-dd535c4a7530 tempest-ProjectMemberTests-1774785373 None] Lock "cinder-quobyte-10a1ebe0-3d44-4384-878a-7c51c22fa65f" acquired by "delete_volume" :: waited 0.022s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:43:36 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bd81621-124b-44fd-8102-5868cf81701b]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:43:36 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-73414059-f39b-4786-8879-dd535c4a7530 tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-10a1ebe0-3d44-4384-878a-7c51c22fa65f {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:36 devstack sudo[115128]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:36 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-0b845bda-928e-40bf-9a90-5fdd875e277a tempest-ProjectReaderTests-1882876355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-07aa4f73-30c2-423d-9e06-394e7eee1da6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-07aa4f73-30c2-423d-9e06-394e7eee1da6.b5bba92f-347e-4876-961e-1b6fbd3428c6 1G" returned: 0 in 0.560s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:36 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-0b845bda-928e-40bf-9a90-5fdd875e277a tempest-ProjectReaderTests-1882876355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07aa4f73-30c2-423d-9e06-394e7eee1da6 -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-07aa4f73-30c2-423d-9e06-394e7eee1da6.b5bba92f-347e-4876-961e-1b6fbd3428c6 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:36 devstack sudo[115136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07aa4f73-30c2-423d-9e06-394e7eee1da6 -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-07aa4f73-30c2-423d-9e06-394e7eee1da6.b5bba92f-347e-4876-961e-1b6fbd3428c6 Aug 26 14:43:36 devstack sudo[115136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:36 devstack sudo[115135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-10a1ebe0-3d44-4384-878a-7c51c22fa65f Aug 26 14:43:36 devstack sudo[115135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:37 devstack sudo[115136]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:37 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-0b845bda-928e-40bf-9a90-5fdd875e277a tempest-ProjectReaderTests-1882876355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07aa4f73-30c2-423d-9e06-394e7eee1da6 -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-07aa4f73-30c2-423d-9e06-394e7eee1da6.b5bba92f-347e-4876-961e-1b6fbd3428c6" returned: 0 in 0.338s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:37 devstack cinder-volume[94394]: WARNING cinder.volume.drivers.remotefs [None req-0b845bda-928e-40bf-9a90-5fdd875e277a tempest-ProjectReaderTests-1882876355 None] /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-07aa4f73-30c2-423d-9e06-394e7eee1da6.b5bba92f-347e-4876-961e-1b6fbd3428c6 is being set with open permissions: ugo+rw Aug 26 14:43:37 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-0b845bda-928e-40bf-9a90-5fdd875e277a tempest-ProjectReaderTests-1882876355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-07aa4f73-30c2-423d-9e06-394e7eee1da6.b5bba92f-347e-4876-961e-1b6fbd3428c6 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:37 devstack sudo[115146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-07aa4f73-30c2-423d-9e06-394e7eee1da6.b5bba92f-347e-4876-961e-1b6fbd3428c6 Aug 26 14:43:37 devstack sudo[115146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:37 devstack sudo[115135]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:37 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-73414059-f39b-4786-8879-dd535c4a7530 tempest-ProjectMemberTests-1774785373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-10a1ebe0-3d44-4384-878a-7c51c22fa65f" returned: 0 in 0.431s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:37 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-73414059-f39b-4786-8879-dd535c4a7530 tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-10a1ebe0-3d44-4384-878a-7c51c22fa65f {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:37 devstack sudo[115148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-10a1ebe0-3d44-4384-878a-7c51c22fa65f Aug 26 14:43:37 devstack sudo[115148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:37 devstack sudo[115146]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:37 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-0b845bda-928e-40bf-9a90-5fdd875e277a tempest-ProjectReaderTests-1882876355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-07aa4f73-30c2-423d-9e06-394e7eee1da6.b5bba92f-347e-4876-961e-1b6fbd3428c6" returned: 0 in 0.249s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:37 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-0b845bda-928e-40bf-9a90-5fdd875e277a tempest-ProjectReaderTests-1882876355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-07aa4f73-30c2-423d-9e06-394e7eee1da6.info {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:37 devstack sudo[115148]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:37 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-73414059-f39b-4786-8879-dd535c4a7530 tempest-ProjectMemberTests-1774785373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-10a1ebe0-3d44-4384-878a-7c51c22fa65f" returned: 0 in 0.261s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:37 devstack sudo[115152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-07aa4f73-30c2-423d-9e06-394e7eee1da6.info Aug 26 14:43:37 devstack sudo[115152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:37 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-73414059-f39b-4786-8879-dd535c4a7530 tempest-ProjectMemberTests-1774785373 None] Lock "cinder-quobyte-10a1ebe0-3d44-4384-878a-7c51c22fa65f" released by "delete_volume" :: held 0.771s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:43:37 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-73414059-f39b-4786-8879-dd535c4a7530 tempest-ProjectMemberTests-1774785373 None] Created reservations ['4002ffe2-3f7b-4ed3-80bd-dcf1374978f5', 'ccd8309b-c446-4681-932d-d2da5ab832b2', '71d6db54-009e-402c-8174-8f0164b2fc5a', '32922ed5-dda5-4275-96e9-fdf37a304078'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:43:37 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-73414059-f39b-4786-8879-dd535c4a7530 tempest-ProjectMemberTests-1774785373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:43:37 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-73414059-f39b-4786-8879-dd535c4a7530 tempest-ProjectMemberTests-1774785373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:43:37 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-73414059-f39b-4786-8879-dd535c4a7530 tempest-ProjectMemberTests-1774785373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:43:37 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-73414059-f39b-4786-8879-dd535c4a7530 tempest-ProjectMemberTests-1774785373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:43:37 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-73414059-f39b-4786-8879-dd535c4a7530 tempest-ProjectMemberTests-1774785373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:43:37 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-73414059-f39b-4786-8879-dd535c4a7530 tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:37 devstack sudo[115154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:43:37 devstack sudo[115154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:37 devstack sudo[115152]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:37 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-0b845bda-928e-40bf-9a90-5fdd875e277a tempest-ProjectReaderTests-1882876355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-07aa4f73-30c2-423d-9e06-394e7eee1da6.info" returned: 0 in 0.293s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:37 devstack cinder-volume[94394]: WARNING cinder.volume.drivers.remotefs [None req-0b845bda-928e-40bf-9a90-5fdd875e277a tempest-ProjectReaderTests-1882876355 None] /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-07aa4f73-30c2-423d-9e06-394e7eee1da6.info is being set with open permissions: ugo+rw Aug 26 14:43:37 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-0b845bda-928e-40bf-9a90-5fdd875e277a tempest-ProjectReaderTests-1882876355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-07aa4f73-30c2-423d-9e06-394e7eee1da6.info {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:37 devstack sudo[115157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-07aa4f73-30c2-423d-9e06-394e7eee1da6.info Aug 26 14:43:37 devstack sudo[115157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:37 devstack sudo[115154]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:37 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-73414059-f39b-4786-8879-dd535c4a7530 tempest-ProjectMemberTests-1774785373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.305s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:37 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-73414059-f39b-4786-8879-dd535c4a7530 tempest-ProjectMemberTests-1774785373 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:43:38 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-73414059-f39b-4786-8879-dd535c4a7530 tempest-ProjectMemberTests-1774785373 None] Deleted volume successfully. Aug 26 14:43:38 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-73414059-f39b-4786-8879-dd535c4a7530 tempest-ProjectMemberTests-1774785373 None] Lock "cinder-10a1ebe0-3d44-4384-878a-7c51c22fa65f-delete_volume" released by "delete_volume" :: held 1.318s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:43:38 devstack sudo[115157]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:38 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-0b845bda-928e-40bf-9a90-5fdd875e277a tempest-ProjectReaderTests-1882876355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-07aa4f73-30c2-423d-9e06-394e7eee1da6.info" returned: 0 in 0.314s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:38 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-0b845bda-928e-40bf-9a90-5fdd875e277a tempest-ProjectReaderTests-1882876355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.288s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:43:38 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-0b845bda-928e-40bf-9a90-5fdd875e277a tempest-ProjectReaderTests-1882876355 None] Create snapshot completed successfully Aug 26 14:43:38 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-456a6a23-1f2c-49b9-b00b-7bb53c9762ab tempest-ProjectMemberTests-1774785373 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:43:38 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-456a6a23-1f2c-49b9-b00b-7bb53c9762ab tempest-ProjectMemberTests-1774785373 None] Flow 'volume_create_manager' (edaf1214-b731-465d-86f0-efa9ab918eb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:43:38 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-456a6a23-1f2c-49b9-b00b-7bb53c9762ab tempest-ProjectMemberTests-1774785373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c16f77d-9f43-41c1-9e9f-87f7a8f302b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:43:38 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-456a6a23-1f2c-49b9-b00b-7bb53c9762ab tempest-ProjectMemberTests-1774785373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c16f77d-9f43-41c1-9e9f-87f7a8f302b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:43:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1339240436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c3df1a4-0cd4-4188-b330-8567d4e60dd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8dd248190cb40cebc9daf2b89f48fd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:43:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:43:38Z,use_quota=True,user_id='ad0617c386b6460d8f790d85646880e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:43:38 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-456a6a23-1f2c-49b9-b00b-7bb53c9762ab tempest-ProjectMemberTests-1774785373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32c07a27-5cc8-413b-b4a1-89740d4de9cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:43:38 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-456a6a23-1f2c-49b9-b00b-7bb53c9762ab tempest-ProjectMemberTests-1774785373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32c07a27-5cc8-413b-b4a1-89740d4de9cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:43:38 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-456a6a23-1f2c-49b9-b00b-7bb53c9762ab tempest-ProjectMemberTests-1774785373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1ac6f70-6bf6-4608-923b-869f2fe7e0b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:43:38 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-456a6a23-1f2c-49b9-b00b-7bb53c9762ab tempest-ProjectMemberTests-1774785373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1ac6f70-6bf6-4608-923b-869f2fe7e0b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c3df1a4-0cd4-4188-b330-8567d4e60dd5', 'volume_name': 'volume-9c3df1a4-0cd4-4188-b330-8567d4e60dd5', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:43:38 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-456a6a23-1f2c-49b9-b00b-7bb53c9762ab tempest-ProjectMemberTests-1774785373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd037e3f-3a8e-49b2-b3cc-5c0bd7f54324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:43:38 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-456a6a23-1f2c-49b9-b00b-7bb53c9762ab tempest-ProjectMemberTests-1774785373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd037e3f-3a8e-49b2-b3cc-5c0bd7f54324) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:43:38 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-456a6a23-1f2c-49b9-b00b-7bb53c9762ab tempest-ProjectMemberTests-1774785373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50fd5cee-760b-41fb-a887-6f1adbfe679d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:43:38 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-456a6a23-1f2c-49b9-b00b-7bb53c9762ab tempest-ProjectMemberTests-1774785373 None] Volume 9c3df1a4-0cd4-4188-b330-8567d4e60dd5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c3df1a4-0cd4-4188-b330-8567d4e60dd5', 'volume_size': 1} Aug 26 14:43:38 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-456a6a23-1f2c-49b9-b00b-7bb53c9762ab tempest-ProjectMemberTests-1774785373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:43:38 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-456a6a23-1f2c-49b9-b00b-7bb53c9762ab tempest-ProjectMemberTests-1774785373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:43:38 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-456a6a23-1f2c-49b9-b00b-7bb53c9762ab tempest-ProjectMemberTests-1774785373 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:43:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1339240436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c3df1a4-0cd4-4188-b330-8567d4e60dd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8dd248190cb40cebc9daf2b89f48fd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:43:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:43:38Z,use_quota=True,user_id='ad0617c386b6460d8f790d85646880e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:43:38 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-456a6a23-1f2c-49b9-b00b-7bb53c9762ab tempest-ProjectMemberTests-1774785373 None] Creating volume 9c3df1a4-0cd4-4188-b330-8567d4e60dd5 {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:43:38 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-456a6a23-1f2c-49b9-b00b-7bb53c9762ab tempest-ProjectMemberTests-1774785373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:43:38 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-456a6a23-1f2c-49b9-b00b-7bb53c9762ab tempest-ProjectMemberTests-1774785373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:43:38 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-456a6a23-1f2c-49b9-b00b-7bb53c9762ab tempest-ProjectMemberTests-1774785373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:43:38 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-456a6a23-1f2c-49b9-b00b-7bb53c9762ab tempest-ProjectMemberTests-1774785373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:43:38 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-456a6a23-1f2c-49b9-b00b-7bb53c9762ab tempest-ProjectMemberTests-1774785373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:43:38 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-456a6a23-1f2c-49b9-b00b-7bb53c9762ab tempest-ProjectMemberTests-1774785373 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:43:38 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-456a6a23-1f2c-49b9-b00b-7bb53c9762ab tempest-ProjectMemberTests-1774785373 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:43:38 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-456a6a23-1f2c-49b9-b00b-7bb53c9762ab tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9c3df1a4-0cd4-4188-b330-8567d4e60dd5 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:38 devstack sudo[115161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9c3df1a4-0cd4-4188-b330-8567d4e60dd5 1073741824 Aug 26 14:43:38 devstack sudo[115161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:38 devstack sudo[115161]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:38 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-456a6a23-1f2c-49b9-b00b-7bb53c9762ab tempest-ProjectMemberTests-1774785373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9c3df1a4-0cd4-4188-b330-8567d4e60dd5 1073741824" returned: 0 in 0.418s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:38 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-456a6a23-1f2c-49b9-b00b-7bb53c9762ab tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9c3df1a4-0cd4-4188-b330-8567d4e60dd5 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:38 devstack sudo[115166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9c3df1a4-0cd4-4188-b330-8567d4e60dd5 Aug 26 14:43:38 devstack sudo[115166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:39 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-04745504-a17f-4a71-aea8-90c1bc45188d tempest-ProjectReaderTests-1882876355 None] Acquiring lock "cinder-b5bba92f-347e-4876-961e-1b6fbd3428c6-delete_snapshot" by "delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:43:39 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-04745504-a17f-4a71-aea8-90c1bc45188d tempest-ProjectReaderTests-1882876355 None] Lock "cinder-b5bba92f-347e-4876-961e-1b6fbd3428c6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:43:39 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-04745504-a17f-4a71-aea8-90c1bc45188d tempest-ProjectReaderTests-1882876355 None] Acquiring lock "cinder-quobyte-07aa4f73-30c2-423d-9e06-394e7eee1da6" by "delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:43:39 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-04745504-a17f-4a71-aea8-90c1bc45188d tempest-ProjectReaderTests-1882876355 None] Lock "cinder-quobyte-07aa4f73-30c2-423d-9e06-394e7eee1da6" acquired by "delete_snapshot" :: waited 0.021s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:43:39 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-04745504-a17f-4a71-aea8-90c1bc45188d tempest-ProjectReaderTests-1882876355 None] Acquiring lock "cinder-quobyte-b5bba92f-347e-4876-961e-1b6fbd3428c6" by "_delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:43:39 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-04745504-a17f-4a71-aea8-90c1bc45188d tempest-ProjectReaderTests-1882876355 None] Lock "cinder-quobyte-b5bba92f-347e-4876-961e-1b6fbd3428c6" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:43:39 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-04745504-a17f-4a71-aea8-90c1bc45188d tempest-ProjectReaderTests-1882876355 None] Deleting offline snapshot b5bba92f-347e-4876-961e-1b6fbd3428c6 of volume 07aa4f73-30c2-423d-9e06-394e7eee1da6 {{(pid=94394) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 14:43:39 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-04745504-a17f-4a71-aea8-90c1bc45188d tempest-ProjectReaderTests-1882876355 None] snapshot_file for this snap is: volume-07aa4f73-30c2-423d-9e06-394e7eee1da6.b5bba92f-347e-4876-961e-1b6fbd3428c6 {{(pid=94394) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 14:43:39 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[29e5e40f-6fe6-462f-a800-e26b0203ae82]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:43:39 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-04745504-a17f-4a71-aea8-90c1bc45188d tempest-ProjectReaderTests-1882876355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-07aa4f73-30c2-423d-9e06-394e7eee1da6.b5bba92f-347e-4876-961e-1b6fbd3428c6 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:39 devstack sudo[115166]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:39 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-456a6a23-1f2c-49b9-b00b-7bb53c9762ab tempest-ProjectMemberTests-1774785373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9c3df1a4-0cd4-4188-b330-8567d4e60dd5" returned: 0 in 0.259s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:39 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-456a6a23-1f2c-49b9-b00b-7bb53c9762ab tempest-ProjectMemberTests-1774785373 None] <== create_volume: return (720ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:43:39 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-456a6a23-1f2c-49b9-b00b-7bb53c9762ab tempest-ProjectMemberTests-1774785373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.722s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:43:39 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-456a6a23-1f2c-49b9-b00b-7bb53c9762ab tempest-ProjectMemberTests-1774785373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50fd5cee-760b-41fb-a887-6f1adbfe679d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c3df1a4-0cd4-4188-b330-8567d4e60dd5', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:43:39 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-456a6a23-1f2c-49b9-b00b-7bb53c9762ab tempest-ProjectMemberTests-1774785373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5e91cbc-aefc-49db-9148-2991fdf7cc6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:43:39 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-456a6a23-1f2c-49b9-b00b-7bb53c9762ab tempest-ProjectMemberTests-1774785373 None] Volume volume-9c3df1a4-0cd4-4188-b330-8567d4e60dd5 (9c3df1a4-0cd4-4188-b330-8567d4e60dd5): created successfully Aug 26 14:43:39 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-456a6a23-1f2c-49b9-b00b-7bb53c9762ab tempest-ProjectMemberTests-1774785373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5e91cbc-aefc-49db-9148-2991fdf7cc6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:43:39 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-456a6a23-1f2c-49b9-b00b-7bb53c9762ab tempest-ProjectMemberTests-1774785373 None] Flow 'volume_create_manager' (edaf1214-b731-465d-86f0-efa9ab918eb0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:43:39 devstack sudo[115168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-07aa4f73-30c2-423d-9e06-394e7eee1da6.b5bba92f-347e-4876-961e-1b6fbd3428c6 Aug 26 14:43:39 devstack sudo[115168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:39 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-456a6a23-1f2c-49b9-b00b-7bb53c9762ab tempest-ProjectMemberTests-1774785373 None] Created volume successfully. Aug 26 14:43:39 devstack sudo[115168]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:39 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-04745504-a17f-4a71-aea8-90c1bc45188d tempest-ProjectReaderTests-1882876355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-07aa4f73-30c2-423d-9e06-394e7eee1da6.b5bba92f-347e-4876-961e-1b6fbd3428c6" returned: 0 in 0.379s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:39 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-04745504-a17f-4a71-aea8-90c1bc45188d tempest-ProjectReaderTests-1882876355 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-07aa4f73-30c2-423d-9e06-394e7eee1da6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94394) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 14:43:39 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[2acc6861-bcee-4344-9730-0a2fca2e0f9a]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:43:39 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-04745504-a17f-4a71-aea8-90c1bc45188d tempest-ProjectReaderTests-1882876355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-07aa4f73-30c2-423d-9e06-394e7eee1da6 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:39 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-be5a6a28-6f2a-4021-9619-49a0f355f4e3 tempest-ProjectMemberTests-1774785373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:43:39 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-be5a6a28-6f2a-4021-9619-49a0f355f4e3 tempest-ProjectMemberTests-1774785373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:43:39 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-be5a6a28-6f2a-4021-9619-49a0f355f4e3 tempest-ProjectMemberTests-1774785373 None] Creating offline snapshot dd5cda06-f1d6-476b-9c72-73c418f44959 of volume 9c3df1a4-0cd4-4188-b330-8567d4e60dd5 {{(pid=94394) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 14:43:39 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[20bcf706-ff36-4a5f-9de5-82ee8d02a0a0]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:43:39 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-be5a6a28-6f2a-4021-9619-49a0f355f4e3 tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9c3df1a4-0cd4-4188-b330-8567d4e60dd5 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:39 devstack sudo[115174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-07aa4f73-30c2-423d-9e06-394e7eee1da6 Aug 26 14:43:39 devstack sudo[115174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:39 devstack sudo[115175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9c3df1a4-0cd4-4188-b330-8567d4e60dd5 Aug 26 14:43:39 devstack sudo[115175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:39 devstack sudo[115174]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:39 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-04745504-a17f-4a71-aea8-90c1bc45188d tempest-ProjectReaderTests-1882876355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-07aa4f73-30c2-423d-9e06-394e7eee1da6" returned: 0 in 0.365s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:39 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-04745504-a17f-4a71-aea8-90c1bc45188d tempest-ProjectReaderTests-1882876355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-07aa4f73-30c2-423d-9e06-394e7eee1da6.b5bba92f-347e-4876-961e-1b6fbd3428c6 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:39 devstack sudo[115183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-07aa4f73-30c2-423d-9e06-394e7eee1da6.b5bba92f-347e-4876-961e-1b6fbd3428c6 Aug 26 14:43:39 devstack sudo[115183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:39 devstack sudo[115175]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:39 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-be5a6a28-6f2a-4021-9619-49a0f355f4e3 tempest-ProjectMemberTests-1774785373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9c3df1a4-0cd4-4188-b330-8567d4e60dd5" returned: 0 in 0.365s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:39 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-be5a6a28-6f2a-4021-9619-49a0f355f4e3 tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9c3df1a4-0cd4-4188-b330-8567d4e60dd5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9c3df1a4-0cd4-4188-b330-8567d4e60dd5.dd5cda06-f1d6-476b-9c72-73c418f44959 1G {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:40 devstack sudo[115187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9c3df1a4-0cd4-4188-b330-8567d4e60dd5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9c3df1a4-0cd4-4188-b330-8567d4e60dd5.dd5cda06-f1d6-476b-9c72-73c418f44959 1G Aug 26 14:43:40 devstack sudo[115187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:40 devstack sudo[115183]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:40 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-04745504-a17f-4a71-aea8-90c1bc45188d tempest-ProjectReaderTests-1882876355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-07aa4f73-30c2-423d-9e06-394e7eee1da6.b5bba92f-347e-4876-961e-1b6fbd3428c6" returned: 0 in 0.345s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:40 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-04745504-a17f-4a71-aea8-90c1bc45188d tempest-ProjectReaderTests-1882876355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-07aa4f73-30c2-423d-9e06-394e7eee1da6.b5bba92f-347e-4876-961e-1b6fbd3428c6 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:40 devstack sudo[115196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-07aa4f73-30c2-423d-9e06-394e7eee1da6.b5bba92f-347e-4876-961e-1b6fbd3428c6 Aug 26 14:43:40 devstack sudo[115196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:40 devstack sudo[115187]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:40 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-be5a6a28-6f2a-4021-9619-49a0f355f4e3 tempest-ProjectMemberTests-1774785373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9c3df1a4-0cd4-4188-b330-8567d4e60dd5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9c3df1a4-0cd4-4188-b330-8567d4e60dd5.dd5cda06-f1d6-476b-9c72-73c418f44959 1G" returned: 0 in 0.410s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:40 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-be5a6a28-6f2a-4021-9619-49a0f355f4e3 tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c3df1a4-0cd4-4188-b330-8567d4e60dd5 -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9c3df1a4-0cd4-4188-b330-8567d4e60dd5.dd5cda06-f1d6-476b-9c72-73c418f44959 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:40 devstack sudo[115198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c3df1a4-0cd4-4188-b330-8567d4e60dd5 -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9c3df1a4-0cd4-4188-b330-8567d4e60dd5.dd5cda06-f1d6-476b-9c72-73c418f44959 Aug 26 14:43:40 devstack sudo[115198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:40 devstack sudo[115196]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:40 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-04745504-a17f-4a71-aea8-90c1bc45188d tempest-ProjectReaderTests-1882876355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-07aa4f73-30c2-423d-9e06-394e7eee1da6.b5bba92f-347e-4876-961e-1b6fbd3428c6" returned: 0 in 0.257s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:40 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-04745504-a17f-4a71-aea8-90c1bc45188d tempest-ProjectReaderTests-1882876355 None] Lock "cinder-quobyte-b5bba92f-347e-4876-961e-1b6fbd3428c6" released by "_delete_snapshot" :: held 1.454s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:43:40 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-04745504-a17f-4a71-aea8-90c1bc45188d tempest-ProjectReaderTests-1882876355 None] Lock "cinder-quobyte-07aa4f73-30c2-423d-9e06-394e7eee1da6" released by "delete_snapshot" :: held 1.479s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:43:40 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-04745504-a17f-4a71-aea8-90c1bc45188d tempest-ProjectReaderTests-1882876355 None] Created reservations ['e138d032-427f-4da3-96fe-8148ffbf01ad', '91777396-855c-45b9-9b02-6ed3a7fd31ed', 'a164cd23-8f4d-4554-a479-a8f2104171fb', '6d7f2ca6-7817-413f-9358-e1d226cb1009'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:43:40 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-04745504-a17f-4a71-aea8-90c1bc45188d tempest-ProjectReaderTests-1882876355 None] Delete snapshot completed successfully. Aug 26 14:43:40 devstack sudo[115198]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:40 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-04745504-a17f-4a71-aea8-90c1bc45188d tempest-ProjectReaderTests-1882876355 None] Lock "cinder-b5bba92f-347e-4876-961e-1b6fbd3428c6-delete_snapshot" released by "delete_snapshot" :: held 1.630s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:43:40 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-be5a6a28-6f2a-4021-9619-49a0f355f4e3 tempest-ProjectMemberTests-1774785373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c3df1a4-0cd4-4188-b330-8567d4e60dd5 -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9c3df1a4-0cd4-4188-b330-8567d4e60dd5.dd5cda06-f1d6-476b-9c72-73c418f44959" returned: 0 in 0.297s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:40 devstack cinder-volume[94394]: WARNING cinder.volume.drivers.remotefs [None req-be5a6a28-6f2a-4021-9619-49a0f355f4e3 tempest-ProjectMemberTests-1774785373 None] /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9c3df1a4-0cd4-4188-b330-8567d4e60dd5.dd5cda06-f1d6-476b-9c72-73c418f44959 is being set with open permissions: ugo+rw Aug 26 14:43:40 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-be5a6a28-6f2a-4021-9619-49a0f355f4e3 tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9c3df1a4-0cd4-4188-b330-8567d4e60dd5.dd5cda06-f1d6-476b-9c72-73c418f44959 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:40 devstack sudo[115206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9c3df1a4-0cd4-4188-b330-8567d4e60dd5.dd5cda06-f1d6-476b-9c72-73c418f44959 Aug 26 14:43:40 devstack sudo[115206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:40 devstack sudo[115206]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:40 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-be5a6a28-6f2a-4021-9619-49a0f355f4e3 tempest-ProjectMemberTests-1774785373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9c3df1a4-0cd4-4188-b330-8567d4e60dd5.dd5cda06-f1d6-476b-9c72-73c418f44959" returned: 0 in 0.246s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:40 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-be5a6a28-6f2a-4021-9619-49a0f355f4e3 tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9c3df1a4-0cd4-4188-b330-8567d4e60dd5.info {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:40 devstack sudo[115209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9c3df1a4-0cd4-4188-b330-8567d4e60dd5.info Aug 26 14:43:40 devstack sudo[115209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:41 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-3b45ca5f-799d-46ee-82d1-7cef165f4b7a tempest-ProjectReaderTests-1882876355 None] Acquiring lock "cinder-07aa4f73-30c2-423d-9e06-394e7eee1da6-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:43:41 devstack sudo[115209]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:41 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-be5a6a28-6f2a-4021-9619-49a0f355f4e3 tempest-ProjectMemberTests-1774785373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9c3df1a4-0cd4-4188-b330-8567d4e60dd5.info" returned: 0 in 0.255s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:41 devstack cinder-volume[94394]: WARNING cinder.volume.drivers.remotefs [None req-be5a6a28-6f2a-4021-9619-49a0f355f4e3 tempest-ProjectMemberTests-1774785373 None] /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9c3df1a4-0cd4-4188-b330-8567d4e60dd5.info is being set with open permissions: ugo+rw Aug 26 14:43:41 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-be5a6a28-6f2a-4021-9619-49a0f355f4e3 tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9c3df1a4-0cd4-4188-b330-8567d4e60dd5.info {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:41 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-3b45ca5f-799d-46ee-82d1-7cef165f4b7a tempest-ProjectReaderTests-1882876355 None] Lock "cinder-07aa4f73-30c2-423d-9e06-394e7eee1da6-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:43:41 devstack sudo[115212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9c3df1a4-0cd4-4188-b330-8567d4e60dd5.info Aug 26 14:43:41 devstack sudo[115212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:41 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-3b45ca5f-799d-46ee-82d1-7cef165f4b7a tempest-ProjectReaderTests-1882876355 None] Acquiring lock "cinder-quobyte-07aa4f73-30c2-423d-9e06-394e7eee1da6" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:43:41 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-3b45ca5f-799d-46ee-82d1-7cef165f4b7a tempest-ProjectReaderTests-1882876355 None] Lock "cinder-quobyte-07aa4f73-30c2-423d-9e06-394e7eee1da6" acquired by "delete_volume" :: waited 0.017s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:43:41 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[23733c22-9104-4e4d-9033-a6755c894a05]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:43:41 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-3b45ca5f-799d-46ee-82d1-7cef165f4b7a tempest-ProjectReaderTests-1882876355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-07aa4f73-30c2-423d-9e06-394e7eee1da6 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:41 devstack sudo[115214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-07aa4f73-30c2-423d-9e06-394e7eee1da6 Aug 26 14:43:41 devstack sudo[115214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:41 devstack sudo[115212]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:41 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-be5a6a28-6f2a-4021-9619-49a0f355f4e3 tempest-ProjectMemberTests-1774785373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9c3df1a4-0cd4-4188-b330-8567d4e60dd5.info" returned: 0 in 0.265s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:41 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-be5a6a28-6f2a-4021-9619-49a0f355f4e3 tempest-ProjectMemberTests-1774785373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.918s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:43:41 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-be5a6a28-6f2a-4021-9619-49a0f355f4e3 tempest-ProjectMemberTests-1774785373 None] Create snapshot completed successfully Aug 26 14:43:41 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-005ba14e-4ffa-4843-9f69-6f3ef899181a tempest-ProjectMemberTests-1774785373 None] Acquiring lock "cinder-dd5cda06-f1d6-476b-9c72-73c418f44959-delete_snapshot" by "delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:43:41 devstack sudo[115214]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:41 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-3b45ca5f-799d-46ee-82d1-7cef165f4b7a tempest-ProjectReaderTests-1882876355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-07aa4f73-30c2-423d-9e06-394e7eee1da6" returned: 0 in 0.369s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:41 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-3b45ca5f-799d-46ee-82d1-7cef165f4b7a tempest-ProjectReaderTests-1882876355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-07aa4f73-30c2-423d-9e06-394e7eee1da6 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:41 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-005ba14e-4ffa-4843-9f69-6f3ef899181a tempest-ProjectMemberTests-1774785373 None] Lock "cinder-dd5cda06-f1d6-476b-9c72-73c418f44959-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:43:41 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-005ba14e-4ffa-4843-9f69-6f3ef899181a tempest-ProjectMemberTests-1774785373 None] Acquiring lock "cinder-quobyte-9c3df1a4-0cd4-4188-b330-8567d4e60dd5" by "delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:43:41 devstack sudo[115220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-07aa4f73-30c2-423d-9e06-394e7eee1da6 Aug 26 14:43:41 devstack sudo[115220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:41 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-005ba14e-4ffa-4843-9f69-6f3ef899181a tempest-ProjectMemberTests-1774785373 None] Lock "cinder-quobyte-9c3df1a4-0cd4-4188-b330-8567d4e60dd5" acquired by "delete_snapshot" :: waited 0.019s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:43:41 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-005ba14e-4ffa-4843-9f69-6f3ef899181a tempest-ProjectMemberTests-1774785373 None] Acquiring lock "cinder-quobyte-dd5cda06-f1d6-476b-9c72-73c418f44959" by "_delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:43:41 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-005ba14e-4ffa-4843-9f69-6f3ef899181a tempest-ProjectMemberTests-1774785373 None] Lock "cinder-quobyte-dd5cda06-f1d6-476b-9c72-73c418f44959" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:43:41 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-005ba14e-4ffa-4843-9f69-6f3ef899181a tempest-ProjectMemberTests-1774785373 None] Deleting offline snapshot dd5cda06-f1d6-476b-9c72-73c418f44959 of volume 9c3df1a4-0cd4-4188-b330-8567d4e60dd5 {{(pid=94394) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 14:43:41 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-005ba14e-4ffa-4843-9f69-6f3ef899181a tempest-ProjectMemberTests-1774785373 None] snapshot_file for this snap is: volume-9c3df1a4-0cd4-4188-b330-8567d4e60dd5.dd5cda06-f1d6-476b-9c72-73c418f44959 {{(pid=94394) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 14:43:41 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cf8f65f-d3d2-40ef-a4e0-732afa4dc59a]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:43:41 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-005ba14e-4ffa-4843-9f69-6f3ef899181a tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9c3df1a4-0cd4-4188-b330-8567d4e60dd5.dd5cda06-f1d6-476b-9c72-73c418f44959 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:41 devstack sudo[115222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9c3df1a4-0cd4-4188-b330-8567d4e60dd5.dd5cda06-f1d6-476b-9c72-73c418f44959 Aug 26 14:43:41 devstack sudo[115222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:41 devstack sudo[115220]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:41 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-3b45ca5f-799d-46ee-82d1-7cef165f4b7a tempest-ProjectReaderTests-1882876355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-07aa4f73-30c2-423d-9e06-394e7eee1da6" returned: 0 in 0.267s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:42 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-3b45ca5f-799d-46ee-82d1-7cef165f4b7a tempest-ProjectReaderTests-1882876355 None] Lock "cinder-quobyte-07aa4f73-30c2-423d-9e06-394e7eee1da6" released by "delete_volume" :: held 0.693s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:43:42 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-3b45ca5f-799d-46ee-82d1-7cef165f4b7a tempest-ProjectReaderTests-1882876355 None] Created reservations ['2c1f852b-31a5-48a7-8be1-1f4e628ef6fd', 'ab8a2fb8-e899-4ae0-b186-3472679ba31f', '480a843d-f384-4dc6-9894-942e73a99954', 'bcc51c58-8eb3-42ae-9c4a-8a0307358d0b'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:43:42 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-3b45ca5f-799d-46ee-82d1-7cef165f4b7a tempest-ProjectReaderTests-1882876355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:43:42 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-3b45ca5f-799d-46ee-82d1-7cef165f4b7a tempest-ProjectReaderTests-1882876355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:43:42 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-3b45ca5f-799d-46ee-82d1-7cef165f4b7a tempest-ProjectReaderTests-1882876355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:43:42 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-3b45ca5f-799d-46ee-82d1-7cef165f4b7a tempest-ProjectReaderTests-1882876355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:43:42 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-3b45ca5f-799d-46ee-82d1-7cef165f4b7a tempest-ProjectReaderTests-1882876355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:43:42 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-3b45ca5f-799d-46ee-82d1-7cef165f4b7a tempest-ProjectReaderTests-1882876355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:42 devstack sudo[115227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:43:42 devstack sudo[115227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:42 devstack sudo[115222]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:42 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-005ba14e-4ffa-4843-9f69-6f3ef899181a tempest-ProjectMemberTests-1774785373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9c3df1a4-0cd4-4188-b330-8567d4e60dd5.dd5cda06-f1d6-476b-9c72-73c418f44959" returned: 0 in 0.381s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:42 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-005ba14e-4ffa-4843-9f69-6f3ef899181a tempest-ProjectMemberTests-1774785373 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9c3df1a4-0cd4-4188-b330-8567d4e60dd5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94394) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 14:43:42 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a5e1978-3c0b-4af1-b864-d70db34ff375]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:43:42 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-005ba14e-4ffa-4843-9f69-6f3ef899181a tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9c3df1a4-0cd4-4188-b330-8567d4e60dd5 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:42 devstack sudo[115230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9c3df1a4-0cd4-4188-b330-8567d4e60dd5 Aug 26 14:43:42 devstack sudo[115230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:42 devstack sudo[115227]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:42 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-3b45ca5f-799d-46ee-82d1-7cef165f4b7a tempest-ProjectReaderTests-1882876355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.262s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:42 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-3b45ca5f-799d-46ee-82d1-7cef165f4b7a tempest-ProjectReaderTests-1882876355 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:43:42 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-3b45ca5f-799d-46ee-82d1-7cef165f4b7a tempest-ProjectReaderTests-1882876355 None] Deleted volume successfully. Aug 26 14:43:42 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-3b45ca5f-799d-46ee-82d1-7cef165f4b7a tempest-ProjectReaderTests-1882876355 None] Lock "cinder-07aa4f73-30c2-423d-9e06-394e7eee1da6-delete_volume" released by "delete_volume" :: held 1.178s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:43:42 devstack sudo[115230]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:42 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-005ba14e-4ffa-4843-9f69-6f3ef899181a tempest-ProjectMemberTests-1774785373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9c3df1a4-0cd4-4188-b330-8567d4e60dd5" returned: 0 in 0.392s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:42 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-005ba14e-4ffa-4843-9f69-6f3ef899181a tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9c3df1a4-0cd4-4188-b330-8567d4e60dd5.dd5cda06-f1d6-476b-9c72-73c418f44959 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:42 devstack sudo[115236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9c3df1a4-0cd4-4188-b330-8567d4e60dd5.dd5cda06-f1d6-476b-9c72-73c418f44959 Aug 26 14:43:42 devstack sudo[115236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:42 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e4cede4-2a77-42d6-bf30-ff2fe168761b tempest-ProjectReaderTests-1882876355 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:43:42 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-3e4cede4-2a77-42d6-bf30-ff2fe168761b tempest-ProjectReaderTests-1882876355 None] Flow 'volume_create_manager' (96bcd13d-221e-44ad-b0e5-e3c9ebb0a5a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:43:42 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-3e4cede4-2a77-42d6-bf30-ff2fe168761b tempest-ProjectReaderTests-1882876355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3e87610-02ec-4b50-bb2c-c01eef2ab617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:43:42 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-3e4cede4-2a77-42d6-bf30-ff2fe168761b tempest-ProjectReaderTests-1882876355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3e87610-02ec-4b50-bb2c-c01eef2ab617) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:43:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1999550290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=041dd4bf-3836-404a-bac5-287ec4f3802d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57364cca92024529a3a58d2a3e634ba3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:43:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:43:43Z,use_quota=True,user_id='23a9f0a2e5524f5485f0d17c6acdc640',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:43:42 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-3e4cede4-2a77-42d6-bf30-ff2fe168761b tempest-ProjectReaderTests-1882876355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85f59497-2cb1-4ae1-bfae-513c77fccee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:43:42 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-3e4cede4-2a77-42d6-bf30-ff2fe168761b tempest-ProjectReaderTests-1882876355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85f59497-2cb1-4ae1-bfae-513c77fccee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:43:42 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-3e4cede4-2a77-42d6-bf30-ff2fe168761b tempest-ProjectReaderTests-1882876355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d1f997e-4f7b-4425-a7d1-7ffd334e3d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:43:42 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-3e4cede4-2a77-42d6-bf30-ff2fe168761b tempest-ProjectReaderTests-1882876355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d1f997e-4f7b-4425-a7d1-7ffd334e3d9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '041dd4bf-3836-404a-bac5-287ec4f3802d', 'volume_name': 'volume-041dd4bf-3836-404a-bac5-287ec4f3802d', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:43:42 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-3e4cede4-2a77-42d6-bf30-ff2fe168761b tempest-ProjectReaderTests-1882876355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ce06628-5498-4e62-aecb-16644ae9a813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:43:42 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-3e4cede4-2a77-42d6-bf30-ff2fe168761b tempest-ProjectReaderTests-1882876355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ce06628-5498-4e62-aecb-16644ae9a813) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:43:42 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-3e4cede4-2a77-42d6-bf30-ff2fe168761b tempest-ProjectReaderTests-1882876355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b226ada6-c32a-4123-80f2-1c7663bab3f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:43:42 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-3e4cede4-2a77-42d6-bf30-ff2fe168761b tempest-ProjectReaderTests-1882876355 None] Volume 041dd4bf-3836-404a-bac5-287ec4f3802d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-041dd4bf-3836-404a-bac5-287ec4f3802d', 'volume_size': 1} Aug 26 14:43:42 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-3e4cede4-2a77-42d6-bf30-ff2fe168761b tempest-ProjectReaderTests-1882876355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:43:42 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-3e4cede4-2a77-42d6-bf30-ff2fe168761b tempest-ProjectReaderTests-1882876355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:43:42 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-3e4cede4-2a77-42d6-bf30-ff2fe168761b tempest-ProjectReaderTests-1882876355 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:43:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1999550290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=041dd4bf-3836-404a-bac5-287ec4f3802d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57364cca92024529a3a58d2a3e634ba3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:43:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:43:43Z,use_quota=True,user_id='23a9f0a2e5524f5485f0d17c6acdc640',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:43:42 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-3e4cede4-2a77-42d6-bf30-ff2fe168761b tempest-ProjectReaderTests-1882876355 None] Creating volume 041dd4bf-3836-404a-bac5-287ec4f3802d {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:43:42 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-3e4cede4-2a77-42d6-bf30-ff2fe168761b tempest-ProjectReaderTests-1882876355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:43:42 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-3e4cede4-2a77-42d6-bf30-ff2fe168761b tempest-ProjectReaderTests-1882876355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:43:42 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-3e4cede4-2a77-42d6-bf30-ff2fe168761b tempest-ProjectReaderTests-1882876355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:43:42 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-3e4cede4-2a77-42d6-bf30-ff2fe168761b tempest-ProjectReaderTests-1882876355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:43:42 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-3e4cede4-2a77-42d6-bf30-ff2fe168761b tempest-ProjectReaderTests-1882876355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:43:42 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-3e4cede4-2a77-42d6-bf30-ff2fe168761b tempest-ProjectReaderTests-1882876355 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:43:42 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-3e4cede4-2a77-42d6-bf30-ff2fe168761b tempest-ProjectReaderTests-1882876355 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:43:42 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-3e4cede4-2a77-42d6-bf30-ff2fe168761b tempest-ProjectReaderTests-1882876355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-041dd4bf-3836-404a-bac5-287ec4f3802d 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:42 devstack sudo[115236]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:42 devstack sudo[115248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-041dd4bf-3836-404a-bac5-287ec4f3802d 1073741824 Aug 26 14:43:42 devstack sudo[115248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:42 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-005ba14e-4ffa-4843-9f69-6f3ef899181a tempest-ProjectMemberTests-1774785373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9c3df1a4-0cd4-4188-b330-8567d4e60dd5.dd5cda06-f1d6-476b-9c72-73c418f44959" returned: 0 in 0.357s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:42 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-005ba14e-4ffa-4843-9f69-6f3ef899181a tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9c3df1a4-0cd4-4188-b330-8567d4e60dd5.dd5cda06-f1d6-476b-9c72-73c418f44959 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:42 devstack sudo[115250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9c3df1a4-0cd4-4188-b330-8567d4e60dd5.dd5cda06-f1d6-476b-9c72-73c418f44959 Aug 26 14:43:42 devstack sudo[115250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:43 devstack sudo[115250]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:43 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-005ba14e-4ffa-4843-9f69-6f3ef899181a tempest-ProjectMemberTests-1774785373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9c3df1a4-0cd4-4188-b330-8567d4e60dd5.dd5cda06-f1d6-476b-9c72-73c418f44959" returned: 0 in 0.262s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:43 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-005ba14e-4ffa-4843-9f69-6f3ef899181a tempest-ProjectMemberTests-1774785373 None] Lock "cinder-quobyte-dd5cda06-f1d6-476b-9c72-73c418f44959" released by "_delete_snapshot" :: held 1.482s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:43:43 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-005ba14e-4ffa-4843-9f69-6f3ef899181a tempest-ProjectMemberTests-1774785373 None] Lock "cinder-quobyte-9c3df1a4-0cd4-4188-b330-8567d4e60dd5" released by "delete_snapshot" :: held 1.505s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:43:43 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-005ba14e-4ffa-4843-9f69-6f3ef899181a tempest-ProjectMemberTests-1774785373 None] Created reservations ['6b79c3a4-6365-4fa9-8e9a-59e8c1ff1043', '04556b1e-741a-43f8-9cdd-cb3408c84b00', 'c3b3ee99-6a3d-4fdc-bf3f-fd7356c92b9e', '7d58f464-39e5-4101-abfc-d136c6c0e178'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:43:43 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-005ba14e-4ffa-4843-9f69-6f3ef899181a tempest-ProjectMemberTests-1774785373 None] Delete snapshot completed successfully. Aug 26 14:43:43 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-005ba14e-4ffa-4843-9f69-6f3ef899181a tempest-ProjectMemberTests-1774785373 None] Lock "cinder-dd5cda06-f1d6-476b-9c72-73c418f44959-delete_snapshot" released by "delete_snapshot" :: held 1.655s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:43:43 devstack sudo[115248]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:43 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-3e4cede4-2a77-42d6-bf30-ff2fe168761b tempest-ProjectReaderTests-1882876355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-041dd4bf-3836-404a-bac5-287ec4f3802d 1073741824" returned: 0 in 0.474s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:43 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-3e4cede4-2a77-42d6-bf30-ff2fe168761b tempest-ProjectReaderTests-1882876355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-041dd4bf-3836-404a-bac5-287ec4f3802d {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:43 devstack sudo[115258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-041dd4bf-3836-404a-bac5-287ec4f3802d Aug 26 14:43:43 devstack sudo[115258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:43 devstack sudo[115258]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:43 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-3e4cede4-2a77-42d6-bf30-ff2fe168761b tempest-ProjectReaderTests-1882876355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-041dd4bf-3836-404a-bac5-287ec4f3802d" returned: 0 in 0.236s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:43 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-3e4cede4-2a77-42d6-bf30-ff2fe168761b tempest-ProjectReaderTests-1882876355 None] <== create_volume: return (748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:43:43 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-3e4cede4-2a77-42d6-bf30-ff2fe168761b tempest-ProjectReaderTests-1882876355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.751s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:43:43 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-3e4cede4-2a77-42d6-bf30-ff2fe168761b tempest-ProjectReaderTests-1882876355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b226ada6-c32a-4123-80f2-1c7663bab3f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-041dd4bf-3836-404a-bac5-287ec4f3802d', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:43:43 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-3e4cede4-2a77-42d6-bf30-ff2fe168761b tempest-ProjectReaderTests-1882876355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f0ca071-88bf-4b4e-92c3-595b901b6c32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:43:43 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-3e4cede4-2a77-42d6-bf30-ff2fe168761b tempest-ProjectReaderTests-1882876355 None] Volume volume-041dd4bf-3836-404a-bac5-287ec4f3802d (041dd4bf-3836-404a-bac5-287ec4f3802d): created successfully Aug 26 14:43:43 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-3e4cede4-2a77-42d6-bf30-ff2fe168761b tempest-ProjectReaderTests-1882876355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f0ca071-88bf-4b4e-92c3-595b901b6c32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:43:43 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-3e4cede4-2a77-42d6-bf30-ff2fe168761b tempest-ProjectReaderTests-1882876355 None] Flow 'volume_create_manager' (96bcd13d-221e-44ad-b0e5-e3c9ebb0a5a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:43:43 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-3e4cede4-2a77-42d6-bf30-ff2fe168761b tempest-ProjectReaderTests-1882876355 None] Created volume successfully. Aug 26 14:43:43 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-08f41806-8fbe-44bd-b96f-2ce30820e24f tempest-ProjectMemberTests-1774785373 None] Acquiring lock "cinder-9c3df1a4-0cd4-4188-b330-8567d4e60dd5-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:43:43 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-08f41806-8fbe-44bd-b96f-2ce30820e24f tempest-ProjectMemberTests-1774785373 None] Lock "cinder-9c3df1a4-0cd4-4188-b330-8567d4e60dd5-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:43:43 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-08f41806-8fbe-44bd-b96f-2ce30820e24f tempest-ProjectMemberTests-1774785373 None] Acquiring lock "cinder-quobyte-9c3df1a4-0cd4-4188-b330-8567d4e60dd5" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:43:43 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-08f41806-8fbe-44bd-b96f-2ce30820e24f tempest-ProjectMemberTests-1774785373 None] Lock "cinder-quobyte-9c3df1a4-0cd4-4188-b330-8567d4e60dd5" acquired by "delete_volume" :: waited 0.016s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:43:44 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ec7b9b6-bb72-4cb7-a296-2a8b1691b726]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:43:44 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-08f41806-8fbe-44bd-b96f-2ce30820e24f tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9c3df1a4-0cd4-4188-b330-8567d4e60dd5 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:44 devstack sudo[115261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9c3df1a4-0cd4-4188-b330-8567d4e60dd5 Aug 26 14:43:44 devstack sudo[115261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:44 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-4084b9c0-6e26-4124-9b2c-193a8c4e93f4 tempest-ProjectReaderTests-1882876355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:43:44 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-4084b9c0-6e26-4124-9b2c-193a8c4e93f4 tempest-ProjectReaderTests-1882876355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:43:44 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-4084b9c0-6e26-4124-9b2c-193a8c4e93f4 tempest-ProjectReaderTests-1882876355 None] Creating offline snapshot 8c2a711a-9795-4b3e-9a69-81f72a537521 of volume 041dd4bf-3836-404a-bac5-287ec4f3802d {{(pid=94394) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 14:43:44 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[75490140-d899-40cd-9bd5-82d0c9ab1dd9]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:43:44 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4084b9c0-6e26-4124-9b2c-193a8c4e93f4 tempest-ProjectReaderTests-1882876355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-041dd4bf-3836-404a-bac5-287ec4f3802d {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:44 devstack sudo[115263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-041dd4bf-3836-404a-bac5-287ec4f3802d Aug 26 14:43:44 devstack sudo[115263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:44 devstack sudo[115261]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:44 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-08f41806-8fbe-44bd-b96f-2ce30820e24f tempest-ProjectMemberTests-1774785373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9c3df1a4-0cd4-4188-b330-8567d4e60dd5" returned: 0 in 0.374s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:44 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-08f41806-8fbe-44bd-b96f-2ce30820e24f tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9c3df1a4-0cd4-4188-b330-8567d4e60dd5 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:44 devstack sudo[115268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9c3df1a4-0cd4-4188-b330-8567d4e60dd5 Aug 26 14:43:44 devstack sudo[115268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:44 devstack sudo[115263]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:44 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4084b9c0-6e26-4124-9b2c-193a8c4e93f4 tempest-ProjectReaderTests-1882876355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-041dd4bf-3836-404a-bac5-287ec4f3802d" returned: 0 in 0.352s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:44 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4084b9c0-6e26-4124-9b2c-193a8c4e93f4 tempest-ProjectReaderTests-1882876355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-041dd4bf-3836-404a-bac5-287ec4f3802d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-041dd4bf-3836-404a-bac5-287ec4f3802d.8c2a711a-9795-4b3e-9a69-81f72a537521 1G {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:44 devstack sudo[115274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-041dd4bf-3836-404a-bac5-287ec4f3802d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-041dd4bf-3836-404a-bac5-287ec4f3802d.8c2a711a-9795-4b3e-9a69-81f72a537521 1G Aug 26 14:43:44 devstack sudo[115274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:44 devstack sudo[115268]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:44 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-08f41806-8fbe-44bd-b96f-2ce30820e24f tempest-ProjectMemberTests-1774785373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-9c3df1a4-0cd4-4188-b330-8567d4e60dd5" returned: 0 in 0.256s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:44 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-08f41806-8fbe-44bd-b96f-2ce30820e24f tempest-ProjectMemberTests-1774785373 None] Lock "cinder-quobyte-9c3df1a4-0cd4-4188-b330-8567d4e60dd5" released by "delete_volume" :: held 0.691s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:43:44 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-08f41806-8fbe-44bd-b96f-2ce30820e24f tempest-ProjectMemberTests-1774785373 None] Created reservations ['11432fe6-4459-45f4-b5bf-ddb0f901a807', 'adf08a5f-143f-40e2-a3ff-b902a68994df', '2dbbeac4-4682-49bd-9847-aff379a84839', 'b5613a05-ce41-46c9-a01e-fd082bb985d6'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:43:44 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-08f41806-8fbe-44bd-b96f-2ce30820e24f tempest-ProjectMemberTests-1774785373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:43:44 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-08f41806-8fbe-44bd-b96f-2ce30820e24f tempest-ProjectMemberTests-1774785373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:43:44 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-08f41806-8fbe-44bd-b96f-2ce30820e24f tempest-ProjectMemberTests-1774785373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:43:44 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-08f41806-8fbe-44bd-b96f-2ce30820e24f tempest-ProjectMemberTests-1774785373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:43:44 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-08f41806-8fbe-44bd-b96f-2ce30820e24f tempest-ProjectMemberTests-1774785373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:43:44 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-08f41806-8fbe-44bd-b96f-2ce30820e24f tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:44 devstack sudo[115276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:43:44 devstack sudo[115276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:45 devstack sudo[115274]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:45 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4084b9c0-6e26-4124-9b2c-193a8c4e93f4 tempest-ProjectReaderTests-1882876355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-041dd4bf-3836-404a-bac5-287ec4f3802d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-041dd4bf-3836-404a-bac5-287ec4f3802d.8c2a711a-9795-4b3e-9a69-81f72a537521 1G" returned: 0 in 0.427s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:45 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4084b9c0-6e26-4124-9b2c-193a8c4e93f4 tempest-ProjectReaderTests-1882876355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-041dd4bf-3836-404a-bac5-287ec4f3802d -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-041dd4bf-3836-404a-bac5-287ec4f3802d.8c2a711a-9795-4b3e-9a69-81f72a537521 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:45 devstack sudo[115276]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:45 devstack sudo[115282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-041dd4bf-3836-404a-bac5-287ec4f3802d -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-041dd4bf-3836-404a-bac5-287ec4f3802d.8c2a711a-9795-4b3e-9a69-81f72a537521 Aug 26 14:43:45 devstack sudo[115282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:45 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-08f41806-8fbe-44bd-b96f-2ce30820e24f tempest-ProjectMemberTests-1774785373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.282s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:45 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-08f41806-8fbe-44bd-b96f-2ce30820e24f tempest-ProjectMemberTests-1774785373 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:43:45 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-08f41806-8fbe-44bd-b96f-2ce30820e24f tempest-ProjectMemberTests-1774785373 None] Deleted volume successfully. Aug 26 14:43:45 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-08f41806-8fbe-44bd-b96f-2ce30820e24f tempest-ProjectMemberTests-1774785373 None] Lock "cinder-9c3df1a4-0cd4-4188-b330-8567d4e60dd5-delete_volume" released by "delete_volume" :: held 1.219s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:43:45 devstack sudo[115282]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:45 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4084b9c0-6e26-4124-9b2c-193a8c4e93f4 tempest-ProjectReaderTests-1882876355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-041dd4bf-3836-404a-bac5-287ec4f3802d -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-041dd4bf-3836-404a-bac5-287ec4f3802d.8c2a711a-9795-4b3e-9a69-81f72a537521" returned: 0 in 0.322s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:45 devstack cinder-volume[94394]: WARNING cinder.volume.drivers.remotefs [None req-4084b9c0-6e26-4124-9b2c-193a8c4e93f4 tempest-ProjectReaderTests-1882876355 None] /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-041dd4bf-3836-404a-bac5-287ec4f3802d.8c2a711a-9795-4b3e-9a69-81f72a537521 is being set with open permissions: ugo+rw Aug 26 14:43:45 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4084b9c0-6e26-4124-9b2c-193a8c4e93f4 tempest-ProjectReaderTests-1882876355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-041dd4bf-3836-404a-bac5-287ec4f3802d.8c2a711a-9795-4b3e-9a69-81f72a537521 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:45 devstack sudo[115287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-041dd4bf-3836-404a-bac5-287ec4f3802d.8c2a711a-9795-4b3e-9a69-81f72a537521 Aug 26 14:43:45 devstack sudo[115287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:45 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-70e8f29c-3d95-4d3b-8785-b6a3137337bd tempest-ProjectMemberTests-1774785373 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:43:45 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-70e8f29c-3d95-4d3b-8785-b6a3137337bd tempest-ProjectMemberTests-1774785373 None] Flow 'volume_create_manager' (557afd3f-e1e4-4f46-ad85-83a575636bd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:43:45 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-70e8f29c-3d95-4d3b-8785-b6a3137337bd tempest-ProjectMemberTests-1774785373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c71b5695-ff60-4a4f-aa6d-0a580912c32a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:43:45 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-70e8f29c-3d95-4d3b-8785-b6a3137337bd tempest-ProjectMemberTests-1774785373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c71b5695-ff60-4a4f-aa6d-0a580912c32a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:43:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-846869569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=385755f7-2165-441d-accd-f09fea4262d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8dd248190cb40cebc9daf2b89f48fd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:43:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:43:45Z,use_quota=True,user_id='ad0617c386b6460d8f790d85646880e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:43:45 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-70e8f29c-3d95-4d3b-8785-b6a3137337bd tempest-ProjectMemberTests-1774785373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c91fe8ce-fae9-44a2-96b4-aa62e043fed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:43:45 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-70e8f29c-3d95-4d3b-8785-b6a3137337bd tempest-ProjectMemberTests-1774785373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c91fe8ce-fae9-44a2-96b4-aa62e043fed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:43:45 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-70e8f29c-3d95-4d3b-8785-b6a3137337bd tempest-ProjectMemberTests-1774785373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2996a199-110c-4993-bb9a-39beeb0466ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:43:45 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-70e8f29c-3d95-4d3b-8785-b6a3137337bd tempest-ProjectMemberTests-1774785373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2996a199-110c-4993-bb9a-39beeb0466ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '385755f7-2165-441d-accd-f09fea4262d4', 'volume_name': 'volume-385755f7-2165-441d-accd-f09fea4262d4', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:43:45 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-70e8f29c-3d95-4d3b-8785-b6a3137337bd tempest-ProjectMemberTests-1774785373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30879f31-957f-49ed-b56b-bce4fcadad00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:43:45 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-70e8f29c-3d95-4d3b-8785-b6a3137337bd tempest-ProjectMemberTests-1774785373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30879f31-957f-49ed-b56b-bce4fcadad00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:43:45 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-70e8f29c-3d95-4d3b-8785-b6a3137337bd tempest-ProjectMemberTests-1774785373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ef8043e-0952-464f-aa95-fa727eceb905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:43:45 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-70e8f29c-3d95-4d3b-8785-b6a3137337bd tempest-ProjectMemberTests-1774785373 None] Volume 385755f7-2165-441d-accd-f09fea4262d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-385755f7-2165-441d-accd-f09fea4262d4', 'volume_size': 1} Aug 26 14:43:45 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-70e8f29c-3d95-4d3b-8785-b6a3137337bd tempest-ProjectMemberTests-1774785373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:43:45 devstack sudo[115287]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:45 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4084b9c0-6e26-4124-9b2c-193a8c4e93f4 tempest-ProjectReaderTests-1882876355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-041dd4bf-3836-404a-bac5-287ec4f3802d.8c2a711a-9795-4b3e-9a69-81f72a537521" returned: 0 in 0.261s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:45 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4084b9c0-6e26-4124-9b2c-193a8c4e93f4 tempest-ProjectReaderTests-1882876355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-041dd4bf-3836-404a-bac5-287ec4f3802d.info {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:45 devstack sudo[115290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-041dd4bf-3836-404a-bac5-287ec4f3802d.info Aug 26 14:43:45 devstack sudo[115290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:45 devstack sudo[115290]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:45 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4084b9c0-6e26-4124-9b2c-193a8c4e93f4 tempest-ProjectReaderTests-1882876355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-041dd4bf-3836-404a-bac5-287ec4f3802d.info" returned: 0 in 0.250s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:45 devstack cinder-volume[94394]: WARNING cinder.volume.drivers.remotefs [None req-4084b9c0-6e26-4124-9b2c-193a8c4e93f4 tempest-ProjectReaderTests-1882876355 None] /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-041dd4bf-3836-404a-bac5-287ec4f3802d.info is being set with open permissions: ugo+rw Aug 26 14:43:45 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4084b9c0-6e26-4124-9b2c-193a8c4e93f4 tempest-ProjectReaderTests-1882876355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-041dd4bf-3836-404a-bac5-287ec4f3802d.info {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:45 devstack sudo[115293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-041dd4bf-3836-404a-bac5-287ec4f3802d.info Aug 26 14:43:45 devstack sudo[115293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:46 devstack sudo[115293]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:46 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4084b9c0-6e26-4124-9b2c-193a8c4e93f4 tempest-ProjectReaderTests-1882876355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-041dd4bf-3836-404a-bac5-287ec4f3802d.info" returned: 0 in 0.236s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:46 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-4084b9c0-6e26-4124-9b2c-193a8c4e93f4 tempest-ProjectReaderTests-1882876355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.918s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:43:46 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-70e8f29c-3d95-4d3b-8785-b6a3137337bd tempest-ProjectMemberTests-1774785373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.563s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:43:46 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-70e8f29c-3d95-4d3b-8785-b6a3137337bd tempest-ProjectMemberTests-1774785373 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:43:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-846869569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=385755f7-2165-441d-accd-f09fea4262d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8dd248190cb40cebc9daf2b89f48fd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:43:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:43:45Z,use_quota=True,user_id='ad0617c386b6460d8f790d85646880e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:43:46 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-70e8f29c-3d95-4d3b-8785-b6a3137337bd tempest-ProjectMemberTests-1774785373 None] Creating volume 385755f7-2165-441d-accd-f09fea4262d4 {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:43:46 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-70e8f29c-3d95-4d3b-8785-b6a3137337bd tempest-ProjectMemberTests-1774785373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:43:46 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-70e8f29c-3d95-4d3b-8785-b6a3137337bd tempest-ProjectMemberTests-1774785373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:43:46 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-70e8f29c-3d95-4d3b-8785-b6a3137337bd tempest-ProjectMemberTests-1774785373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:43:46 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-70e8f29c-3d95-4d3b-8785-b6a3137337bd tempest-ProjectMemberTests-1774785373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:43:46 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-70e8f29c-3d95-4d3b-8785-b6a3137337bd tempest-ProjectMemberTests-1774785373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:43:46 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-70e8f29c-3d95-4d3b-8785-b6a3137337bd tempest-ProjectMemberTests-1774785373 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:43:46 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-70e8f29c-3d95-4d3b-8785-b6a3137337bd tempest-ProjectMemberTests-1774785373 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:43:46 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-70e8f29c-3d95-4d3b-8785-b6a3137337bd tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-385755f7-2165-441d-accd-f09fea4262d4 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:46 devstack sudo[115296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-385755f7-2165-441d-accd-f09fea4262d4 1073741824 Aug 26 14:43:46 devstack sudo[115296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:46 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-4084b9c0-6e26-4124-9b2c-193a8c4e93f4 tempest-ProjectReaderTests-1882876355 None] Create snapshot completed successfully Aug 26 14:43:46 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-c82088a3-d522-408c-878a-ab4a5ef258a1 tempest-ProjectReaderTests-1882876355 None] Acquiring lock "cinder-8c2a711a-9795-4b3e-9a69-81f72a537521-delete_snapshot" by "delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:43:46 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-c82088a3-d522-408c-878a-ab4a5ef258a1 tempest-ProjectReaderTests-1882876355 None] Lock "cinder-8c2a711a-9795-4b3e-9a69-81f72a537521-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:43:46 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-c82088a3-d522-408c-878a-ab4a5ef258a1 tempest-ProjectReaderTests-1882876355 None] Acquiring lock "cinder-quobyte-041dd4bf-3836-404a-bac5-287ec4f3802d" by "delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:43:46 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-c82088a3-d522-408c-878a-ab4a5ef258a1 tempest-ProjectReaderTests-1882876355 None] Lock "cinder-quobyte-041dd4bf-3836-404a-bac5-287ec4f3802d" acquired by "delete_snapshot" :: waited 0.023s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:43:46 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-c82088a3-d522-408c-878a-ab4a5ef258a1 tempest-ProjectReaderTests-1882876355 None] Acquiring lock "cinder-quobyte-8c2a711a-9795-4b3e-9a69-81f72a537521" by "_delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:43:46 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-c82088a3-d522-408c-878a-ab4a5ef258a1 tempest-ProjectReaderTests-1882876355 None] Lock "cinder-quobyte-8c2a711a-9795-4b3e-9a69-81f72a537521" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:43:46 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-c82088a3-d522-408c-878a-ab4a5ef258a1 tempest-ProjectReaderTests-1882876355 None] Deleting offline snapshot 8c2a711a-9795-4b3e-9a69-81f72a537521 of volume 041dd4bf-3836-404a-bac5-287ec4f3802d {{(pid=94394) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 14:43:46 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-c82088a3-d522-408c-878a-ab4a5ef258a1 tempest-ProjectReaderTests-1882876355 None] snapshot_file for this snap is: volume-041dd4bf-3836-404a-bac5-287ec4f3802d.8c2a711a-9795-4b3e-9a69-81f72a537521 {{(pid=94394) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 14:43:46 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[e32ada97-6db7-417c-9e77-b435f3ef9b63]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:43:46 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-c82088a3-d522-408c-878a-ab4a5ef258a1 tempest-ProjectReaderTests-1882876355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-041dd4bf-3836-404a-bac5-287ec4f3802d.8c2a711a-9795-4b3e-9a69-81f72a537521 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:46 devstack sudo[115301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-041dd4bf-3836-404a-bac5-287ec4f3802d.8c2a711a-9795-4b3e-9a69-81f72a537521 Aug 26 14:43:46 devstack sudo[115301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:46 devstack sudo[115296]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:46 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-70e8f29c-3d95-4d3b-8785-b6a3137337bd tempest-ProjectMemberTests-1774785373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-385755f7-2165-441d-accd-f09fea4262d4 1073741824" returned: 0 in 0.442s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:46 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-70e8f29c-3d95-4d3b-8785-b6a3137337bd tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-385755f7-2165-441d-accd-f09fea4262d4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:46 devstack sudo[115304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-385755f7-2165-441d-accd-f09fea4262d4 Aug 26 14:43:46 devstack sudo[115304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:46 devstack sudo[115301]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:46 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-c82088a3-d522-408c-878a-ab4a5ef258a1 tempest-ProjectReaderTests-1882876355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-041dd4bf-3836-404a-bac5-287ec4f3802d.8c2a711a-9795-4b3e-9a69-81f72a537521" returned: 0 in 0.361s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:46 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-c82088a3-d522-408c-878a-ab4a5ef258a1 tempest-ProjectReaderTests-1882876355 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-041dd4bf-3836-404a-bac5-287ec4f3802d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94394) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 14:43:46 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[362fe809-73f0-42e5-a923-3787028cccfb]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:43:46 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-c82088a3-d522-408c-878a-ab4a5ef258a1 tempest-ProjectReaderTests-1882876355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-041dd4bf-3836-404a-bac5-287ec4f3802d {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:46 devstack sudo[115304]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:46 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-70e8f29c-3d95-4d3b-8785-b6a3137337bd tempest-ProjectMemberTests-1774785373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-385755f7-2165-441d-accd-f09fea4262d4" returned: 0 in 0.247s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:46 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-70e8f29c-3d95-4d3b-8785-b6a3137337bd tempest-ProjectMemberTests-1774785373 None] <== create_volume: return (726ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:43:46 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-70e8f29c-3d95-4d3b-8785-b6a3137337bd tempest-ProjectMemberTests-1774785373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.728s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:43:46 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-70e8f29c-3d95-4d3b-8785-b6a3137337bd tempest-ProjectMemberTests-1774785373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ef8043e-0952-464f-aa95-fa727eceb905) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-385755f7-2165-441d-accd-f09fea4262d4', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:43:46 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-70e8f29c-3d95-4d3b-8785-b6a3137337bd tempest-ProjectMemberTests-1774785373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a4cb87c-a8ac-4a53-b43c-e9d6089c9ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:43:46 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-70e8f29c-3d95-4d3b-8785-b6a3137337bd tempest-ProjectMemberTests-1774785373 None] Volume volume-385755f7-2165-441d-accd-f09fea4262d4 (385755f7-2165-441d-accd-f09fea4262d4): created successfully Aug 26 14:43:46 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-70e8f29c-3d95-4d3b-8785-b6a3137337bd tempest-ProjectMemberTests-1774785373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a4cb87c-a8ac-4a53-b43c-e9d6089c9ff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:43:46 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-70e8f29c-3d95-4d3b-8785-b6a3137337bd tempest-ProjectMemberTests-1774785373 None] Flow 'volume_create_manager' (557afd3f-e1e4-4f46-ad85-83a575636bd2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:43:46 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-70e8f29c-3d95-4d3b-8785-b6a3137337bd tempest-ProjectMemberTests-1774785373 None] Created volume successfully. Aug 26 14:43:46 devstack sudo[115310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-041dd4bf-3836-404a-bac5-287ec4f3802d Aug 26 14:43:46 devstack sudo[115310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:47 devstack sudo[115310]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:47 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-c82088a3-d522-408c-878a-ab4a5ef258a1 tempest-ProjectReaderTests-1882876355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-041dd4bf-3836-404a-bac5-287ec4f3802d" returned: 0 in 0.365s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:47 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-c82088a3-d522-408c-878a-ab4a5ef258a1 tempest-ProjectReaderTests-1882876355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-041dd4bf-3836-404a-bac5-287ec4f3802d.8c2a711a-9795-4b3e-9a69-81f72a537521 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:47 devstack sudo[115315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-041dd4bf-3836-404a-bac5-287ec4f3802d.8c2a711a-9795-4b3e-9a69-81f72a537521 Aug 26 14:43:47 devstack sudo[115315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:47 devstack sudo[115315]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:47 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-c82088a3-d522-408c-878a-ab4a5ef258a1 tempest-ProjectReaderTests-1882876355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-041dd4bf-3836-404a-bac5-287ec4f3802d.8c2a711a-9795-4b3e-9a69-81f72a537521" returned: 0 in 0.343s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:47 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-c82088a3-d522-408c-878a-ab4a5ef258a1 tempest-ProjectReaderTests-1882876355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-041dd4bf-3836-404a-bac5-287ec4f3802d.8c2a711a-9795-4b3e-9a69-81f72a537521 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:47 devstack sudo[115321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-041dd4bf-3836-404a-bac5-287ec4f3802d.8c2a711a-9795-4b3e-9a69-81f72a537521 Aug 26 14:43:47 devstack sudo[115321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:47 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-1f9c7990-a6ea-45a5-9b28-7a68443e09d1 tempest-ProjectMemberTests-1774785373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:43:47 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-1f9c7990-a6ea-45a5-9b28-7a68443e09d1 tempest-ProjectMemberTests-1774785373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:43:47 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-1f9c7990-a6ea-45a5-9b28-7a68443e09d1 tempest-ProjectMemberTests-1774785373 None] Creating offline snapshot 66e5a53a-65ac-4f48-b106-c5de195b39bc of volume 385755f7-2165-441d-accd-f09fea4262d4 {{(pid=94394) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 14:43:47 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc1e1f5a-aa25-4cec-bee5-f89debc40ba2]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:43:47 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-1f9c7990-a6ea-45a5-9b28-7a68443e09d1 tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-385755f7-2165-441d-accd-f09fea4262d4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:47 devstack sudo[115321]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:47 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-c82088a3-d522-408c-878a-ab4a5ef258a1 tempest-ProjectReaderTests-1882876355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-041dd4bf-3836-404a-bac5-287ec4f3802d.8c2a711a-9795-4b3e-9a69-81f72a537521" returned: 0 in 0.252s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:47 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-c82088a3-d522-408c-878a-ab4a5ef258a1 tempest-ProjectReaderTests-1882876355 None] Lock "cinder-quobyte-8c2a711a-9795-4b3e-9a69-81f72a537521" released by "_delete_snapshot" :: held 1.420s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:43:47 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-c82088a3-d522-408c-878a-ab4a5ef258a1 tempest-ProjectReaderTests-1882876355 None] Lock "cinder-quobyte-041dd4bf-3836-404a-bac5-287ec4f3802d" released by "delete_snapshot" :: held 1.449s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:43:47 devstack sudo[115324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-385755f7-2165-441d-accd-f09fea4262d4 Aug 26 14:43:47 devstack sudo[115324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:47 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-c82088a3-d522-408c-878a-ab4a5ef258a1 tempest-ProjectReaderTests-1882876355 None] Created reservations ['cde2a162-97d9-42a8-b02e-2ab882745abb', '9ad63c84-dc74-46f8-8ce1-8f57e0e576b7', 'd70085e4-a0e1-41b7-b641-18b73cd38b46', '4f8dca93-0f3c-49b7-beec-600875f155a5'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:43:47 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-c82088a3-d522-408c-878a-ab4a5ef258a1 tempest-ProjectReaderTests-1882876355 None] Delete snapshot completed successfully. Aug 26 14:43:47 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-c82088a3-d522-408c-878a-ab4a5ef258a1 tempest-ProjectReaderTests-1882876355 None] Lock "cinder-8c2a711a-9795-4b3e-9a69-81f72a537521-delete_snapshot" released by "delete_snapshot" :: held 1.592s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:43:48 devstack sudo[115324]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:48 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-1f9c7990-a6ea-45a5-9b28-7a68443e09d1 tempest-ProjectMemberTests-1774785373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-385755f7-2165-441d-accd-f09fea4262d4" returned: 0 in 0.360s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:48 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-1f9c7990-a6ea-45a5-9b28-7a68443e09d1 tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-385755f7-2165-441d-accd-f09fea4262d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-385755f7-2165-441d-accd-f09fea4262d4.66e5a53a-65ac-4f48-b106-c5de195b39bc 1G {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:48 devstack sudo[115329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-385755f7-2165-441d-accd-f09fea4262d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-385755f7-2165-441d-accd-f09fea4262d4.66e5a53a-65ac-4f48-b106-c5de195b39bc 1G Aug 26 14:43:48 devstack sudo[115329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:48 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-d2dbdb1e-a070-4e08-8c18-ed936073f3f3 tempest-ProjectReaderTests-1882876355 None] Acquiring lock "cinder-041dd4bf-3836-404a-bac5-287ec4f3802d-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:43:48 devstack sudo[115329]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:48 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-d2dbdb1e-a070-4e08-8c18-ed936073f3f3 tempest-ProjectReaderTests-1882876355 None] Lock "cinder-041dd4bf-3836-404a-bac5-287ec4f3802d-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:43:48 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-1f9c7990-a6ea-45a5-9b28-7a68443e09d1 tempest-ProjectMemberTests-1774785373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-385755f7-2165-441d-accd-f09fea4262d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-385755f7-2165-441d-accd-f09fea4262d4.66e5a53a-65ac-4f48-b106-c5de195b39bc 1G" returned: 0 in 0.400s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:48 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-1f9c7990-a6ea-45a5-9b28-7a68443e09d1 tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-385755f7-2165-441d-accd-f09fea4262d4 -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-385755f7-2165-441d-accd-f09fea4262d4.66e5a53a-65ac-4f48-b106-c5de195b39bc {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:48 devstack sudo[115335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-385755f7-2165-441d-accd-f09fea4262d4 -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-385755f7-2165-441d-accd-f09fea4262d4.66e5a53a-65ac-4f48-b106-c5de195b39bc Aug 26 14:43:48 devstack sudo[115335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:48 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-d2dbdb1e-a070-4e08-8c18-ed936073f3f3 tempest-ProjectReaderTests-1882876355 None] Acquiring lock "cinder-quobyte-041dd4bf-3836-404a-bac5-287ec4f3802d" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:43:48 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-d2dbdb1e-a070-4e08-8c18-ed936073f3f3 tempest-ProjectReaderTests-1882876355 None] Lock "cinder-quobyte-041dd4bf-3836-404a-bac5-287ec4f3802d" acquired by "delete_volume" :: waited 0.019s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:43:48 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[04f4794e-f134-44b0-845b-a7df5ad8214a]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:43:48 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-d2dbdb1e-a070-4e08-8c18-ed936073f3f3 tempest-ProjectReaderTests-1882876355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-041dd4bf-3836-404a-bac5-287ec4f3802d {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:48 devstack sudo[115337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-041dd4bf-3836-404a-bac5-287ec4f3802d Aug 26 14:43:48 devstack sudo[115337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:48 devstack sudo[115335]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:48 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-1f9c7990-a6ea-45a5-9b28-7a68443e09d1 tempest-ProjectMemberTests-1774785373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-385755f7-2165-441d-accd-f09fea4262d4 -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-385755f7-2165-441d-accd-f09fea4262d4.66e5a53a-65ac-4f48-b106-c5de195b39bc" returned: 0 in 0.308s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:48 devstack cinder-volume[94394]: WARNING cinder.volume.drivers.remotefs [None req-1f9c7990-a6ea-45a5-9b28-7a68443e09d1 tempest-ProjectMemberTests-1774785373 None] /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-385755f7-2165-441d-accd-f09fea4262d4.66e5a53a-65ac-4f48-b106-c5de195b39bc is being set with open permissions: ugo+rw Aug 26 14:43:48 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-1f9c7990-a6ea-45a5-9b28-7a68443e09d1 tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-385755f7-2165-441d-accd-f09fea4262d4.66e5a53a-65ac-4f48-b106-c5de195b39bc {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:48 devstack sudo[115342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-385755f7-2165-441d-accd-f09fea4262d4.66e5a53a-65ac-4f48-b106-c5de195b39bc Aug 26 14:43:48 devstack sudo[115342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:49 devstack sudo[115337]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:49 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-d2dbdb1e-a070-4e08-8c18-ed936073f3f3 tempest-ProjectReaderTests-1882876355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-041dd4bf-3836-404a-bac5-287ec4f3802d" returned: 0 in 0.367s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:49 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-d2dbdb1e-a070-4e08-8c18-ed936073f3f3 tempest-ProjectReaderTests-1882876355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-041dd4bf-3836-404a-bac5-287ec4f3802d {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:49 devstack sudo[115347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-041dd4bf-3836-404a-bac5-287ec4f3802d Aug 26 14:43:49 devstack sudo[115347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:49 devstack sudo[115342]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:49 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-1f9c7990-a6ea-45a5-9b28-7a68443e09d1 tempest-ProjectMemberTests-1774785373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-385755f7-2165-441d-accd-f09fea4262d4.66e5a53a-65ac-4f48-b106-c5de195b39bc" returned: 0 in 0.244s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:49 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-1f9c7990-a6ea-45a5-9b28-7a68443e09d1 tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-385755f7-2165-441d-accd-f09fea4262d4.info {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:49 devstack sudo[115350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-385755f7-2165-441d-accd-f09fea4262d4.info Aug 26 14:43:49 devstack sudo[115350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:49 devstack sudo[115347]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:49 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-d2dbdb1e-a070-4e08-8c18-ed936073f3f3 tempest-ProjectReaderTests-1882876355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-041dd4bf-3836-404a-bac5-287ec4f3802d" returned: 0 in 0.248s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:49 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-d2dbdb1e-a070-4e08-8c18-ed936073f3f3 tempest-ProjectReaderTests-1882876355 None] Lock "cinder-quobyte-041dd4bf-3836-404a-bac5-287ec4f3802d" released by "delete_volume" :: held 0.674s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:43:49 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-d2dbdb1e-a070-4e08-8c18-ed936073f3f3 tempest-ProjectReaderTests-1882876355 None] Created reservations ['25105c93-e8bb-4377-959c-619c5f782147', '079a02f1-777f-4ff2-b3b5-6b673864a54b', 'a19de12e-d773-4896-b221-32cbea320f52', '7f3ec1fa-f5d4-47a9-9651-0e5af6bb3010'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:43:49 devstack sudo[115350]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:49 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-d2dbdb1e-a070-4e08-8c18-ed936073f3f3 tempest-ProjectReaderTests-1882876355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:43:49 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-d2dbdb1e-a070-4e08-8c18-ed936073f3f3 tempest-ProjectReaderTests-1882876355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:43:49 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-d2dbdb1e-a070-4e08-8c18-ed936073f3f3 tempest-ProjectReaderTests-1882876355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:43:49 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-d2dbdb1e-a070-4e08-8c18-ed936073f3f3 tempest-ProjectReaderTests-1882876355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:43:49 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-d2dbdb1e-a070-4e08-8c18-ed936073f3f3 tempest-ProjectReaderTests-1882876355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:43:49 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-d2dbdb1e-a070-4e08-8c18-ed936073f3f3 tempest-ProjectReaderTests-1882876355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:49 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-1f9c7990-a6ea-45a5-9b28-7a68443e09d1 tempest-ProjectMemberTests-1774785373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-385755f7-2165-441d-accd-f09fea4262d4.info" returned: 0 in 0.284s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:49 devstack cinder-volume[94394]: WARNING cinder.volume.drivers.remotefs [None req-1f9c7990-a6ea-45a5-9b28-7a68443e09d1 tempest-ProjectMemberTests-1774785373 None] /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-385755f7-2165-441d-accd-f09fea4262d4.info is being set with open permissions: ugo+rw Aug 26 14:43:49 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-1f9c7990-a6ea-45a5-9b28-7a68443e09d1 tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-385755f7-2165-441d-accd-f09fea4262d4.info {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:49 devstack sudo[115354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:43:49 devstack sudo[115354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:49 devstack sudo[115355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-385755f7-2165-441d-accd-f09fea4262d4.info Aug 26 14:43:49 devstack sudo[115355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:49 devstack sudo[115354]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:49 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-d2dbdb1e-a070-4e08-8c18-ed936073f3f3 tempest-ProjectReaderTests-1882876355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.248s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:49 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-d2dbdb1e-a070-4e08-8c18-ed936073f3f3 tempest-ProjectReaderTests-1882876355 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:43:49 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-d2dbdb1e-a070-4e08-8c18-ed936073f3f3 tempest-ProjectReaderTests-1882876355 None] Deleted volume successfully. Aug 26 14:43:49 devstack sudo[115355]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:49 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-1f9c7990-a6ea-45a5-9b28-7a68443e09d1 tempest-ProjectMemberTests-1774785373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-385755f7-2165-441d-accd-f09fea4262d4.info" returned: 0 in 0.260s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:49 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-1f9c7990-a6ea-45a5-9b28-7a68443e09d1 tempest-ProjectMemberTests-1774785373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.944s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:43:49 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-d2dbdb1e-a070-4e08-8c18-ed936073f3f3 tempest-ProjectReaderTests-1882876355 None] Lock "cinder-041dd4bf-3836-404a-bac5-287ec4f3802d-delete_volume" released by "delete_volume" :: held 1.166s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:43:49 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-1f9c7990-a6ea-45a5-9b28-7a68443e09d1 tempest-ProjectMemberTests-1774785373 None] Create snapshot completed successfully Aug 26 14:43:49 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-5b5bdde6-7b85-414c-98de-36744a8cd744 tempest-ProjectMemberTests-1774785373 None] Acquiring lock "cinder-66e5a53a-65ac-4f48-b106-c5de195b39bc-delete_snapshot" by "delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:43:49 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-5b5bdde6-7b85-414c-98de-36744a8cd744 tempest-ProjectMemberTests-1774785373 None] Lock "cinder-66e5a53a-65ac-4f48-b106-c5de195b39bc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:43:49 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-5b5bdde6-7b85-414c-98de-36744a8cd744 tempest-ProjectMemberTests-1774785373 None] Acquiring lock "cinder-quobyte-385755f7-2165-441d-accd-f09fea4262d4" by "delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:43:49 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-5b5bdde6-7b85-414c-98de-36744a8cd744 tempest-ProjectMemberTests-1774785373 None] Lock "cinder-quobyte-385755f7-2165-441d-accd-f09fea4262d4" acquired by "delete_snapshot" :: waited 0.021s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:43:49 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-5b5bdde6-7b85-414c-98de-36744a8cd744 tempest-ProjectMemberTests-1774785373 None] Acquiring lock "cinder-quobyte-66e5a53a-65ac-4f48-b106-c5de195b39bc" by "_delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:43:49 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-5b5bdde6-7b85-414c-98de-36744a8cd744 tempest-ProjectMemberTests-1774785373 None] Lock "cinder-quobyte-66e5a53a-65ac-4f48-b106-c5de195b39bc" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:43:49 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-5b5bdde6-7b85-414c-98de-36744a8cd744 tempest-ProjectMemberTests-1774785373 None] Deleting offline snapshot 66e5a53a-65ac-4f48-b106-c5de195b39bc of volume 385755f7-2165-441d-accd-f09fea4262d4 {{(pid=94394) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 14:43:49 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-5b5bdde6-7b85-414c-98de-36744a8cd744 tempest-ProjectMemberTests-1774785373 None] snapshot_file for this snap is: volume-385755f7-2165-441d-accd-f09fea4262d4.66e5a53a-65ac-4f48-b106-c5de195b39bc {{(pid=94394) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 14:43:50 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[76310a65-ce7a-4ece-bb87-f7a95ee584db]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:43:50 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-5b5bdde6-7b85-414c-98de-36744a8cd744 tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-385755f7-2165-441d-accd-f09fea4262d4.66e5a53a-65ac-4f48-b106-c5de195b39bc {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:50 devstack sudo[115360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-385755f7-2165-441d-accd-f09fea4262d4.66e5a53a-65ac-4f48-b106-c5de195b39bc Aug 26 14:43:50 devstack sudo[115360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:50 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-517fc627-2ca1-46bb-aa64-99f76308b04f tempest-ProjectReaderTests-1882876355 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:43:50 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-517fc627-2ca1-46bb-aa64-99f76308b04f tempest-ProjectReaderTests-1882876355 None] Flow 'volume_create_manager' (d86ba9ab-a675-42d3-96a6-5d6800160d51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:43:50 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-517fc627-2ca1-46bb-aa64-99f76308b04f tempest-ProjectReaderTests-1882876355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba68ad5d-c7d0-48b1-9ae2-6a4a39f6250e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:43:50 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-517fc627-2ca1-46bb-aa64-99f76308b04f tempest-ProjectReaderTests-1882876355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba68ad5d-c7d0-48b1-9ae2-6a4a39f6250e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:43:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-939120302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e6aba44-1928-4ae7-9c43-de4a48a0796d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57364cca92024529a3a58d2a3e634ba3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:43:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:43:50Z,use_quota=True,user_id='23a9f0a2e5524f5485f0d17c6acdc640',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:43:50 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-517fc627-2ca1-46bb-aa64-99f76308b04f tempest-ProjectReaderTests-1882876355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd39eb85-2a93-42d5-8cdc-74ecc79a3b62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:43:50 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-517fc627-2ca1-46bb-aa64-99f76308b04f tempest-ProjectReaderTests-1882876355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd39eb85-2a93-42d5-8cdc-74ecc79a3b62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:43:50 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-517fc627-2ca1-46bb-aa64-99f76308b04f tempest-ProjectReaderTests-1882876355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea23f218-c1c7-44a2-a7be-5eee9d55ada6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:43:50 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-517fc627-2ca1-46bb-aa64-99f76308b04f tempest-ProjectReaderTests-1882876355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea23f218-c1c7-44a2-a7be-5eee9d55ada6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e6aba44-1928-4ae7-9c43-de4a48a0796d', 'volume_name': 'volume-6e6aba44-1928-4ae7-9c43-de4a48a0796d', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:43:50 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-517fc627-2ca1-46bb-aa64-99f76308b04f tempest-ProjectReaderTests-1882876355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7715482c-be6a-47ad-bbe9-336e5a825544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:43:50 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-517fc627-2ca1-46bb-aa64-99f76308b04f tempest-ProjectReaderTests-1882876355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7715482c-be6a-47ad-bbe9-336e5a825544) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:43:50 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-517fc627-2ca1-46bb-aa64-99f76308b04f tempest-ProjectReaderTests-1882876355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c821ce9-ac6e-4978-9b17-575bbc9263bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:43:50 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-517fc627-2ca1-46bb-aa64-99f76308b04f tempest-ProjectReaderTests-1882876355 None] Volume 6e6aba44-1928-4ae7-9c43-de4a48a0796d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e6aba44-1928-4ae7-9c43-de4a48a0796d', 'volume_size': 1} Aug 26 14:43:50 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-517fc627-2ca1-46bb-aa64-99f76308b04f tempest-ProjectReaderTests-1882876355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:43:50 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-517fc627-2ca1-46bb-aa64-99f76308b04f tempest-ProjectReaderTests-1882876355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:43:50 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-517fc627-2ca1-46bb-aa64-99f76308b04f tempest-ProjectReaderTests-1882876355 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:43:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-939120302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e6aba44-1928-4ae7-9c43-de4a48a0796d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57364cca92024529a3a58d2a3e634ba3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:43:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:43:50Z,use_quota=True,user_id='23a9f0a2e5524f5485f0d17c6acdc640',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:43:50 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-517fc627-2ca1-46bb-aa64-99f76308b04f tempest-ProjectReaderTests-1882876355 None] Creating volume 6e6aba44-1928-4ae7-9c43-de4a48a0796d {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:43:50 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-517fc627-2ca1-46bb-aa64-99f76308b04f tempest-ProjectReaderTests-1882876355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:43:50 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-517fc627-2ca1-46bb-aa64-99f76308b04f tempest-ProjectReaderTests-1882876355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:43:50 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-517fc627-2ca1-46bb-aa64-99f76308b04f tempest-ProjectReaderTests-1882876355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:43:50 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-517fc627-2ca1-46bb-aa64-99f76308b04f tempest-ProjectReaderTests-1882876355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:43:50 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-517fc627-2ca1-46bb-aa64-99f76308b04f tempest-ProjectReaderTests-1882876355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:43:50 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-517fc627-2ca1-46bb-aa64-99f76308b04f tempest-ProjectReaderTests-1882876355 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:43:50 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-517fc627-2ca1-46bb-aa64-99f76308b04f tempest-ProjectReaderTests-1882876355 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:43:50 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-517fc627-2ca1-46bb-aa64-99f76308b04f tempest-ProjectReaderTests-1882876355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6e6aba44-1928-4ae7-9c43-de4a48a0796d 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:50 devstack sudo[115363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6e6aba44-1928-4ae7-9c43-de4a48a0796d 1073741824 Aug 26 14:43:50 devstack sudo[115363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:50 devstack sudo[115360]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:50 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-5b5bdde6-7b85-414c-98de-36744a8cd744 tempest-ProjectMemberTests-1774785373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-385755f7-2165-441d-accd-f09fea4262d4.66e5a53a-65ac-4f48-b106-c5de195b39bc" returned: 0 in 0.403s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:50 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-5b5bdde6-7b85-414c-98de-36744a8cd744 tempest-ProjectMemberTests-1774785373 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-385755f7-2165-441d-accd-f09fea4262d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94394) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 14:43:50 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0e4db23-352f-4919-96c2-d521d5fbafd9]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:43:50 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-5b5bdde6-7b85-414c-98de-36744a8cd744 tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-385755f7-2165-441d-accd-f09fea4262d4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:50 devstack sudo[115368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-385755f7-2165-441d-accd-f09fea4262d4 Aug 26 14:43:50 devstack sudo[115368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:50 devstack sudo[115363]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:50 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-517fc627-2ca1-46bb-aa64-99f76308b04f tempest-ProjectReaderTests-1882876355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6e6aba44-1928-4ae7-9c43-de4a48a0796d 1073741824" returned: 0 in 0.443s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:50 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-517fc627-2ca1-46bb-aa64-99f76308b04f tempest-ProjectReaderTests-1882876355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6e6aba44-1928-4ae7-9c43-de4a48a0796d {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:50 devstack sudo[115375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6e6aba44-1928-4ae7-9c43-de4a48a0796d Aug 26 14:43:50 devstack sudo[115375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:50 devstack sudo[115368]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:50 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-5b5bdde6-7b85-414c-98de-36744a8cd744 tempest-ProjectMemberTests-1774785373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-385755f7-2165-441d-accd-f09fea4262d4" returned: 0 in 0.373s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:50 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-5b5bdde6-7b85-414c-98de-36744a8cd744 tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-385755f7-2165-441d-accd-f09fea4262d4.66e5a53a-65ac-4f48-b106-c5de195b39bc {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:50 devstack sudo[115380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-385755f7-2165-441d-accd-f09fea4262d4.66e5a53a-65ac-4f48-b106-c5de195b39bc Aug 26 14:43:50 devstack sudo[115380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:50 devstack sudo[115375]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:50 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-517fc627-2ca1-46bb-aa64-99f76308b04f tempest-ProjectReaderTests-1882876355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6e6aba44-1928-4ae7-9c43-de4a48a0796d" returned: 0 in 0.260s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:50 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-517fc627-2ca1-46bb-aa64-99f76308b04f tempest-ProjectReaderTests-1882876355 None] <== create_volume: return (749ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:43:50 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-517fc627-2ca1-46bb-aa64-99f76308b04f tempest-ProjectReaderTests-1882876355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.751s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:43:51 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-517fc627-2ca1-46bb-aa64-99f76308b04f tempest-ProjectReaderTests-1882876355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c821ce9-ac6e-4978-9b17-575bbc9263bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e6aba44-1928-4ae7-9c43-de4a48a0796d', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:43:51 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-517fc627-2ca1-46bb-aa64-99f76308b04f tempest-ProjectReaderTests-1882876355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (721dab69-b2f9-404e-b652-28f70db26664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:43:51 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-517fc627-2ca1-46bb-aa64-99f76308b04f tempest-ProjectReaderTests-1882876355 None] Volume volume-6e6aba44-1928-4ae7-9c43-de4a48a0796d (6e6aba44-1928-4ae7-9c43-de4a48a0796d): created successfully Aug 26 14:43:51 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-517fc627-2ca1-46bb-aa64-99f76308b04f tempest-ProjectReaderTests-1882876355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (721dab69-b2f9-404e-b652-28f70db26664) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:43:51 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-517fc627-2ca1-46bb-aa64-99f76308b04f tempest-ProjectReaderTests-1882876355 None] Flow 'volume_create_manager' (d86ba9ab-a675-42d3-96a6-5d6800160d51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:43:51 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-517fc627-2ca1-46bb-aa64-99f76308b04f tempest-ProjectReaderTests-1882876355 None] Created volume successfully. Aug 26 14:43:51 devstack sudo[115380]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:51 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-5b5bdde6-7b85-414c-98de-36744a8cd744 tempest-ProjectMemberTests-1774785373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-385755f7-2165-441d-accd-f09fea4262d4.66e5a53a-65ac-4f48-b106-c5de195b39bc" returned: 0 in 0.388s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:51 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-5b5bdde6-7b85-414c-98de-36744a8cd744 tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-385755f7-2165-441d-accd-f09fea4262d4.66e5a53a-65ac-4f48-b106-c5de195b39bc {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:51 devstack sudo[115386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-385755f7-2165-441d-accd-f09fea4262d4.66e5a53a-65ac-4f48-b106-c5de195b39bc Aug 26 14:43:51 devstack sudo[115386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:51 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-cdb6247a-49ac-44a1-b07c-ba90cdfdd6bf tempest-ProjectReaderTests-1882876355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:43:51 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-cdb6247a-49ac-44a1-b07c-ba90cdfdd6bf tempest-ProjectReaderTests-1882876355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:43:51 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-cdb6247a-49ac-44a1-b07c-ba90cdfdd6bf tempest-ProjectReaderTests-1882876355 None] Creating offline snapshot 5856e8dc-ea31-46ef-a1ba-e07bf8ab4fd8 of volume 6e6aba44-1928-4ae7-9c43-de4a48a0796d {{(pid=94394) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 14:43:51 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce29a35e-175d-4357-b7a0-986ec3f0b244]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:43:51 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-cdb6247a-49ac-44a1-b07c-ba90cdfdd6bf tempest-ProjectReaderTests-1882876355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6e6aba44-1928-4ae7-9c43-de4a48a0796d {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:51 devstack sudo[115386]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:51 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-5b5bdde6-7b85-414c-98de-36744a8cd744 tempest-ProjectMemberTests-1774785373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-385755f7-2165-441d-accd-f09fea4262d4.66e5a53a-65ac-4f48-b106-c5de195b39bc" returned: 0 in 0.267s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:51 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-5b5bdde6-7b85-414c-98de-36744a8cd744 tempest-ProjectMemberTests-1774785373 None] Lock "cinder-quobyte-66e5a53a-65ac-4f48-b106-c5de195b39bc" released by "_delete_snapshot" :: held 1.554s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:43:51 devstack sudo[115388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6e6aba44-1928-4ae7-9c43-de4a48a0796d Aug 26 14:43:51 devstack sudo[115388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:51 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-5b5bdde6-7b85-414c-98de-36744a8cd744 tempest-ProjectMemberTests-1774785373 None] Lock "cinder-quobyte-385755f7-2165-441d-accd-f09fea4262d4" released by "delete_snapshot" :: held 1.577s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:43:51 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-5b5bdde6-7b85-414c-98de-36744a8cd744 tempest-ProjectMemberTests-1774785373 None] Created reservations ['c3537bca-3ec3-42f5-97f9-574f289ccb5c', '53d1e2ef-3610-4ca2-82a4-56104afdc50b', '638b212f-5d42-4198-a10a-c82d39bafc9c', '01707eff-633f-47f7-a71d-a12a918dd514'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:43:51 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-5b5bdde6-7b85-414c-98de-36744a8cd744 tempest-ProjectMemberTests-1774785373 None] Delete snapshot completed successfully. Aug 26 14:43:51 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-5b5bdde6-7b85-414c-98de-36744a8cd744 tempest-ProjectMemberTests-1774785373 None] Lock "cinder-66e5a53a-65ac-4f48-b106-c5de195b39bc-delete_snapshot" released by "delete_snapshot" :: held 1.722s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:43:51 devstack sudo[115388]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:51 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-cdb6247a-49ac-44a1-b07c-ba90cdfdd6bf tempest-ProjectReaderTests-1882876355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6e6aba44-1928-4ae7-9c43-de4a48a0796d" returned: 0 in 0.356s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:51 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-cdb6247a-49ac-44a1-b07c-ba90cdfdd6bf tempest-ProjectReaderTests-1882876355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6e6aba44-1928-4ae7-9c43-de4a48a0796d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6e6aba44-1928-4ae7-9c43-de4a48a0796d.5856e8dc-ea31-46ef-a1ba-e07bf8ab4fd8 1G {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:51 devstack sudo[115394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6e6aba44-1928-4ae7-9c43-de4a48a0796d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6e6aba44-1928-4ae7-9c43-de4a48a0796d.5856e8dc-ea31-46ef-a1ba-e07bf8ab4fd8 1G Aug 26 14:43:51 devstack sudo[115394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:52 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-45da90a8-84dd-438b-abb1-0719b72a2abf tempest-ProjectMemberTests-1774785373 None] Acquiring lock "cinder-385755f7-2165-441d-accd-f09fea4262d4-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:43:52 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-45da90a8-84dd-438b-abb1-0719b72a2abf tempest-ProjectMemberTests-1774785373 None] Lock "cinder-385755f7-2165-441d-accd-f09fea4262d4-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:43:52 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-45da90a8-84dd-438b-abb1-0719b72a2abf tempest-ProjectMemberTests-1774785373 None] Acquiring lock "cinder-quobyte-385755f7-2165-441d-accd-f09fea4262d4" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:43:52 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-45da90a8-84dd-438b-abb1-0719b72a2abf tempest-ProjectMemberTests-1774785373 None] Lock "cinder-quobyte-385755f7-2165-441d-accd-f09fea4262d4" acquired by "delete_volume" :: waited 0.015s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:43:52 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf91dc47-5fbd-4542-8e73-cdc13c2dacac]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:43:52 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-45da90a8-84dd-438b-abb1-0719b72a2abf tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-385755f7-2165-441d-accd-f09fea4262d4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:52 devstack sudo[115394]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:52 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-cdb6247a-49ac-44a1-b07c-ba90cdfdd6bf tempest-ProjectReaderTests-1882876355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6e6aba44-1928-4ae7-9c43-de4a48a0796d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6e6aba44-1928-4ae7-9c43-de4a48a0796d.5856e8dc-ea31-46ef-a1ba-e07bf8ab4fd8 1G" returned: 0 in 0.440s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:52 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-cdb6247a-49ac-44a1-b07c-ba90cdfdd6bf tempest-ProjectReaderTests-1882876355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e6aba44-1928-4ae7-9c43-de4a48a0796d -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6e6aba44-1928-4ae7-9c43-de4a48a0796d.5856e8dc-ea31-46ef-a1ba-e07bf8ab4fd8 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:52 devstack sudo[115401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e6aba44-1928-4ae7-9c43-de4a48a0796d -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6e6aba44-1928-4ae7-9c43-de4a48a0796d.5856e8dc-ea31-46ef-a1ba-e07bf8ab4fd8 Aug 26 14:43:52 devstack sudo[115401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:52 devstack sudo[115400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-385755f7-2165-441d-accd-f09fea4262d4 Aug 26 14:43:52 devstack sudo[115400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:52 devstack sudo[115401]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:52 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-cdb6247a-49ac-44a1-b07c-ba90cdfdd6bf tempest-ProjectReaderTests-1882876355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e6aba44-1928-4ae7-9c43-de4a48a0796d -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6e6aba44-1928-4ae7-9c43-de4a48a0796d.5856e8dc-ea31-46ef-a1ba-e07bf8ab4fd8" returned: 0 in 0.287s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:52 devstack cinder-volume[94394]: WARNING cinder.volume.drivers.remotefs [None req-cdb6247a-49ac-44a1-b07c-ba90cdfdd6bf tempest-ProjectReaderTests-1882876355 None] /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6e6aba44-1928-4ae7-9c43-de4a48a0796d.5856e8dc-ea31-46ef-a1ba-e07bf8ab4fd8 is being set with open permissions: ugo+rw Aug 26 14:43:52 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-cdb6247a-49ac-44a1-b07c-ba90cdfdd6bf tempest-ProjectReaderTests-1882876355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6e6aba44-1928-4ae7-9c43-de4a48a0796d.5856e8dc-ea31-46ef-a1ba-e07bf8ab4fd8 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:52 devstack sudo[115410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6e6aba44-1928-4ae7-9c43-de4a48a0796d.5856e8dc-ea31-46ef-a1ba-e07bf8ab4fd8 Aug 26 14:43:52 devstack sudo[115410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:52 devstack sudo[115400]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:52 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-45da90a8-84dd-438b-abb1-0719b72a2abf tempest-ProjectMemberTests-1774785373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-385755f7-2165-441d-accd-f09fea4262d4" returned: 0 in 0.362s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:52 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-45da90a8-84dd-438b-abb1-0719b72a2abf tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-385755f7-2165-441d-accd-f09fea4262d4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:52 devstack sudo[115412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-385755f7-2165-441d-accd-f09fea4262d4 Aug 26 14:43:52 devstack sudo[115412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:52 devstack sudo[115410]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:52 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-cdb6247a-49ac-44a1-b07c-ba90cdfdd6bf tempest-ProjectReaderTests-1882876355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6e6aba44-1928-4ae7-9c43-de4a48a0796d.5856e8dc-ea31-46ef-a1ba-e07bf8ab4fd8" returned: 0 in 0.246s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:52 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-cdb6247a-49ac-44a1-b07c-ba90cdfdd6bf tempest-ProjectReaderTests-1882876355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6e6aba44-1928-4ae7-9c43-de4a48a0796d.info {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:52 devstack sudo[115412]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:52 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-45da90a8-84dd-438b-abb1-0719b72a2abf tempest-ProjectMemberTests-1774785373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-385755f7-2165-441d-accd-f09fea4262d4" returned: 0 in 0.245s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:52 devstack sudo[115416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6e6aba44-1928-4ae7-9c43-de4a48a0796d.info Aug 26 14:43:52 devstack sudo[115416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:52 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-45da90a8-84dd-438b-abb1-0719b72a2abf tempest-ProjectMemberTests-1774785373 None] Lock "cinder-quobyte-385755f7-2165-441d-accd-f09fea4262d4" released by "delete_volume" :: held 0.665s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:43:52 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-45da90a8-84dd-438b-abb1-0719b72a2abf tempest-ProjectMemberTests-1774785373 None] Created reservations ['7b94daf5-71ac-499d-81ed-4d657e0fa8f1', 'edabe647-1ae8-4758-a173-c6c90f41edab', '0059cff8-c62d-4128-b154-e9617f212129', '17d32d55-11be-4da0-bb62-ebb544f851a7'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:43:52 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-45da90a8-84dd-438b-abb1-0719b72a2abf tempest-ProjectMemberTests-1774785373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:43:52 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-45da90a8-84dd-438b-abb1-0719b72a2abf tempest-ProjectMemberTests-1774785373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:43:52 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-45da90a8-84dd-438b-abb1-0719b72a2abf tempest-ProjectMemberTests-1774785373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:43:52 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-45da90a8-84dd-438b-abb1-0719b72a2abf tempest-ProjectMemberTests-1774785373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:43:52 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-45da90a8-84dd-438b-abb1-0719b72a2abf tempest-ProjectMemberTests-1774785373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:43:52 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-45da90a8-84dd-438b-abb1-0719b72a2abf tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:52 devstack sudo[115418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:43:52 devstack sudo[115418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:53 devstack sudo[115416]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:53 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-cdb6247a-49ac-44a1-b07c-ba90cdfdd6bf tempest-ProjectReaderTests-1882876355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6e6aba44-1928-4ae7-9c43-de4a48a0796d.info" returned: 0 in 0.258s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:53 devstack cinder-volume[94394]: WARNING cinder.volume.drivers.remotefs [None req-cdb6247a-49ac-44a1-b07c-ba90cdfdd6bf tempest-ProjectReaderTests-1882876355 None] /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6e6aba44-1928-4ae7-9c43-de4a48a0796d.info is being set with open permissions: ugo+rw Aug 26 14:43:53 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-cdb6247a-49ac-44a1-b07c-ba90cdfdd6bf tempest-ProjectReaderTests-1882876355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6e6aba44-1928-4ae7-9c43-de4a48a0796d.info {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:53 devstack sudo[115421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6e6aba44-1928-4ae7-9c43-de4a48a0796d.info Aug 26 14:43:53 devstack sudo[115421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:53 devstack sudo[115418]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:53 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-45da90a8-84dd-438b-abb1-0719b72a2abf tempest-ProjectMemberTests-1774785373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.256s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:53 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-45da90a8-84dd-438b-abb1-0719b72a2abf tempest-ProjectMemberTests-1774785373 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:43:53 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-45da90a8-84dd-438b-abb1-0719b72a2abf tempest-ProjectMemberTests-1774785373 None] Deleted volume successfully. Aug 26 14:43:53 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-45da90a8-84dd-438b-abb1-0719b72a2abf tempest-ProjectMemberTests-1774785373 None] Lock "cinder-385755f7-2165-441d-accd-f09fea4262d4-delete_volume" released by "delete_volume" :: held 1.129s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:43:53 devstack sudo[115421]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:53 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-cdb6247a-49ac-44a1-b07c-ba90cdfdd6bf tempest-ProjectReaderTests-1882876355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6e6aba44-1928-4ae7-9c43-de4a48a0796d.info" returned: 0 in 0.248s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:53 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-cdb6247a-49ac-44a1-b07c-ba90cdfdd6bf tempest-ProjectReaderTests-1882876355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.913s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:43:53 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-cdb6247a-49ac-44a1-b07c-ba90cdfdd6bf tempest-ProjectReaderTests-1882876355 None] Create snapshot completed successfully Aug 26 14:43:53 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-5f56db83-5ba5-457c-8cd2-b6898d5d1ee4 tempest-ProjectReaderTests-1882876355 None] Acquiring lock "cinder-5856e8dc-ea31-46ef-a1ba-e07bf8ab4fd8-delete_snapshot" by "delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:43:53 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-5f56db83-5ba5-457c-8cd2-b6898d5d1ee4 tempest-ProjectReaderTests-1882876355 None] Lock "cinder-5856e8dc-ea31-46ef-a1ba-e07bf8ab4fd8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:43:53 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-5f56db83-5ba5-457c-8cd2-b6898d5d1ee4 tempest-ProjectReaderTests-1882876355 None] Acquiring lock "cinder-quobyte-6e6aba44-1928-4ae7-9c43-de4a48a0796d" by "delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:43:53 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-5f56db83-5ba5-457c-8cd2-b6898d5d1ee4 tempest-ProjectReaderTests-1882876355 None] Lock "cinder-quobyte-6e6aba44-1928-4ae7-9c43-de4a48a0796d" acquired by "delete_snapshot" :: waited 0.026s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:43:53 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-5f56db83-5ba5-457c-8cd2-b6898d5d1ee4 tempest-ProjectReaderTests-1882876355 None] Acquiring lock "cinder-quobyte-5856e8dc-ea31-46ef-a1ba-e07bf8ab4fd8" by "_delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:43:53 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-5f56db83-5ba5-457c-8cd2-b6898d5d1ee4 tempest-ProjectReaderTests-1882876355 None] Lock "cinder-quobyte-5856e8dc-ea31-46ef-a1ba-e07bf8ab4fd8" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:43:53 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-5f56db83-5ba5-457c-8cd2-b6898d5d1ee4 tempest-ProjectReaderTests-1882876355 None] Deleting offline snapshot 5856e8dc-ea31-46ef-a1ba-e07bf8ab4fd8 of volume 6e6aba44-1928-4ae7-9c43-de4a48a0796d {{(pid=94394) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 14:43:53 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-5f56db83-5ba5-457c-8cd2-b6898d5d1ee4 tempest-ProjectReaderTests-1882876355 None] snapshot_file for this snap is: volume-6e6aba44-1928-4ae7-9c43-de4a48a0796d.5856e8dc-ea31-46ef-a1ba-e07bf8ab4fd8 {{(pid=94394) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 14:43:53 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[35d223fc-45b7-439b-a9c4-d130b0ca1d5f]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:43:53 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-5f56db83-5ba5-457c-8cd2-b6898d5d1ee4 tempest-ProjectReaderTests-1882876355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6e6aba44-1928-4ae7-9c43-de4a48a0796d.5856e8dc-ea31-46ef-a1ba-e07bf8ab4fd8 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:53 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-4bd3294e-3b9d-425d-b7e7-52c570ed332a tempest-ProjectMemberTests-1774785373 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:43:53 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-4bd3294e-3b9d-425d-b7e7-52c570ed332a tempest-ProjectMemberTests-1774785373 None] Flow 'volume_create_manager' (97e85afa-c419-420a-9874-1363cd8a0811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:43:53 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-4bd3294e-3b9d-425d-b7e7-52c570ed332a tempest-ProjectMemberTests-1774785373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4866d9c2-a631-4fcd-9b0a-c0135abe04b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:43:53 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-4bd3294e-3b9d-425d-b7e7-52c570ed332a tempest-ProjectMemberTests-1774785373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4866d9c2-a631-4fcd-9b0a-c0135abe04b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:43:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2117460247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34398e27-7ee5-4481-8263-e3d9a96fec1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8dd248190cb40cebc9daf2b89f48fd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:43:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:43:54Z,use_quota=True,user_id='ad0617c386b6460d8f790d85646880e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:43:53 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-4bd3294e-3b9d-425d-b7e7-52c570ed332a tempest-ProjectMemberTests-1774785373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33eb6273-0b86-4a7e-a1b3-2778b47425d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:43:53 devstack sudo[115425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6e6aba44-1928-4ae7-9c43-de4a48a0796d.5856e8dc-ea31-46ef-a1ba-e07bf8ab4fd8 Aug 26 14:43:53 devstack sudo[115425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:53 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-4bd3294e-3b9d-425d-b7e7-52c570ed332a tempest-ProjectMemberTests-1774785373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33eb6273-0b86-4a7e-a1b3-2778b47425d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:43:53 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-4bd3294e-3b9d-425d-b7e7-52c570ed332a tempest-ProjectMemberTests-1774785373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a8e43e1-b0dc-489f-9719-a724812dc1a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:43:53 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-4bd3294e-3b9d-425d-b7e7-52c570ed332a tempest-ProjectMemberTests-1774785373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a8e43e1-b0dc-489f-9719-a724812dc1a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34398e27-7ee5-4481-8263-e3d9a96fec1a', 'volume_name': 'volume-34398e27-7ee5-4481-8263-e3d9a96fec1a', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:43:53 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-4bd3294e-3b9d-425d-b7e7-52c570ed332a tempest-ProjectMemberTests-1774785373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f49b11f-b7a5-4709-b345-8e46ac2548e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:43:53 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-4bd3294e-3b9d-425d-b7e7-52c570ed332a tempest-ProjectMemberTests-1774785373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f49b11f-b7a5-4709-b345-8e46ac2548e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:43:53 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-4bd3294e-3b9d-425d-b7e7-52c570ed332a tempest-ProjectMemberTests-1774785373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7da397d-46e2-4c89-98a1-5ee138460ba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:43:53 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-4bd3294e-3b9d-425d-b7e7-52c570ed332a tempest-ProjectMemberTests-1774785373 None] Volume 34398e27-7ee5-4481-8263-e3d9a96fec1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34398e27-7ee5-4481-8263-e3d9a96fec1a', 'volume_size': 1} Aug 26 14:43:53 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-4bd3294e-3b9d-425d-b7e7-52c570ed332a tempest-ProjectMemberTests-1774785373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:43:53 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-4bd3294e-3b9d-425d-b7e7-52c570ed332a tempest-ProjectMemberTests-1774785373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:43:53 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-4bd3294e-3b9d-425d-b7e7-52c570ed332a tempest-ProjectMemberTests-1774785373 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:43:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2117460247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34398e27-7ee5-4481-8263-e3d9a96fec1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8dd248190cb40cebc9daf2b89f48fd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:43:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:43:54Z,use_quota=True,user_id='ad0617c386b6460d8f790d85646880e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:43:53 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-4bd3294e-3b9d-425d-b7e7-52c570ed332a tempest-ProjectMemberTests-1774785373 None] Creating volume 34398e27-7ee5-4481-8263-e3d9a96fec1a {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:43:53 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-4bd3294e-3b9d-425d-b7e7-52c570ed332a tempest-ProjectMemberTests-1774785373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:43:53 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-4bd3294e-3b9d-425d-b7e7-52c570ed332a tempest-ProjectMemberTests-1774785373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:43:53 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-4bd3294e-3b9d-425d-b7e7-52c570ed332a tempest-ProjectMemberTests-1774785373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:43:53 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-4bd3294e-3b9d-425d-b7e7-52c570ed332a tempest-ProjectMemberTests-1774785373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:43:53 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-4bd3294e-3b9d-425d-b7e7-52c570ed332a tempest-ProjectMemberTests-1774785373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:43:53 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-4bd3294e-3b9d-425d-b7e7-52c570ed332a tempest-ProjectMemberTests-1774785373 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:43:53 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-4bd3294e-3b9d-425d-b7e7-52c570ed332a tempest-ProjectMemberTests-1774785373 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:43:53 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4bd3294e-3b9d-425d-b7e7-52c570ed332a tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-34398e27-7ee5-4481-8263-e3d9a96fec1a 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:53 devstack sudo[115427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-34398e27-7ee5-4481-8263-e3d9a96fec1a 1073741824 Aug 26 14:43:53 devstack sudo[115427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:53 devstack sudo[115425]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:53 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-5f56db83-5ba5-457c-8cd2-b6898d5d1ee4 tempest-ProjectReaderTests-1882876355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6e6aba44-1928-4ae7-9c43-de4a48a0796d.5856e8dc-ea31-46ef-a1ba-e07bf8ab4fd8" returned: 0 in 0.363s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:53 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-5f56db83-5ba5-457c-8cd2-b6898d5d1ee4 tempest-ProjectReaderTests-1882876355 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6e6aba44-1928-4ae7-9c43-de4a48a0796d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94394) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 14:43:54 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb76c9a3-e37e-4655-bc5c-2559ca2684e1]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:43:54 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-5f56db83-5ba5-457c-8cd2-b6898d5d1ee4 tempest-ProjectReaderTests-1882876355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6e6aba44-1928-4ae7-9c43-de4a48a0796d {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:54 devstack sudo[115434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6e6aba44-1928-4ae7-9c43-de4a48a0796d Aug 26 14:43:54 devstack sudo[115434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:54 devstack sudo[115427]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:54 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4bd3294e-3b9d-425d-b7e7-52c570ed332a tempest-ProjectMemberTests-1774785373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-34398e27-7ee5-4481-8263-e3d9a96fec1a 1073741824" returned: 0 in 0.431s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:54 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4bd3294e-3b9d-425d-b7e7-52c570ed332a tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-34398e27-7ee5-4481-8263-e3d9a96fec1a {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:54 devstack sudo[115438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-34398e27-7ee5-4481-8263-e3d9a96fec1a Aug 26 14:43:54 devstack sudo[115438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:54 devstack sudo[115434]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:54 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-5f56db83-5ba5-457c-8cd2-b6898d5d1ee4 tempest-ProjectReaderTests-1882876355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6e6aba44-1928-4ae7-9c43-de4a48a0796d" returned: 0 in 0.376s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:54 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-5f56db83-5ba5-457c-8cd2-b6898d5d1ee4 tempest-ProjectReaderTests-1882876355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6e6aba44-1928-4ae7-9c43-de4a48a0796d.5856e8dc-ea31-46ef-a1ba-e07bf8ab4fd8 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:54 devstack sudo[115443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6e6aba44-1928-4ae7-9c43-de4a48a0796d.5856e8dc-ea31-46ef-a1ba-e07bf8ab4fd8 Aug 26 14:43:54 devstack sudo[115443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:54 devstack sudo[115438]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:54 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-4bd3294e-3b9d-425d-b7e7-52c570ed332a tempest-ProjectMemberTests-1774785373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-34398e27-7ee5-4481-8263-e3d9a96fec1a" returned: 0 in 0.258s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:54 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-4bd3294e-3b9d-425d-b7e7-52c570ed332a tempest-ProjectMemberTests-1774785373 None] <== create_volume: return (735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:43:54 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-4bd3294e-3b9d-425d-b7e7-52c570ed332a tempest-ProjectMemberTests-1774785373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.738s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:43:54 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-4bd3294e-3b9d-425d-b7e7-52c570ed332a tempest-ProjectMemberTests-1774785373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7da397d-46e2-4c89-98a1-5ee138460ba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34398e27-7ee5-4481-8263-e3d9a96fec1a', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:43:54 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-4bd3294e-3b9d-425d-b7e7-52c570ed332a tempest-ProjectMemberTests-1774785373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6901d51-100c-400d-b408-c62be0796c22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:43:54 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-4bd3294e-3b9d-425d-b7e7-52c570ed332a tempest-ProjectMemberTests-1774785373 None] Volume volume-34398e27-7ee5-4481-8263-e3d9a96fec1a (34398e27-7ee5-4481-8263-e3d9a96fec1a): created successfully Aug 26 14:43:54 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-4bd3294e-3b9d-425d-b7e7-52c570ed332a tempest-ProjectMemberTests-1774785373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6901d51-100c-400d-b408-c62be0796c22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:43:54 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-4bd3294e-3b9d-425d-b7e7-52c570ed332a tempest-ProjectMemberTests-1774785373 None] Flow 'volume_create_manager' (97e85afa-c419-420a-9874-1363cd8a0811) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:43:54 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-4bd3294e-3b9d-425d-b7e7-52c570ed332a tempest-ProjectMemberTests-1774785373 None] Created volume successfully. Aug 26 14:43:54 devstack sudo[115443]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:54 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-5f56db83-5ba5-457c-8cd2-b6898d5d1ee4 tempest-ProjectReaderTests-1882876355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6e6aba44-1928-4ae7-9c43-de4a48a0796d.5856e8dc-ea31-46ef-a1ba-e07bf8ab4fd8" returned: 0 in 0.370s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:54 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-5f56db83-5ba5-457c-8cd2-b6898d5d1ee4 tempest-ProjectReaderTests-1882876355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6e6aba44-1928-4ae7-9c43-de4a48a0796d.5856e8dc-ea31-46ef-a1ba-e07bf8ab4fd8 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:54 devstack sudo[115449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6e6aba44-1928-4ae7-9c43-de4a48a0796d.5856e8dc-ea31-46ef-a1ba-e07bf8ab4fd8 Aug 26 14:43:54 devstack sudo[115449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:54 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-392bc079-1677-4c7e-a545-97c284e078c4 tempest-ProjectMemberTests-1774785373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:43:54 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-392bc079-1677-4c7e-a545-97c284e078c4 tempest-ProjectMemberTests-1774785373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:43:54 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-392bc079-1677-4c7e-a545-97c284e078c4 tempest-ProjectMemberTests-1774785373 None] Creating offline snapshot 5c43ea70-43be-4551-817f-743fe64dc457 of volume 34398e27-7ee5-4481-8263-e3d9a96fec1a {{(pid=94394) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 14:43:54 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[929c8b27-73da-45c3-8ad5-8fb9640054c3]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:43:54 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-392bc079-1677-4c7e-a545-97c284e078c4 tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-34398e27-7ee5-4481-8263-e3d9a96fec1a {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:55 devstack sudo[115449]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:55 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-5f56db83-5ba5-457c-8cd2-b6898d5d1ee4 tempest-ProjectReaderTests-1882876355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6e6aba44-1928-4ae7-9c43-de4a48a0796d.5856e8dc-ea31-46ef-a1ba-e07bf8ab4fd8" returned: 0 in 0.260s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:55 devstack sudo[115451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-34398e27-7ee5-4481-8263-e3d9a96fec1a Aug 26 14:43:55 devstack sudo[115451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:55 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-5f56db83-5ba5-457c-8cd2-b6898d5d1ee4 tempest-ProjectReaderTests-1882876355 None] Lock "cinder-quobyte-5856e8dc-ea31-46ef-a1ba-e07bf8ab4fd8" released by "_delete_snapshot" :: held 1.452s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:43:55 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-5f56db83-5ba5-457c-8cd2-b6898d5d1ee4 tempest-ProjectReaderTests-1882876355 None] Lock "cinder-quobyte-6e6aba44-1928-4ae7-9c43-de4a48a0796d" released by "delete_snapshot" :: held 1.475s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:43:55 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-5f56db83-5ba5-457c-8cd2-b6898d5d1ee4 tempest-ProjectReaderTests-1882876355 None] Created reservations ['bd353ea7-73e3-4657-a446-b312d8ca30e9', '1baaa21f-01a1-4c3b-bd99-e0e725b1874d', '6c8d8eda-eb72-406b-8985-d655628b9d6d', '2f9cd50d-cb6d-4992-b94b-ec45d227957a'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:43:55 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-5f56db83-5ba5-457c-8cd2-b6898d5d1ee4 tempest-ProjectReaderTests-1882876355 None] Delete snapshot completed successfully. Aug 26 14:43:55 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-5f56db83-5ba5-457c-8cd2-b6898d5d1ee4 tempest-ProjectReaderTests-1882876355 None] Lock "cinder-5856e8dc-ea31-46ef-a1ba-e07bf8ab4fd8-delete_snapshot" released by "delete_snapshot" :: held 1.654s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:43:55 devstack sudo[115451]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:55 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-392bc079-1677-4c7e-a545-97c284e078c4 tempest-ProjectMemberTests-1774785373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-34398e27-7ee5-4481-8263-e3d9a96fec1a" returned: 0 in 0.393s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:55 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-392bc079-1677-4c7e-a545-97c284e078c4 tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-34398e27-7ee5-4481-8263-e3d9a96fec1a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-34398e27-7ee5-4481-8263-e3d9a96fec1a.5c43ea70-43be-4551-817f-743fe64dc457 1G {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:55 devstack sudo[115457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-34398e27-7ee5-4481-8263-e3d9a96fec1a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-34398e27-7ee5-4481-8263-e3d9a96fec1a.5c43ea70-43be-4551-817f-743fe64dc457 1G Aug 26 14:43:55 devstack sudo[115457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:55 devstack sudo[115457]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:55 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-0ac9bbea-30e4-4d32-a66f-e0a0fe158e9d tempest-ProjectReaderTests-1882876355 None] Acquiring lock "cinder-6e6aba44-1928-4ae7-9c43-de4a48a0796d-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:43:55 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-392bc079-1677-4c7e-a545-97c284e078c4 tempest-ProjectMemberTests-1774785373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-34398e27-7ee5-4481-8263-e3d9a96fec1a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-34398e27-7ee5-4481-8263-e3d9a96fec1a.5c43ea70-43be-4551-817f-743fe64dc457 1G" returned: 0 in 0.399s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:55 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-392bc079-1677-4c7e-a545-97c284e078c4 tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34398e27-7ee5-4481-8263-e3d9a96fec1a -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-34398e27-7ee5-4481-8263-e3d9a96fec1a.5c43ea70-43be-4551-817f-743fe64dc457 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:55 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-0ac9bbea-30e4-4d32-a66f-e0a0fe158e9d tempest-ProjectReaderTests-1882876355 None] Lock "cinder-6e6aba44-1928-4ae7-9c43-de4a48a0796d-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:43:55 devstack sudo[115463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34398e27-7ee5-4481-8263-e3d9a96fec1a -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-34398e27-7ee5-4481-8263-e3d9a96fec1a.5c43ea70-43be-4551-817f-743fe64dc457 Aug 26 14:43:55 devstack sudo[115463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:55 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-0ac9bbea-30e4-4d32-a66f-e0a0fe158e9d tempest-ProjectReaderTests-1882876355 None] Acquiring lock "cinder-quobyte-6e6aba44-1928-4ae7-9c43-de4a48a0796d" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:43:55 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-0ac9bbea-30e4-4d32-a66f-e0a0fe158e9d tempest-ProjectReaderTests-1882876355 None] Lock "cinder-quobyte-6e6aba44-1928-4ae7-9c43-de4a48a0796d" acquired by "delete_volume" :: waited 0.016s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:43:55 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cda8db2-ea31-4afb-9f87-916ce739992f]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:43:55 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-0ac9bbea-30e4-4d32-a66f-e0a0fe158e9d tempest-ProjectReaderTests-1882876355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6e6aba44-1928-4ae7-9c43-de4a48a0796d {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:55 devstack sudo[115465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6e6aba44-1928-4ae7-9c43-de4a48a0796d Aug 26 14:43:55 devstack sudo[115465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:56 devstack sudo[115463]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:56 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-392bc079-1677-4c7e-a545-97c284e078c4 tempest-ProjectMemberTests-1774785373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34398e27-7ee5-4481-8263-e3d9a96fec1a -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-34398e27-7ee5-4481-8263-e3d9a96fec1a.5c43ea70-43be-4551-817f-743fe64dc457" returned: 0 in 0.299s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:56 devstack cinder-volume[94394]: WARNING cinder.volume.drivers.remotefs [None req-392bc079-1677-4c7e-a545-97c284e078c4 tempest-ProjectMemberTests-1774785373 None] /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-34398e27-7ee5-4481-8263-e3d9a96fec1a.5c43ea70-43be-4551-817f-743fe64dc457 is being set with open permissions: ugo+rw Aug 26 14:43:56 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-392bc079-1677-4c7e-a545-97c284e078c4 tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-34398e27-7ee5-4481-8263-e3d9a96fec1a.5c43ea70-43be-4551-817f-743fe64dc457 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:56 devstack sudo[115470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-34398e27-7ee5-4481-8263-e3d9a96fec1a.5c43ea70-43be-4551-817f-743fe64dc457 Aug 26 14:43:56 devstack sudo[115470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:56 devstack sudo[115465]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:56 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-0ac9bbea-30e4-4d32-a66f-e0a0fe158e9d tempest-ProjectReaderTests-1882876355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6e6aba44-1928-4ae7-9c43-de4a48a0796d" returned: 0 in 0.378s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:56 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-0ac9bbea-30e4-4d32-a66f-e0a0fe158e9d tempest-ProjectReaderTests-1882876355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6e6aba44-1928-4ae7-9c43-de4a48a0796d {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:56 devstack sudo[115475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6e6aba44-1928-4ae7-9c43-de4a48a0796d Aug 26 14:43:56 devstack sudo[115475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:56 devstack sudo[115470]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:56 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-392bc079-1677-4c7e-a545-97c284e078c4 tempest-ProjectMemberTests-1774785373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-34398e27-7ee5-4481-8263-e3d9a96fec1a.5c43ea70-43be-4551-817f-743fe64dc457" returned: 0 in 0.255s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:56 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-392bc079-1677-4c7e-a545-97c284e078c4 tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-34398e27-7ee5-4481-8263-e3d9a96fec1a.info {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:56 devstack sudo[115478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-34398e27-7ee5-4481-8263-e3d9a96fec1a.info Aug 26 14:43:56 devstack sudo[115478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:56 devstack sudo[115475]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:56 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-0ac9bbea-30e4-4d32-a66f-e0a0fe158e9d tempest-ProjectReaderTests-1882876355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6e6aba44-1928-4ae7-9c43-de4a48a0796d" returned: 0 in 0.246s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:56 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-0ac9bbea-30e4-4d32-a66f-e0a0fe158e9d tempest-ProjectReaderTests-1882876355 None] Lock "cinder-quobyte-6e6aba44-1928-4ae7-9c43-de4a48a0796d" released by "delete_volume" :: held 0.679s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:43:56 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-0ac9bbea-30e4-4d32-a66f-e0a0fe158e9d tempest-ProjectReaderTests-1882876355 None] Created reservations ['f1e80c30-c280-43b7-bb35-c51b27c548d8', 'efa8bb62-7983-4d45-a677-0a854e11e380', '824200ab-2974-4380-9500-8786c359b2e1', 'd365a344-8148-4312-a51d-4f5ce1998911'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:43:56 devstack sudo[115478]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:56 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-392bc079-1677-4c7e-a545-97c284e078c4 tempest-ProjectMemberTests-1774785373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-34398e27-7ee5-4481-8263-e3d9a96fec1a.info" returned: 0 in 0.265s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:56 devstack cinder-volume[94394]: WARNING cinder.volume.drivers.remotefs [None req-392bc079-1677-4c7e-a545-97c284e078c4 tempest-ProjectMemberTests-1774785373 None] /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-34398e27-7ee5-4481-8263-e3d9a96fec1a.info is being set with open permissions: ugo+rw Aug 26 14:43:56 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-392bc079-1677-4c7e-a545-97c284e078c4 tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-34398e27-7ee5-4481-8263-e3d9a96fec1a.info {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:56 devstack sudo[115482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-34398e27-7ee5-4481-8263-e3d9a96fec1a.info Aug 26 14:43:56 devstack sudo[115482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:56 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-0ac9bbea-30e4-4d32-a66f-e0a0fe158e9d tempest-ProjectReaderTests-1882876355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:43:56 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-0ac9bbea-30e4-4d32-a66f-e0a0fe158e9d tempest-ProjectReaderTests-1882876355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:43:56 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-0ac9bbea-30e4-4d32-a66f-e0a0fe158e9d tempest-ProjectReaderTests-1882876355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:43:56 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-0ac9bbea-30e4-4d32-a66f-e0a0fe158e9d tempest-ProjectReaderTests-1882876355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:43:56 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-0ac9bbea-30e4-4d32-a66f-e0a0fe158e9d tempest-ProjectReaderTests-1882876355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:43:56 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-0ac9bbea-30e4-4d32-a66f-e0a0fe158e9d tempest-ProjectReaderTests-1882876355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:56 devstack sudo[115484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:43:56 devstack sudo[115484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:56 devstack sudo[115482]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:56 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-392bc079-1677-4c7e-a545-97c284e078c4 tempest-ProjectMemberTests-1774785373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-34398e27-7ee5-4481-8263-e3d9a96fec1a.info" returned: 0 in 0.249s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:56 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-392bc079-1677-4c7e-a545-97c284e078c4 tempest-ProjectMemberTests-1774785373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.944s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:43:56 devstack sudo[115484]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:56 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-0ac9bbea-30e4-4d32-a66f-e0a0fe158e9d tempest-ProjectReaderTests-1882876355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.249s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:56 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-0ac9bbea-30e4-4d32-a66f-e0a0fe158e9d tempest-ProjectReaderTests-1882876355 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:43:56 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-0ac9bbea-30e4-4d32-a66f-e0a0fe158e9d tempest-ProjectReaderTests-1882876355 None] Deleted volume successfully. Aug 26 14:43:56 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-392bc079-1677-4c7e-a545-97c284e078c4 tempest-ProjectMemberTests-1774785373 None] Create snapshot completed successfully Aug 26 14:43:56 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-0ac9bbea-30e4-4d32-a66f-e0a0fe158e9d tempest-ProjectReaderTests-1882876355 None] Lock "cinder-6e6aba44-1928-4ae7-9c43-de4a48a0796d-delete_volume" released by "delete_volume" :: held 1.144s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:43:57 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-aaf058ea-2028-45b8-b27a-af373b3a5889 tempest-ProjectMemberTests-1774785373 None] Acquiring lock "cinder-5c43ea70-43be-4551-817f-743fe64dc457-delete_snapshot" by "delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:43:57 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-aaf058ea-2028-45b8-b27a-af373b3a5889 tempest-ProjectMemberTests-1774785373 None] Lock "cinder-5c43ea70-43be-4551-817f-743fe64dc457-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:43:57 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-aaf058ea-2028-45b8-b27a-af373b3a5889 tempest-ProjectMemberTests-1774785373 None] Acquiring lock "cinder-quobyte-34398e27-7ee5-4481-8263-e3d9a96fec1a" by "delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:43:57 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-aaf058ea-2028-45b8-b27a-af373b3a5889 tempest-ProjectMemberTests-1774785373 None] Lock "cinder-quobyte-34398e27-7ee5-4481-8263-e3d9a96fec1a" acquired by "delete_snapshot" :: waited 0.024s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:43:57 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-aaf058ea-2028-45b8-b27a-af373b3a5889 tempest-ProjectMemberTests-1774785373 None] Acquiring lock "cinder-quobyte-5c43ea70-43be-4551-817f-743fe64dc457" by "_delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:43:57 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-aaf058ea-2028-45b8-b27a-af373b3a5889 tempest-ProjectMemberTests-1774785373 None] Lock "cinder-quobyte-5c43ea70-43be-4551-817f-743fe64dc457" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:43:57 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-aaf058ea-2028-45b8-b27a-af373b3a5889 tempest-ProjectMemberTests-1774785373 None] Deleting offline snapshot 5c43ea70-43be-4551-817f-743fe64dc457 of volume 34398e27-7ee5-4481-8263-e3d9a96fec1a {{(pid=94394) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 14:43:57 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-aaf058ea-2028-45b8-b27a-af373b3a5889 tempest-ProjectMemberTests-1774785373 None] snapshot_file for this snap is: volume-34398e27-7ee5-4481-8263-e3d9a96fec1a.5c43ea70-43be-4551-817f-743fe64dc457 {{(pid=94394) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 14:43:57 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[33fcc407-c3e9-465a-91df-378b614018f1]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:43:57 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-aaf058ea-2028-45b8-b27a-af373b3a5889 tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-34398e27-7ee5-4481-8263-e3d9a96fec1a.5c43ea70-43be-4551-817f-743fe64dc457 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:57 devstack sudo[115488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-34398e27-7ee5-4481-8263-e3d9a96fec1a.5c43ea70-43be-4551-817f-743fe64dc457 Aug 26 14:43:57 devstack sudo[115488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:57 devstack sudo[115488]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:57 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-aaf058ea-2028-45b8-b27a-af373b3a5889 tempest-ProjectMemberTests-1774785373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-34398e27-7ee5-4481-8263-e3d9a96fec1a.5c43ea70-43be-4551-817f-743fe64dc457" returned: 0 in 0.375s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:57 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-aaf058ea-2028-45b8-b27a-af373b3a5889 tempest-ProjectMemberTests-1774785373 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-34398e27-7ee5-4481-8263-e3d9a96fec1a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94394) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 14:43:57 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[1737a30a-7420-46c3-91aa-c86a236b5392]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:43:57 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-aaf058ea-2028-45b8-b27a-af373b3a5889 tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-34398e27-7ee5-4481-8263-e3d9a96fec1a {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:57 devstack sudo[115494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-34398e27-7ee5-4481-8263-e3d9a96fec1a Aug 26 14:43:57 devstack sudo[115494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:57 devstack sudo[115494]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:57 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-aaf058ea-2028-45b8-b27a-af373b3a5889 tempest-ProjectMemberTests-1774785373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-34398e27-7ee5-4481-8263-e3d9a96fec1a" returned: 0 in 0.379s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:57 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-aaf058ea-2028-45b8-b27a-af373b3a5889 tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-34398e27-7ee5-4481-8263-e3d9a96fec1a.5c43ea70-43be-4551-817f-743fe64dc457 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:57 devstack sudo[115499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-34398e27-7ee5-4481-8263-e3d9a96fec1a.5c43ea70-43be-4551-817f-743fe64dc457 Aug 26 14:43:57 devstack sudo[115499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:58 devstack sudo[115499]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:58 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-aaf058ea-2028-45b8-b27a-af373b3a5889 tempest-ProjectMemberTests-1774785373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-34398e27-7ee5-4481-8263-e3d9a96fec1a.5c43ea70-43be-4551-817f-743fe64dc457" returned: 0 in 0.364s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:58 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-aaf058ea-2028-45b8-b27a-af373b3a5889 tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-34398e27-7ee5-4481-8263-e3d9a96fec1a.5c43ea70-43be-4551-817f-743fe64dc457 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:58 devstack sudo[115504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-34398e27-7ee5-4481-8263-e3d9a96fec1a.5c43ea70-43be-4551-817f-743fe64dc457 Aug 26 14:43:58 devstack sudo[115504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:58 devstack sudo[115504]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:58 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-aaf058ea-2028-45b8-b27a-af373b3a5889 tempest-ProjectMemberTests-1774785373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-34398e27-7ee5-4481-8263-e3d9a96fec1a.5c43ea70-43be-4551-817f-743fe64dc457" returned: 0 in 0.266s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:58 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-aaf058ea-2028-45b8-b27a-af373b3a5889 tempest-ProjectMemberTests-1774785373 None] Lock "cinder-quobyte-5c43ea70-43be-4551-817f-743fe64dc457" released by "_delete_snapshot" :: held 1.487s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:43:58 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-aaf058ea-2028-45b8-b27a-af373b3a5889 tempest-ProjectMemberTests-1774785373 None] Lock "cinder-quobyte-34398e27-7ee5-4481-8263-e3d9a96fec1a" released by "delete_snapshot" :: held 1.513s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:43:58 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-aaf058ea-2028-45b8-b27a-af373b3a5889 tempest-ProjectMemberTests-1774785373 None] Created reservations ['f7d91957-0e56-4484-8f07-e6a31c618c99', '63a22191-5232-4428-bfec-a13d2ee6e443', 'dfba4c9f-f0a3-4667-97e1-b665edeec13c', '33626815-7ef9-412c-91f4-b2c7c1534611'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:43:58 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-aaf058ea-2028-45b8-b27a-af373b3a5889 tempest-ProjectMemberTests-1774785373 None] Delete snapshot completed successfully. Aug 26 14:43:58 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-aaf058ea-2028-45b8-b27a-af373b3a5889 tempest-ProjectMemberTests-1774785373 None] Lock "cinder-5c43ea70-43be-4551-817f-743fe64dc457-delete_snapshot" released by "delete_snapshot" :: held 1.672s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:43:59 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-99524b86-1817-460e-98d4-ec0dbde3c072 tempest-ProjectMemberTests-1774785373 None] Acquiring lock "cinder-34398e27-7ee5-4481-8263-e3d9a96fec1a-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:43:59 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-99524b86-1817-460e-98d4-ec0dbde3c072 tempest-ProjectMemberTests-1774785373 None] Lock "cinder-34398e27-7ee5-4481-8263-e3d9a96fec1a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:43:59 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-99524b86-1817-460e-98d4-ec0dbde3c072 tempest-ProjectMemberTests-1774785373 None] Acquiring lock "cinder-quobyte-34398e27-7ee5-4481-8263-e3d9a96fec1a" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:43:59 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-99524b86-1817-460e-98d4-ec0dbde3c072 tempest-ProjectMemberTests-1774785373 None] Lock "cinder-quobyte-34398e27-7ee5-4481-8263-e3d9a96fec1a" acquired by "delete_volume" :: waited 0.018s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:43:59 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a84f3b0-5496-46fc-a066-1a74593a7ac5]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:43:59 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-99524b86-1817-460e-98d4-ec0dbde3c072 tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-34398e27-7ee5-4481-8263-e3d9a96fec1a {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:59 devstack sudo[115507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-34398e27-7ee5-4481-8263-e3d9a96fec1a Aug 26 14:43:59 devstack sudo[115507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:59 devstack sudo[115507]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:59 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-99524b86-1817-460e-98d4-ec0dbde3c072 tempest-ProjectMemberTests-1774785373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-34398e27-7ee5-4481-8263-e3d9a96fec1a" returned: 0 in 0.353s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:59 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-99524b86-1817-460e-98d4-ec0dbde3c072 tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-34398e27-7ee5-4481-8263-e3d9a96fec1a {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:43:59 devstack sudo[115512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-34398e27-7ee5-4481-8263-e3d9a96fec1a Aug 26 14:43:59 devstack sudo[115512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:43:59 devstack sudo[115512]: pam_unix(sudo:session): session closed for user root Aug 26 14:43:59 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-99524b86-1817-460e-98d4-ec0dbde3c072 tempest-ProjectMemberTests-1774785373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-34398e27-7ee5-4481-8263-e3d9a96fec1a" returned: 0 in 0.251s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:43:59 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-99524b86-1817-460e-98d4-ec0dbde3c072 tempest-ProjectMemberTests-1774785373 None] Lock "cinder-quobyte-34398e27-7ee5-4481-8263-e3d9a96fec1a" released by "delete_volume" :: held 0.661s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:44:00 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-99524b86-1817-460e-98d4-ec0dbde3c072 tempest-ProjectMemberTests-1774785373 None] Created reservations ['9b992c4d-fed1-4c00-9bfd-82046e783469', 'd457430b-cd2b-4826-882a-72bb2c89a3a2', '5558cdaa-c205-4f3a-bc53-ba89f0ce3331', '4d455d81-7581-4e15-84b5-174497571af3'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:44:00 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-99524b86-1817-460e-98d4-ec0dbde3c072 tempest-ProjectMemberTests-1774785373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:44:00 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-99524b86-1817-460e-98d4-ec0dbde3c072 tempest-ProjectMemberTests-1774785373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:44:00 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-99524b86-1817-460e-98d4-ec0dbde3c072 tempest-ProjectMemberTests-1774785373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:44:00 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-99524b86-1817-460e-98d4-ec0dbde3c072 tempest-ProjectMemberTests-1774785373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:44:00 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-99524b86-1817-460e-98d4-ec0dbde3c072 tempest-ProjectMemberTests-1774785373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:44:00 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-99524b86-1817-460e-98d4-ec0dbde3c072 tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:44:00 devstack sudo[115515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:44:00 devstack sudo[115515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:44:00 devstack sudo[115515]: pam_unix(sudo:session): session closed for user root Aug 26 14:44:00 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-99524b86-1817-460e-98d4-ec0dbde3c072 tempest-ProjectMemberTests-1774785373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.260s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:44:00 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-99524b86-1817-460e-98d4-ec0dbde3c072 tempest-ProjectMemberTests-1774785373 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:44:00 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-99524b86-1817-460e-98d4-ec0dbde3c072 tempest-ProjectMemberTests-1774785373 None] Deleted volume successfully. Aug 26 14:44:00 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-99524b86-1817-460e-98d4-ec0dbde3c072 tempest-ProjectMemberTests-1774785373 None] Lock "cinder-34398e27-7ee5-4481-8263-e3d9a96fec1a-delete_volume" released by "delete_volume" :: held 1.141s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:44:00 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0547718-bc74-4ff8-ab23-8c60472b9127 tempest-ProjectMemberTests-1774785373 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:44:00 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-b0547718-bc74-4ff8-ab23-8c60472b9127 tempest-ProjectMemberTests-1774785373 None] Flow 'volume_create_manager' (4ef613e3-5498-46b5-8612-7e76b00f4dff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:44:00 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-b0547718-bc74-4ff8-ab23-8c60472b9127 tempest-ProjectMemberTests-1774785373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fd68d28-c5ec-428d-a661-1959241c3329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:44:00 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-b0547718-bc74-4ff8-ab23-8c60472b9127 tempest-ProjectMemberTests-1774785373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fd68d28-c5ec-428d-a661-1959241c3329) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:44:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1384874210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f8d8dbd-99e9-4734-91d4-e35d164c355e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8dd248190cb40cebc9daf2b89f48fd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:44:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:44:01Z,use_quota=True,user_id='ad0617c386b6460d8f790d85646880e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:44:00 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-b0547718-bc74-4ff8-ab23-8c60472b9127 tempest-ProjectMemberTests-1774785373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9eef8f7c-5bc5-4d09-8f09-25d48de1c1c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:44:00 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-b0547718-bc74-4ff8-ab23-8c60472b9127 tempest-ProjectMemberTests-1774785373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9eef8f7c-5bc5-4d09-8f09-25d48de1c1c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:44:00 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-b0547718-bc74-4ff8-ab23-8c60472b9127 tempest-ProjectMemberTests-1774785373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d03f2af-6b91-4b86-b0e1-8ca4809f0599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:44:00 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-b0547718-bc74-4ff8-ab23-8c60472b9127 tempest-ProjectMemberTests-1774785373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d03f2af-6b91-4b86-b0e1-8ca4809f0599) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f8d8dbd-99e9-4734-91d4-e35d164c355e', 'volume_name': 'volume-6f8d8dbd-99e9-4734-91d4-e35d164c355e', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:44:00 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-b0547718-bc74-4ff8-ab23-8c60472b9127 tempest-ProjectMemberTests-1774785373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2567aeb6-323f-4a2e-9a7c-92f6ae70720a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:44:00 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-b0547718-bc74-4ff8-ab23-8c60472b9127 tempest-ProjectMemberTests-1774785373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2567aeb6-323f-4a2e-9a7c-92f6ae70720a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:44:00 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-b0547718-bc74-4ff8-ab23-8c60472b9127 tempest-ProjectMemberTests-1774785373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81ab8373-e3c5-4961-bccf-c15a776ca298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:44:00 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-b0547718-bc74-4ff8-ab23-8c60472b9127 tempest-ProjectMemberTests-1774785373 None] Volume 6f8d8dbd-99e9-4734-91d4-e35d164c355e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f8d8dbd-99e9-4734-91d4-e35d164c355e', 'volume_size': 1} Aug 26 14:44:00 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-b0547718-bc74-4ff8-ab23-8c60472b9127 tempest-ProjectMemberTests-1774785373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:44:00 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-b0547718-bc74-4ff8-ab23-8c60472b9127 tempest-ProjectMemberTests-1774785373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:44:00 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-b0547718-bc74-4ff8-ab23-8c60472b9127 tempest-ProjectMemberTests-1774785373 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:44:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1384874210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f8d8dbd-99e9-4734-91d4-e35d164c355e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8dd248190cb40cebc9daf2b89f48fd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:44:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:44:01Z,use_quota=True,user_id='ad0617c386b6460d8f790d85646880e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:44:00 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-b0547718-bc74-4ff8-ab23-8c60472b9127 tempest-ProjectMemberTests-1774785373 None] Creating volume 6f8d8dbd-99e9-4734-91d4-e35d164c355e {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:44:00 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-b0547718-bc74-4ff8-ab23-8c60472b9127 tempest-ProjectMemberTests-1774785373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:44:00 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-b0547718-bc74-4ff8-ab23-8c60472b9127 tempest-ProjectMemberTests-1774785373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:44:00 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-b0547718-bc74-4ff8-ab23-8c60472b9127 tempest-ProjectMemberTests-1774785373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:44:00 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-b0547718-bc74-4ff8-ab23-8c60472b9127 tempest-ProjectMemberTests-1774785373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:44:00 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-b0547718-bc74-4ff8-ab23-8c60472b9127 tempest-ProjectMemberTests-1774785373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:44:00 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-b0547718-bc74-4ff8-ab23-8c60472b9127 tempest-ProjectMemberTests-1774785373 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:44:00 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-b0547718-bc74-4ff8-ab23-8c60472b9127 tempest-ProjectMemberTests-1774785373 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:44:00 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-b0547718-bc74-4ff8-ab23-8c60472b9127 tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6f8d8dbd-99e9-4734-91d4-e35d164c355e 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:44:00 devstack sudo[115519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6f8d8dbd-99e9-4734-91d4-e35d164c355e 1073741824 Aug 26 14:44:00 devstack sudo[115519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:44:01 devstack sudo[115519]: pam_unix(sudo:session): session closed for user root Aug 26 14:44:01 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-b0547718-bc74-4ff8-ab23-8c60472b9127 tempest-ProjectMemberTests-1774785373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6f8d8dbd-99e9-4734-91d4-e35d164c355e 1073741824" returned: 0 in 0.395s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:44:01 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-b0547718-bc74-4ff8-ab23-8c60472b9127 tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6f8d8dbd-99e9-4734-91d4-e35d164c355e {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:44:01 devstack sudo[115525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6f8d8dbd-99e9-4734-91d4-e35d164c355e Aug 26 14:44:01 devstack sudo[115525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:44:01 devstack sudo[115525]: pam_unix(sudo:session): session closed for user root Aug 26 14:44:01 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-b0547718-bc74-4ff8-ab23-8c60472b9127 tempest-ProjectMemberTests-1774785373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6f8d8dbd-99e9-4734-91d4-e35d164c355e" returned: 0 in 0.244s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:44:01 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-b0547718-bc74-4ff8-ab23-8c60472b9127 tempest-ProjectMemberTests-1774785373 None] <== create_volume: return (679ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:44:01 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-b0547718-bc74-4ff8-ab23-8c60472b9127 tempest-ProjectMemberTests-1774785373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.681s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:44:01 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-b0547718-bc74-4ff8-ab23-8c60472b9127 tempest-ProjectMemberTests-1774785373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81ab8373-e3c5-4961-bccf-c15a776ca298) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f8d8dbd-99e9-4734-91d4-e35d164c355e', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:44:01 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-b0547718-bc74-4ff8-ab23-8c60472b9127 tempest-ProjectMemberTests-1774785373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (509a43c2-ceda-4554-b163-908a6e5afb45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:44:01 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-b0547718-bc74-4ff8-ab23-8c60472b9127 tempest-ProjectMemberTests-1774785373 None] Volume volume-6f8d8dbd-99e9-4734-91d4-e35d164c355e (6f8d8dbd-99e9-4734-91d4-e35d164c355e): created successfully Aug 26 14:44:01 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-b0547718-bc74-4ff8-ab23-8c60472b9127 tempest-ProjectMemberTests-1774785373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (509a43c2-ceda-4554-b163-908a6e5afb45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:44:01 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-b0547718-bc74-4ff8-ab23-8c60472b9127 tempest-ProjectMemberTests-1774785373 None] Flow 'volume_create_manager' (4ef613e3-5498-46b5-8612-7e76b00f4dff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:44:01 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-b0547718-bc74-4ff8-ab23-8c60472b9127 tempest-ProjectMemberTests-1774785373 None] Created volume successfully. Aug 26 14:44:02 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-5aa85423-6d6b-4545-a174-253ef36b44ee tempest-ProjectMemberTests-1774785373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:44:02 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-5aa85423-6d6b-4545-a174-253ef36b44ee tempest-ProjectMemberTests-1774785373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:44:02 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-5aa85423-6d6b-4545-a174-253ef36b44ee tempest-ProjectMemberTests-1774785373 None] Creating offline snapshot 2eecec3a-e4f2-4343-bf30-761f0717ab49 of volume 6f8d8dbd-99e9-4734-91d4-e35d164c355e {{(pid=94394) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 14:44:02 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[64ee436a-03de-4025-afe6-1b39c3979531]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:44:02 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-5aa85423-6d6b-4545-a174-253ef36b44ee tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6f8d8dbd-99e9-4734-91d4-e35d164c355e {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:44:02 devstack sudo[115528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6f8d8dbd-99e9-4734-91d4-e35d164c355e Aug 26 14:44:02 devstack sudo[115528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:44:02 devstack sudo[115528]: pam_unix(sudo:session): session closed for user root Aug 26 14:44:02 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-5aa85423-6d6b-4545-a174-253ef36b44ee tempest-ProjectMemberTests-1774785373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6f8d8dbd-99e9-4734-91d4-e35d164c355e" returned: 0 in 0.390s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:44:02 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-5aa85423-6d6b-4545-a174-253ef36b44ee tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6f8d8dbd-99e9-4734-91d4-e35d164c355e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6f8d8dbd-99e9-4734-91d4-e35d164c355e.2eecec3a-e4f2-4343-bf30-761f0717ab49 1G {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:44:02 devstack sudo[115533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6f8d8dbd-99e9-4734-91d4-e35d164c355e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6f8d8dbd-99e9-4734-91d4-e35d164c355e.2eecec3a-e4f2-4343-bf30-761f0717ab49 1G Aug 26 14:44:02 devstack sudo[115533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:44:02 devstack sudo[115533]: pam_unix(sudo:session): session closed for user root Aug 26 14:44:02 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-5aa85423-6d6b-4545-a174-253ef36b44ee tempest-ProjectMemberTests-1774785373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6f8d8dbd-99e9-4734-91d4-e35d164c355e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6f8d8dbd-99e9-4734-91d4-e35d164c355e.2eecec3a-e4f2-4343-bf30-761f0717ab49 1G" returned: 0 in 0.389s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:44:02 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-5aa85423-6d6b-4545-a174-253ef36b44ee tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f8d8dbd-99e9-4734-91d4-e35d164c355e -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6f8d8dbd-99e9-4734-91d4-e35d164c355e.2eecec3a-e4f2-4343-bf30-761f0717ab49 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:44:02 devstack sudo[115539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f8d8dbd-99e9-4734-91d4-e35d164c355e -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6f8d8dbd-99e9-4734-91d4-e35d164c355e.2eecec3a-e4f2-4343-bf30-761f0717ab49 Aug 26 14:44:02 devstack sudo[115539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:44:03 devstack sudo[115539]: pam_unix(sudo:session): session closed for user root Aug 26 14:44:03 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-5aa85423-6d6b-4545-a174-253ef36b44ee tempest-ProjectMemberTests-1774785373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f8d8dbd-99e9-4734-91d4-e35d164c355e -F qcow2 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6f8d8dbd-99e9-4734-91d4-e35d164c355e.2eecec3a-e4f2-4343-bf30-761f0717ab49" returned: 0 in 0.280s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:44:03 devstack cinder-volume[94394]: WARNING cinder.volume.drivers.remotefs [None req-5aa85423-6d6b-4545-a174-253ef36b44ee tempest-ProjectMemberTests-1774785373 None] /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6f8d8dbd-99e9-4734-91d4-e35d164c355e.2eecec3a-e4f2-4343-bf30-761f0717ab49 is being set with open permissions: ugo+rw Aug 26 14:44:03 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-5aa85423-6d6b-4545-a174-253ef36b44ee tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6f8d8dbd-99e9-4734-91d4-e35d164c355e.2eecec3a-e4f2-4343-bf30-761f0717ab49 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:44:03 devstack sudo[115544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6f8d8dbd-99e9-4734-91d4-e35d164c355e.2eecec3a-e4f2-4343-bf30-761f0717ab49 Aug 26 14:44:03 devstack sudo[115544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:44:03 devstack sudo[115544]: pam_unix(sudo:session): session closed for user root Aug 26 14:44:03 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-5aa85423-6d6b-4545-a174-253ef36b44ee tempest-ProjectMemberTests-1774785373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6f8d8dbd-99e9-4734-91d4-e35d164c355e.2eecec3a-e4f2-4343-bf30-761f0717ab49" returned: 0 in 0.242s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:44:03 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-5aa85423-6d6b-4545-a174-253ef36b44ee tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6f8d8dbd-99e9-4734-91d4-e35d164c355e.info {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:44:03 devstack sudo[115547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6f8d8dbd-99e9-4734-91d4-e35d164c355e.info Aug 26 14:44:03 devstack sudo[115547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:44:03 devstack sudo[115547]: pam_unix(sudo:session): session closed for user root Aug 26 14:44:03 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-5aa85423-6d6b-4545-a174-253ef36b44ee tempest-ProjectMemberTests-1774785373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6f8d8dbd-99e9-4734-91d4-e35d164c355e.info" returned: 0 in 0.251s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:44:03 devstack cinder-volume[94394]: WARNING cinder.volume.drivers.remotefs [None req-5aa85423-6d6b-4545-a174-253ef36b44ee tempest-ProjectMemberTests-1774785373 None] /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6f8d8dbd-99e9-4734-91d4-e35d164c355e.info is being set with open permissions: ugo+rw Aug 26 14:44:03 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-5aa85423-6d6b-4545-a174-253ef36b44ee tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6f8d8dbd-99e9-4734-91d4-e35d164c355e.info {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:44:03 devstack sudo[115550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6f8d8dbd-99e9-4734-91d4-e35d164c355e.info Aug 26 14:44:03 devstack sudo[115550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:44:03 devstack sudo[115550]: pam_unix(sudo:session): session closed for user root Aug 26 14:44:03 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-5aa85423-6d6b-4545-a174-253ef36b44ee tempest-ProjectMemberTests-1774785373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6f8d8dbd-99e9-4734-91d4-e35d164c355e.info" returned: 0 in 0.248s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:44:03 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-5aa85423-6d6b-4545-a174-253ef36b44ee tempest-ProjectMemberTests-1774785373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.887s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:44:03 devstack cinder-volume[94394]: DEBUG dbcounter [-] [94394] Writing DB stats cinder:SELECT=188,cinder:INSERT=61,cinder:UPDATE=226,cinder:DELETE=23 {{(pid=94394) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 14:44:03 devstack cinder-volume[94394]: DEBUG dbcounter [-] [94394] Writing DB stats cinder:SELECT=185,cinder:INSERT=70,cinder:UPDATE=253,cinder:DELETE=17 {{(pid=94394) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 14:44:03 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-5aa85423-6d6b-4545-a174-253ef36b44ee tempest-ProjectMemberTests-1774785373 None] Create snapshot completed successfully Aug 26 14:44:04 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-a5dd93cf-63d8-44fc-b620-a357562a5784 tempest-ProjectMemberTests-1774785373 None] Acquiring lock "cinder-2eecec3a-e4f2-4343-bf30-761f0717ab49-delete_snapshot" by "delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:44:04 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-a5dd93cf-63d8-44fc-b620-a357562a5784 tempest-ProjectMemberTests-1774785373 None] Lock "cinder-2eecec3a-e4f2-4343-bf30-761f0717ab49-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:44:04 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-a5dd93cf-63d8-44fc-b620-a357562a5784 tempest-ProjectMemberTests-1774785373 None] Acquiring lock "cinder-quobyte-6f8d8dbd-99e9-4734-91d4-e35d164c355e" by "delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:44:04 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-a5dd93cf-63d8-44fc-b620-a357562a5784 tempest-ProjectMemberTests-1774785373 None] Lock "cinder-quobyte-6f8d8dbd-99e9-4734-91d4-e35d164c355e" acquired by "delete_snapshot" :: waited 0.019s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:44:04 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-a5dd93cf-63d8-44fc-b620-a357562a5784 tempest-ProjectMemberTests-1774785373 None] Acquiring lock "cinder-quobyte-2eecec3a-e4f2-4343-bf30-761f0717ab49" by "_delete_snapshot" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:44:04 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-a5dd93cf-63d8-44fc-b620-a357562a5784 tempest-ProjectMemberTests-1774785373 None] Lock "cinder-quobyte-2eecec3a-e4f2-4343-bf30-761f0717ab49" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:44:04 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-a5dd93cf-63d8-44fc-b620-a357562a5784 tempest-ProjectMemberTests-1774785373 None] Deleting offline snapshot 2eecec3a-e4f2-4343-bf30-761f0717ab49 of volume 6f8d8dbd-99e9-4734-91d4-e35d164c355e {{(pid=94394) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 14:44:04 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-a5dd93cf-63d8-44fc-b620-a357562a5784 tempest-ProjectMemberTests-1774785373 None] snapshot_file for this snap is: volume-6f8d8dbd-99e9-4734-91d4-e35d164c355e.2eecec3a-e4f2-4343-bf30-761f0717ab49 {{(pid=94394) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 14:44:04 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[388e1f42-546c-471c-a82a-8fb0b388a34e]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:44:04 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-a5dd93cf-63d8-44fc-b620-a357562a5784 tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6f8d8dbd-99e9-4734-91d4-e35d164c355e.2eecec3a-e4f2-4343-bf30-761f0717ab49 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:44:04 devstack sudo[115553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6f8d8dbd-99e9-4734-91d4-e35d164c355e.2eecec3a-e4f2-4343-bf30-761f0717ab49 Aug 26 14:44:04 devstack sudo[115553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:44:04 devstack sudo[115553]: pam_unix(sudo:session): session closed for user root Aug 26 14:44:04 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-a5dd93cf-63d8-44fc-b620-a357562a5784 tempest-ProjectMemberTests-1774785373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6f8d8dbd-99e9-4734-91d4-e35d164c355e.2eecec3a-e4f2-4343-bf30-761f0717ab49" returned: 0 in 0.361s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:44:04 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-a5dd93cf-63d8-44fc-b620-a357562a5784 tempest-ProjectMemberTests-1774785373 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6f8d8dbd-99e9-4734-91d4-e35d164c355e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94394) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 14:44:04 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[3660205b-239a-44c4-a504-02a51c58d519]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:44:04 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-a5dd93cf-63d8-44fc-b620-a357562a5784 tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6f8d8dbd-99e9-4734-91d4-e35d164c355e {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:44:04 devstack sudo[115558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6f8d8dbd-99e9-4734-91d4-e35d164c355e Aug 26 14:44:04 devstack sudo[115558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:44:05 devstack sudo[115558]: pam_unix(sudo:session): session closed for user root Aug 26 14:44:05 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-a5dd93cf-63d8-44fc-b620-a357562a5784 tempest-ProjectMemberTests-1774785373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6f8d8dbd-99e9-4734-91d4-e35d164c355e" returned: 0 in 0.381s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:44:05 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-a5dd93cf-63d8-44fc-b620-a357562a5784 tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6f8d8dbd-99e9-4734-91d4-e35d164c355e.2eecec3a-e4f2-4343-bf30-761f0717ab49 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:44:05 devstack sudo[115563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6f8d8dbd-99e9-4734-91d4-e35d164c355e.2eecec3a-e4f2-4343-bf30-761f0717ab49 Aug 26 14:44:05 devstack sudo[115563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:44:05 devstack sudo[115563]: pam_unix(sudo:session): session closed for user root Aug 26 14:44:05 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-a5dd93cf-63d8-44fc-b620-a357562a5784 tempest-ProjectMemberTests-1774785373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6f8d8dbd-99e9-4734-91d4-e35d164c355e.2eecec3a-e4f2-4343-bf30-761f0717ab49" returned: 0 in 0.356s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:44:05 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-a5dd93cf-63d8-44fc-b620-a357562a5784 tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6f8d8dbd-99e9-4734-91d4-e35d164c355e.2eecec3a-e4f2-4343-bf30-761f0717ab49 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:44:05 devstack sudo[115568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6f8d8dbd-99e9-4734-91d4-e35d164c355e.2eecec3a-e4f2-4343-bf30-761f0717ab49 Aug 26 14:44:05 devstack sudo[115568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:44:05 devstack sudo[115568]: pam_unix(sudo:session): session closed for user root Aug 26 14:44:05 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-a5dd93cf-63d8-44fc-b620-a357562a5784 tempest-ProjectMemberTests-1774785373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6f8d8dbd-99e9-4734-91d4-e35d164c355e.2eecec3a-e4f2-4343-bf30-761f0717ab49" returned: 0 in 0.252s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:44:05 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-a5dd93cf-63d8-44fc-b620-a357562a5784 tempest-ProjectMemberTests-1774785373 None] Lock "cinder-quobyte-2eecec3a-e4f2-4343-bf30-761f0717ab49" released by "_delete_snapshot" :: held 1.455s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:44:05 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-a5dd93cf-63d8-44fc-b620-a357562a5784 tempest-ProjectMemberTests-1774785373 None] Lock "cinder-quobyte-6f8d8dbd-99e9-4734-91d4-e35d164c355e" released by "delete_snapshot" :: held 1.479s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:44:05 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-a5dd93cf-63d8-44fc-b620-a357562a5784 tempest-ProjectMemberTests-1774785373 None] Created reservations ['30304335-75e7-4efd-bcfd-a9c6dc6d4157', '46143bd2-b969-4a58-9789-1f2f204b2d37', 'ace30d52-27f9-439b-b778-da366113a849', '41e3eaf9-b82b-4a77-80c9-495081611fb7'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:44:05 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-a5dd93cf-63d8-44fc-b620-a357562a5784 tempest-ProjectMemberTests-1774785373 None] Delete snapshot completed successfully. Aug 26 14:44:05 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-a5dd93cf-63d8-44fc-b620-a357562a5784 tempest-ProjectMemberTests-1774785373 None] Lock "cinder-2eecec3a-e4f2-4343-bf30-761f0717ab49-delete_snapshot" released by "delete_snapshot" :: held 1.631s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:44:06 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-889e0fab-85ca-410b-98ab-011d4d6f4859 tempest-ProjectMemberTests-1774785373 None] Acquiring lock "cinder-6f8d8dbd-99e9-4734-91d4-e35d164c355e-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:44:06 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-889e0fab-85ca-410b-98ab-011d4d6f4859 tempest-ProjectMemberTests-1774785373 None] Lock "cinder-6f8d8dbd-99e9-4734-91d4-e35d164c355e-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:44:06 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-889e0fab-85ca-410b-98ab-011d4d6f4859 tempest-ProjectMemberTests-1774785373 None] Acquiring lock "cinder-quobyte-6f8d8dbd-99e9-4734-91d4-e35d164c355e" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:44:06 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-889e0fab-85ca-410b-98ab-011d4d6f4859 tempest-ProjectMemberTests-1774785373 None] Lock "cinder-quobyte-6f8d8dbd-99e9-4734-91d4-e35d164c355e" acquired by "delete_volume" :: waited 0.022s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:44:06 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f860e83-4b59-4660-bc5b-bfec386ac72e]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:44:06 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-889e0fab-85ca-410b-98ab-011d4d6f4859 tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6f8d8dbd-99e9-4734-91d4-e35d164c355e {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:44:06 devstack sudo[115571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6f8d8dbd-99e9-4734-91d4-e35d164c355e Aug 26 14:44:06 devstack sudo[115571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:44:06 devstack sudo[115571]: pam_unix(sudo:session): session closed for user root Aug 26 14:44:06 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-889e0fab-85ca-410b-98ab-011d4d6f4859 tempest-ProjectMemberTests-1774785373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6f8d8dbd-99e9-4734-91d4-e35d164c355e" returned: 0 in 0.400s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:44:06 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-889e0fab-85ca-410b-98ab-011d4d6f4859 tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6f8d8dbd-99e9-4734-91d4-e35d164c355e {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:44:07 devstack sudo[115576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6f8d8dbd-99e9-4734-91d4-e35d164c355e Aug 26 14:44:07 devstack sudo[115576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:44:07 devstack sudo[115576]: pam_unix(sudo:session): session closed for user root Aug 26 14:44:07 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-889e0fab-85ca-410b-98ab-011d4d6f4859 tempest-ProjectMemberTests-1774785373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6f8d8dbd-99e9-4734-91d4-e35d164c355e" returned: 0 in 0.253s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:44:07 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-889e0fab-85ca-410b-98ab-011d4d6f4859 tempest-ProjectMemberTests-1774785373 None] Lock "cinder-quobyte-6f8d8dbd-99e9-4734-91d4-e35d164c355e" released by "delete_volume" :: held 0.721s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:44:07 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-889e0fab-85ca-410b-98ab-011d4d6f4859 tempest-ProjectMemberTests-1774785373 None] Created reservations ['cdd97286-6340-4178-945c-b40af2c175d8', '8e3319a6-84a8-48b8-b28f-c87c234761fd', '6fcbb5aa-699f-4857-961e-92fa6ef1c3b6', '7db004df-7817-41e5-82bb-3daa617d2545'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:44:07 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-889e0fab-85ca-410b-98ab-011d4d6f4859 tempest-ProjectMemberTests-1774785373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:44:07 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-889e0fab-85ca-410b-98ab-011d4d6f4859 tempest-ProjectMemberTests-1774785373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:44:07 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-889e0fab-85ca-410b-98ab-011d4d6f4859 tempest-ProjectMemberTests-1774785373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:44:07 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-889e0fab-85ca-410b-98ab-011d4d6f4859 tempest-ProjectMemberTests-1774785373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:44:07 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-889e0fab-85ca-410b-98ab-011d4d6f4859 tempest-ProjectMemberTests-1774785373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:44:07 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-889e0fab-85ca-410b-98ab-011d4d6f4859 tempest-ProjectMemberTests-1774785373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:44:07 devstack sudo[115579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:44:07 devstack sudo[115579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:44:07 devstack sudo[115579]: pam_unix(sudo:session): session closed for user root Aug 26 14:44:07 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-889e0fab-85ca-410b-98ab-011d4d6f4859 tempest-ProjectMemberTests-1774785373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.270s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:44:07 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-889e0fab-85ca-410b-98ab-011d4d6f4859 tempest-ProjectMemberTests-1774785373 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:44:07 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-889e0fab-85ca-410b-98ab-011d4d6f4859 tempest-ProjectMemberTests-1774785373 None] Deleted volume successfully. Aug 26 14:44:07 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-889e0fab-85ca-410b-98ab-011d4d6f4859 tempest-ProjectMemberTests-1774785373 None] Lock "cinder-6f8d8dbd-99e9-4734-91d4-e35d164c355e-delete_volume" released by "delete_volume" :: held 1.212s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:44:17 devstack cinder-volume[94394]: DEBUG dbcounter [-] [94394] Writing DB stats cinder:SELECT=10,cinder:INSERT=6,cinder:UPDATE=11 {{(pid=94394) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 14:44:17 devstack cinder-volume[94394]: DEBUG dbcounter [-] [94394] Writing DB stats cinder:DELETE=2,cinder:SELECT=9,cinder:INSERT=2,cinder:UPDATE=16 {{(pid=94394) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 14:44:20 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1370350-b769-49c0-9da4-47d8a1b1a45a tempest-ProjectReaderTests-657034904 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:44:20 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-d1370350-b769-49c0-9da4-47d8a1b1a45a tempest-ProjectReaderTests-657034904 None] Flow 'volume_create_manager' (934cd4b0-83d3-408a-b495-cb0bd73eb4ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:44:20 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-d1370350-b769-49c0-9da4-47d8a1b1a45a tempest-ProjectReaderTests-657034904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3401cfc2-dabc-44e8-9f0e-a7a35dd8410d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:44:20 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-d1370350-b769-49c0-9da4-47d8a1b1a45a tempest-ProjectReaderTests-657034904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3401cfc2-dabc-44e8-9f0e-a7a35dd8410d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:44:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1334230526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9b7842b-a659-4a7d-82d1-5cd16e09430e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a203edd095694be29136dbe74e7f9c05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:44:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:44:20Z,use_quota=True,user_id='1022b98421384115bfe98d3ad46da898',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:44:20 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-d1370350-b769-49c0-9da4-47d8a1b1a45a tempest-ProjectReaderTests-657034904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62e9c333-8d17-46c9-99ff-98344651fa57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:44:20 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-d1370350-b769-49c0-9da4-47d8a1b1a45a tempest-ProjectReaderTests-657034904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62e9c333-8d17-46c9-99ff-98344651fa57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:44:20 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-d1370350-b769-49c0-9da4-47d8a1b1a45a tempest-ProjectReaderTests-657034904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5631f694-3c0d-495c-b4de-ab47e7db0137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:44:20 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-d1370350-b769-49c0-9da4-47d8a1b1a45a tempest-ProjectReaderTests-657034904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5631f694-3c0d-495c-b4de-ab47e7db0137) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9b7842b-a659-4a7d-82d1-5cd16e09430e', 'volume_name': 'volume-d9b7842b-a659-4a7d-82d1-5cd16e09430e', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:44:20 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-d1370350-b769-49c0-9da4-47d8a1b1a45a tempest-ProjectReaderTests-657034904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c9dca75-3952-4744-bfe3-c44ddbc8c3b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:44:20 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-d1370350-b769-49c0-9da4-47d8a1b1a45a tempest-ProjectReaderTests-657034904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c9dca75-3952-4744-bfe3-c44ddbc8c3b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:44:20 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-d1370350-b769-49c0-9da4-47d8a1b1a45a tempest-ProjectReaderTests-657034904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87589555-1d54-4909-9947-3aa457833374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:44:20 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-d1370350-b769-49c0-9da4-47d8a1b1a45a tempest-ProjectReaderTests-657034904 None] Volume d9b7842b-a659-4a7d-82d1-5cd16e09430e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9b7842b-a659-4a7d-82d1-5cd16e09430e', 'volume_size': 1} Aug 26 14:44:20 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-d1370350-b769-49c0-9da4-47d8a1b1a45a tempest-ProjectReaderTests-657034904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:44:20 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-d1370350-b769-49c0-9da4-47d8a1b1a45a tempest-ProjectReaderTests-657034904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:44:20 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-d1370350-b769-49c0-9da4-47d8a1b1a45a tempest-ProjectReaderTests-657034904 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:44:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1334230526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9b7842b-a659-4a7d-82d1-5cd16e09430e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a203edd095694be29136dbe74e7f9c05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:44:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:44:20Z,use_quota=True,user_id='1022b98421384115bfe98d3ad46da898',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:44:20 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-d1370350-b769-49c0-9da4-47d8a1b1a45a tempest-ProjectReaderTests-657034904 None] Creating volume d9b7842b-a659-4a7d-82d1-5cd16e09430e {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:44:20 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-d1370350-b769-49c0-9da4-47d8a1b1a45a tempest-ProjectReaderTests-657034904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:44:20 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-d1370350-b769-49c0-9da4-47d8a1b1a45a tempest-ProjectReaderTests-657034904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:44:20 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-d1370350-b769-49c0-9da4-47d8a1b1a45a tempest-ProjectReaderTests-657034904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:44:20 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-d1370350-b769-49c0-9da4-47d8a1b1a45a tempest-ProjectReaderTests-657034904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:44:20 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-d1370350-b769-49c0-9da4-47d8a1b1a45a tempest-ProjectReaderTests-657034904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:44:20 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-d1370350-b769-49c0-9da4-47d8a1b1a45a tempest-ProjectReaderTests-657034904 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:44:20 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-d1370350-b769-49c0-9da4-47d8a1b1a45a tempest-ProjectReaderTests-657034904 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:44:20 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-d1370350-b769-49c0-9da4-47d8a1b1a45a tempest-ProjectReaderTests-657034904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d9b7842b-a659-4a7d-82d1-5cd16e09430e 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:44:20 devstack sudo[115587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d9b7842b-a659-4a7d-82d1-5cd16e09430e 1073741824 Aug 26 14:44:20 devstack sudo[115587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:44:20 devstack sudo[115587]: pam_unix(sudo:session): session closed for user root Aug 26 14:44:20 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-d1370350-b769-49c0-9da4-47d8a1b1a45a tempest-ProjectReaderTests-657034904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d9b7842b-a659-4a7d-82d1-5cd16e09430e 1073741824" returned: 0 in 0.406s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:44:20 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-d1370350-b769-49c0-9da4-47d8a1b1a45a tempest-ProjectReaderTests-657034904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d9b7842b-a659-4a7d-82d1-5cd16e09430e {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:44:20 devstack sudo[115592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d9b7842b-a659-4a7d-82d1-5cd16e09430e Aug 26 14:44:20 devstack sudo[115592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:44:20 devstack sudo[115592]: pam_unix(sudo:session): session closed for user root Aug 26 14:44:20 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-d1370350-b769-49c0-9da4-47d8a1b1a45a tempest-ProjectReaderTests-657034904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d9b7842b-a659-4a7d-82d1-5cd16e09430e" returned: 0 in 0.239s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:44:20 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-d1370350-b769-49c0-9da4-47d8a1b1a45a tempest-ProjectReaderTests-657034904 None] <== create_volume: return (686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:44:20 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-d1370350-b769-49c0-9da4-47d8a1b1a45a tempest-ProjectReaderTests-657034904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.689s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:44:20 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-d1370350-b769-49c0-9da4-47d8a1b1a45a tempest-ProjectReaderTests-657034904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87589555-1d54-4909-9947-3aa457833374) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9b7842b-a659-4a7d-82d1-5cd16e09430e', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:44:20 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-d1370350-b769-49c0-9da4-47d8a1b1a45a tempest-ProjectReaderTests-657034904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8235beac-25aa-45c0-9ed3-7165f5f0f193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:44:20 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-d1370350-b769-49c0-9da4-47d8a1b1a45a tempest-ProjectReaderTests-657034904 None] Volume volume-d9b7842b-a659-4a7d-82d1-5cd16e09430e (d9b7842b-a659-4a7d-82d1-5cd16e09430e): created successfully Aug 26 14:44:20 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-d1370350-b769-49c0-9da4-47d8a1b1a45a tempest-ProjectReaderTests-657034904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8235beac-25aa-45c0-9ed3-7165f5f0f193) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:44:20 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-d1370350-b769-49c0-9da4-47d8a1b1a45a tempest-ProjectReaderTests-657034904 None] Flow 'volume_create_manager' (934cd4b0-83d3-408a-b495-cb0bd73eb4ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:44:20 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-d1370350-b769-49c0-9da4-47d8a1b1a45a tempest-ProjectReaderTests-657034904 None] Created volume successfully. Aug 26 14:44:21 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-8c7de43a-a600-493c-bb34-b8f5ddeaf277 tempest-ProjectReaderTests-657034904 None] Acquiring lock "cinder-d9b7842b-a659-4a7d-82d1-5cd16e09430e-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:44:21 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-8c7de43a-a600-493c-bb34-b8f5ddeaf277 tempest-ProjectReaderTests-657034904 None] Lock "cinder-d9b7842b-a659-4a7d-82d1-5cd16e09430e-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:44:21 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-8c7de43a-a600-493c-bb34-b8f5ddeaf277 tempest-ProjectReaderTests-657034904 None] Acquiring lock "cinder-quobyte-d9b7842b-a659-4a7d-82d1-5cd16e09430e" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:44:21 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-8c7de43a-a600-493c-bb34-b8f5ddeaf277 tempest-ProjectReaderTests-657034904 None] Lock "cinder-quobyte-d9b7842b-a659-4a7d-82d1-5cd16e09430e" acquired by "delete_volume" :: waited 0.016s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:44:21 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[2053e53e-0b8f-4453-9348-9ad38086a940]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:44:21 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-8c7de43a-a600-493c-bb34-b8f5ddeaf277 tempest-ProjectReaderTests-657034904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d9b7842b-a659-4a7d-82d1-5cd16e09430e {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:44:21 devstack sudo[115596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d9b7842b-a659-4a7d-82d1-5cd16e09430e Aug 26 14:44:21 devstack sudo[115596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:44:21 devstack sudo[115596]: pam_unix(sudo:session): session closed for user root Aug 26 14:44:21 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-8c7de43a-a600-493c-bb34-b8f5ddeaf277 tempest-ProjectReaderTests-657034904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d9b7842b-a659-4a7d-82d1-5cd16e09430e" returned: 0 in 0.347s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:44:21 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-8c7de43a-a600-493c-bb34-b8f5ddeaf277 tempest-ProjectReaderTests-657034904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d9b7842b-a659-4a7d-82d1-5cd16e09430e {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:44:21 devstack sudo[115601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d9b7842b-a659-4a7d-82d1-5cd16e09430e Aug 26 14:44:21 devstack sudo[115601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:44:21 devstack sudo[115601]: pam_unix(sudo:session): session closed for user root Aug 26 14:44:21 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-8c7de43a-a600-493c-bb34-b8f5ddeaf277 tempest-ProjectReaderTests-657034904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-d9b7842b-a659-4a7d-82d1-5cd16e09430e" returned: 0 in 0.240s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:44:21 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-8c7de43a-a600-493c-bb34-b8f5ddeaf277 tempest-ProjectReaderTests-657034904 None] Lock "cinder-quobyte-d9b7842b-a659-4a7d-82d1-5cd16e09430e" released by "delete_volume" :: held 0.623s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:44:21 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-8c7de43a-a600-493c-bb34-b8f5ddeaf277 tempest-ProjectReaderTests-657034904 None] Created reservations ['b68cf276-a1cc-4130-bc8c-71451bd8bf0a', 'cd70926f-ce9e-43aa-b140-cc76a7ed95e3', '2ec5ce7f-c920-4a5e-a263-4bdd71828658', 'df52c742-c734-4f2d-81ec-aaf4c9d9f4d3'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:44:22 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-8c7de43a-a600-493c-bb34-b8f5ddeaf277 tempest-ProjectReaderTests-657034904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:44:22 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-8c7de43a-a600-493c-bb34-b8f5ddeaf277 tempest-ProjectReaderTests-657034904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:44:22 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-8c7de43a-a600-493c-bb34-b8f5ddeaf277 tempest-ProjectReaderTests-657034904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:44:22 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-8c7de43a-a600-493c-bb34-b8f5ddeaf277 tempest-ProjectReaderTests-657034904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:44:22 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-8c7de43a-a600-493c-bb34-b8f5ddeaf277 tempest-ProjectReaderTests-657034904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:44:22 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-8c7de43a-a600-493c-bb34-b8f5ddeaf277 tempest-ProjectReaderTests-657034904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:44:22 devstack sudo[115604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:44:22 devstack sudo[115604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:44:22 devstack sudo[115604]: pam_unix(sudo:session): session closed for user root Aug 26 14:44:22 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-8c7de43a-a600-493c-bb34-b8f5ddeaf277 tempest-ProjectReaderTests-657034904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.240s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:44:22 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-8c7de43a-a600-493c-bb34-b8f5ddeaf277 tempest-ProjectReaderTests-657034904 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:44:22 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-8c7de43a-a600-493c-bb34-b8f5ddeaf277 tempest-ProjectReaderTests-657034904 None] Deleted volume successfully. Aug 26 14:44:22 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-8c7de43a-a600-493c-bb34-b8f5ddeaf277 tempest-ProjectReaderTests-657034904 None] Lock "cinder-d9b7842b-a659-4a7d-82d1-5cd16e09430e-delete_volume" released by "delete_volume" :: held 1.047s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:44:22 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4437049-5c3e-4205-914b-449ff9cbdda7 tempest-ProjectReaderTests-657034904 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:44:22 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-a4437049-5c3e-4205-914b-449ff9cbdda7 tempest-ProjectReaderTests-657034904 None] Flow 'volume_create_manager' (2ae63131-8d05-46a3-8757-8d7cc33fdabc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:44:22 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-a4437049-5c3e-4205-914b-449ff9cbdda7 tempest-ProjectReaderTests-657034904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f908513b-13c5-4650-baea-d7a552d07bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:44:22 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-a4437049-5c3e-4205-914b-449ff9cbdda7 tempest-ProjectReaderTests-657034904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f908513b-13c5-4650-baea-d7a552d07bba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:44:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-71036743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b09f8949-f14e-4eba-97df-025dcae24673,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a203edd095694be29136dbe74e7f9c05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:44:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:44:23Z,use_quota=True,user_id='1022b98421384115bfe98d3ad46da898',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:44:22 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-a4437049-5c3e-4205-914b-449ff9cbdda7 tempest-ProjectReaderTests-657034904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f9ef67f-44e4-4f89-b971-9d8ff18abb31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:44:22 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-a4437049-5c3e-4205-914b-449ff9cbdda7 tempest-ProjectReaderTests-657034904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f9ef67f-44e4-4f89-b971-9d8ff18abb31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:44:22 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-a4437049-5c3e-4205-914b-449ff9cbdda7 tempest-ProjectReaderTests-657034904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (862059eb-2911-427f-ab8f-1cbc423d1b96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:44:22 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-a4437049-5c3e-4205-914b-449ff9cbdda7 tempest-ProjectReaderTests-657034904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (862059eb-2911-427f-ab8f-1cbc423d1b96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b09f8949-f14e-4eba-97df-025dcae24673', 'volume_name': 'volume-b09f8949-f14e-4eba-97df-025dcae24673', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:44:22 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-a4437049-5c3e-4205-914b-449ff9cbdda7 tempest-ProjectReaderTests-657034904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6635a0d3-99d5-4057-b668-9ccf83cdbe67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:44:22 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-a4437049-5c3e-4205-914b-449ff9cbdda7 tempest-ProjectReaderTests-657034904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6635a0d3-99d5-4057-b668-9ccf83cdbe67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:44:22 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-a4437049-5c3e-4205-914b-449ff9cbdda7 tempest-ProjectReaderTests-657034904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (015d5056-4168-4a8a-9a86-933fe95e3e08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:44:22 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-a4437049-5c3e-4205-914b-449ff9cbdda7 tempest-ProjectReaderTests-657034904 None] Volume b09f8949-f14e-4eba-97df-025dcae24673: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b09f8949-f14e-4eba-97df-025dcae24673', 'volume_size': 1} Aug 26 14:44:22 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-a4437049-5c3e-4205-914b-449ff9cbdda7 tempest-ProjectReaderTests-657034904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:44:22 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-a4437049-5c3e-4205-914b-449ff9cbdda7 tempest-ProjectReaderTests-657034904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:44:22 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-a4437049-5c3e-4205-914b-449ff9cbdda7 tempest-ProjectReaderTests-657034904 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:44:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-71036743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b09f8949-f14e-4eba-97df-025dcae24673,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a203edd095694be29136dbe74e7f9c05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:44:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:44:23Z,use_quota=True,user_id='1022b98421384115bfe98d3ad46da898',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:44:22 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-a4437049-5c3e-4205-914b-449ff9cbdda7 tempest-ProjectReaderTests-657034904 None] Creating volume b09f8949-f14e-4eba-97df-025dcae24673 {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:44:22 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-a4437049-5c3e-4205-914b-449ff9cbdda7 tempest-ProjectReaderTests-657034904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:44:22 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-a4437049-5c3e-4205-914b-449ff9cbdda7 tempest-ProjectReaderTests-657034904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:44:22 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-a4437049-5c3e-4205-914b-449ff9cbdda7 tempest-ProjectReaderTests-657034904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:44:22 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-a4437049-5c3e-4205-914b-449ff9cbdda7 tempest-ProjectReaderTests-657034904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:44:22 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-a4437049-5c3e-4205-914b-449ff9cbdda7 tempest-ProjectReaderTests-657034904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:44:22 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-a4437049-5c3e-4205-914b-449ff9cbdda7 tempest-ProjectReaderTests-657034904 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:44:22 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-a4437049-5c3e-4205-914b-449ff9cbdda7 tempest-ProjectReaderTests-657034904 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:44:22 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-a4437049-5c3e-4205-914b-449ff9cbdda7 tempest-ProjectReaderTests-657034904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b09f8949-f14e-4eba-97df-025dcae24673 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:44:22 devstack sudo[115607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b09f8949-f14e-4eba-97df-025dcae24673 1073741824 Aug 26 14:44:22 devstack sudo[115607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:44:23 devstack sudo[115607]: pam_unix(sudo:session): session closed for user root Aug 26 14:44:23 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-a4437049-5c3e-4205-914b-449ff9cbdda7 tempest-ProjectReaderTests-657034904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b09f8949-f14e-4eba-97df-025dcae24673 1073741824" returned: 0 in 0.399s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:44:23 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-a4437049-5c3e-4205-914b-449ff9cbdda7 tempest-ProjectReaderTests-657034904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b09f8949-f14e-4eba-97df-025dcae24673 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:44:23 devstack sudo[115612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b09f8949-f14e-4eba-97df-025dcae24673 Aug 26 14:44:23 devstack sudo[115612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:44:23 devstack sudo[115612]: pam_unix(sudo:session): session closed for user root Aug 26 14:44:23 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-a4437049-5c3e-4205-914b-449ff9cbdda7 tempest-ProjectReaderTests-657034904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b09f8949-f14e-4eba-97df-025dcae24673" returned: 0 in 0.236s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:44:23 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-a4437049-5c3e-4205-914b-449ff9cbdda7 tempest-ProjectReaderTests-657034904 None] <== create_volume: return (675ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:44:23 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-a4437049-5c3e-4205-914b-449ff9cbdda7 tempest-ProjectReaderTests-657034904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.678s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:44:23 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-a4437049-5c3e-4205-914b-449ff9cbdda7 tempest-ProjectReaderTests-657034904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (015d5056-4168-4a8a-9a86-933fe95e3e08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b09f8949-f14e-4eba-97df-025dcae24673', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:44:23 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-a4437049-5c3e-4205-914b-449ff9cbdda7 tempest-ProjectReaderTests-657034904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f13564d5-41d7-4a34-a7d1-28e976e497d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:44:23 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-a4437049-5c3e-4205-914b-449ff9cbdda7 tempest-ProjectReaderTests-657034904 None] Volume volume-b09f8949-f14e-4eba-97df-025dcae24673 (b09f8949-f14e-4eba-97df-025dcae24673): created successfully Aug 26 14:44:23 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-a4437049-5c3e-4205-914b-449ff9cbdda7 tempest-ProjectReaderTests-657034904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f13564d5-41d7-4a34-a7d1-28e976e497d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:44:23 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-a4437049-5c3e-4205-914b-449ff9cbdda7 tempest-ProjectReaderTests-657034904 None] Flow 'volume_create_manager' (2ae63131-8d05-46a3-8757-8d7cc33fdabc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:44:23 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-a4437049-5c3e-4205-914b-449ff9cbdda7 tempest-ProjectReaderTests-657034904 None] Created volume successfully. Aug 26 14:44:23 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-09b98943-bd89-4dfe-9ee5-a49c8410a54d tempest-ProjectReaderTests-657034904 None] Acquiring lock "cinder-b09f8949-f14e-4eba-97df-025dcae24673-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:44:23 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-09b98943-bd89-4dfe-9ee5-a49c8410a54d tempest-ProjectReaderTests-657034904 None] Lock "cinder-b09f8949-f14e-4eba-97df-025dcae24673-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:44:23 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-09b98943-bd89-4dfe-9ee5-a49c8410a54d tempest-ProjectReaderTests-657034904 None] Acquiring lock "cinder-quobyte-b09f8949-f14e-4eba-97df-025dcae24673" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:44:23 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-09b98943-bd89-4dfe-9ee5-a49c8410a54d tempest-ProjectReaderTests-657034904 None] Lock "cinder-quobyte-b09f8949-f14e-4eba-97df-025dcae24673" acquired by "delete_volume" :: waited 0.013s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:44:23 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[7db03541-a5d8-4ee8-a2a1-03adbd01287e]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:44:23 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-09b98943-bd89-4dfe-9ee5-a49c8410a54d tempest-ProjectReaderTests-657034904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b09f8949-f14e-4eba-97df-025dcae24673 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:44:24 devstack sudo[115615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b09f8949-f14e-4eba-97df-025dcae24673 Aug 26 14:44:24 devstack sudo[115615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:44:24 devstack sudo[115615]: pam_unix(sudo:session): session closed for user root Aug 26 14:44:24 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-09b98943-bd89-4dfe-9ee5-a49c8410a54d tempest-ProjectReaderTests-657034904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b09f8949-f14e-4eba-97df-025dcae24673" returned: 0 in 0.350s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:44:24 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-09b98943-bd89-4dfe-9ee5-a49c8410a54d tempest-ProjectReaderTests-657034904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b09f8949-f14e-4eba-97df-025dcae24673 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:44:24 devstack sudo[115620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b09f8949-f14e-4eba-97df-025dcae24673 Aug 26 14:44:24 devstack sudo[115620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:44:24 devstack sudo[115620]: pam_unix(sudo:session): session closed for user root Aug 26 14:44:24 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-09b98943-bd89-4dfe-9ee5-a49c8410a54d tempest-ProjectReaderTests-657034904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-b09f8949-f14e-4eba-97df-025dcae24673" returned: 0 in 0.237s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:44:24 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-09b98943-bd89-4dfe-9ee5-a49c8410a54d tempest-ProjectReaderTests-657034904 None] Lock "cinder-quobyte-b09f8949-f14e-4eba-97df-025dcae24673" released by "delete_volume" :: held 0.625s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:44:24 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-09b98943-bd89-4dfe-9ee5-a49c8410a54d tempest-ProjectReaderTests-657034904 None] Created reservations ['be0fe0a1-7151-48da-b79e-5a02a2921cee', '3d71d103-123b-4f1c-b6ce-469ed96af7ce', '171483a2-54f1-4e61-91b1-e474d786029a', '53105454-ab9a-46a6-b4d7-91ec681b789b'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:44:24 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-09b98943-bd89-4dfe-9ee5-a49c8410a54d tempest-ProjectReaderTests-657034904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:44:24 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-09b98943-bd89-4dfe-9ee5-a49c8410a54d tempest-ProjectReaderTests-657034904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:44:24 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-09b98943-bd89-4dfe-9ee5-a49c8410a54d tempest-ProjectReaderTests-657034904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:44:24 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-09b98943-bd89-4dfe-9ee5-a49c8410a54d tempest-ProjectReaderTests-657034904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:44:24 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-09b98943-bd89-4dfe-9ee5-a49c8410a54d tempest-ProjectReaderTests-657034904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:44:24 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-09b98943-bd89-4dfe-9ee5-a49c8410a54d tempest-ProjectReaderTests-657034904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:44:24 devstack sudo[115623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:44:24 devstack sudo[115623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:44:24 devstack sudo[115623]: pam_unix(sudo:session): session closed for user root Aug 26 14:44:24 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-09b98943-bd89-4dfe-9ee5-a49c8410a54d tempest-ProjectReaderTests-657034904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.236s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:44:24 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-09b98943-bd89-4dfe-9ee5-a49c8410a54d tempest-ProjectReaderTests-657034904 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:44:24 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-09b98943-bd89-4dfe-9ee5-a49c8410a54d tempest-ProjectReaderTests-657034904 None] Deleted volume successfully. Aug 26 14:44:24 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-09b98943-bd89-4dfe-9ee5-a49c8410a54d tempest-ProjectReaderTests-657034904 None] Lock "cinder-b09f8949-f14e-4eba-97df-025dcae24673-delete_volume" released by "delete_volume" :: held 1.044s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:44:28 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a03e223-628b-4c70-aa3e-a62e167ff617 tempest-ProjectReaderTests-937480282 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:44:28 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-0a03e223-628b-4c70-aa3e-a62e167ff617 tempest-ProjectReaderTests-937480282 None] Flow 'volume_create_manager' (3ed217da-f2f1-49c7-ba8b-33284524fd44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:44:28 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-0a03e223-628b-4c70-aa3e-a62e167ff617 tempest-ProjectReaderTests-937480282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (471c8d98-8fe8-4f2b-94e1-f4a9ba704a95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:44:28 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-0a03e223-628b-4c70-aa3e-a62e167ff617 tempest-ProjectReaderTests-937480282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (471c8d98-8fe8-4f2b-94e1-f4a9ba704a95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:44:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2075218453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fc4f360-afbe-4628-b434-1e0b4184e243,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='622b509f87fb480983ddbd2cef0f7028',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:44:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:44:28Z,use_quota=True,user_id='0da0653ba4bc4bc8a95bed71e233e3bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:44:28 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-0a03e223-628b-4c70-aa3e-a62e167ff617 tempest-ProjectReaderTests-937480282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a84d9224-b490-495f-871f-cc0f788198f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:44:28 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-0a03e223-628b-4c70-aa3e-a62e167ff617 tempest-ProjectReaderTests-937480282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a84d9224-b490-495f-871f-cc0f788198f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:44:28 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-0a03e223-628b-4c70-aa3e-a62e167ff617 tempest-ProjectReaderTests-937480282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f36f5db-1a09-4ef8-ae6c-be0c4de872e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:44:28 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-0a03e223-628b-4c70-aa3e-a62e167ff617 tempest-ProjectReaderTests-937480282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f36f5db-1a09-4ef8-ae6c-be0c4de872e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3fc4f360-afbe-4628-b434-1e0b4184e243', 'volume_name': 'volume-3fc4f360-afbe-4628-b434-1e0b4184e243', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:44:28 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-0a03e223-628b-4c70-aa3e-a62e167ff617 tempest-ProjectReaderTests-937480282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4436dbbf-c4ee-463a-8374-35d0ffbe1dc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:44:28 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-0a03e223-628b-4c70-aa3e-a62e167ff617 tempest-ProjectReaderTests-937480282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4436dbbf-c4ee-463a-8374-35d0ffbe1dc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:44:28 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-0a03e223-628b-4c70-aa3e-a62e167ff617 tempest-ProjectReaderTests-937480282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26a15b85-22f5-4f4e-b6d7-667478e0a8ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:44:28 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-0a03e223-628b-4c70-aa3e-a62e167ff617 tempest-ProjectReaderTests-937480282 None] Volume 3fc4f360-afbe-4628-b434-1e0b4184e243: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3fc4f360-afbe-4628-b434-1e0b4184e243', 'volume_size': 1} Aug 26 14:44:28 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-0a03e223-628b-4c70-aa3e-a62e167ff617 tempest-ProjectReaderTests-937480282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:44:28 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-0a03e223-628b-4c70-aa3e-a62e167ff617 tempest-ProjectReaderTests-937480282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:44:28 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-0a03e223-628b-4c70-aa3e-a62e167ff617 tempest-ProjectReaderTests-937480282 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:44:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2075218453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fc4f360-afbe-4628-b434-1e0b4184e243,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='622b509f87fb480983ddbd2cef0f7028',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:44:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:44:28Z,use_quota=True,user_id='0da0653ba4bc4bc8a95bed71e233e3bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:44:28 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-0a03e223-628b-4c70-aa3e-a62e167ff617 tempest-ProjectReaderTests-937480282 None] Creating volume 3fc4f360-afbe-4628-b434-1e0b4184e243 {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:44:28 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-0a03e223-628b-4c70-aa3e-a62e167ff617 tempest-ProjectReaderTests-937480282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:44:28 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-0a03e223-628b-4c70-aa3e-a62e167ff617 tempest-ProjectReaderTests-937480282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:44:28 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-0a03e223-628b-4c70-aa3e-a62e167ff617 tempest-ProjectReaderTests-937480282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:44:28 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-0a03e223-628b-4c70-aa3e-a62e167ff617 tempest-ProjectReaderTests-937480282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:44:28 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-0a03e223-628b-4c70-aa3e-a62e167ff617 tempest-ProjectReaderTests-937480282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:44:28 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-0a03e223-628b-4c70-aa3e-a62e167ff617 tempest-ProjectReaderTests-937480282 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:44:28 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-0a03e223-628b-4c70-aa3e-a62e167ff617 tempest-ProjectReaderTests-937480282 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:44:28 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-0a03e223-628b-4c70-aa3e-a62e167ff617 tempest-ProjectReaderTests-937480282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3fc4f360-afbe-4628-b434-1e0b4184e243 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:44:28 devstack sudo[115626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3fc4f360-afbe-4628-b434-1e0b4184e243 1073741824 Aug 26 14:44:28 devstack sudo[115626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:44:28 devstack sudo[115626]: pam_unix(sudo:session): session closed for user root Aug 26 14:44:28 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-0a03e223-628b-4c70-aa3e-a62e167ff617 tempest-ProjectReaderTests-937480282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3fc4f360-afbe-4628-b434-1e0b4184e243 1073741824" returned: 0 in 0.394s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:44:28 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-0a03e223-628b-4c70-aa3e-a62e167ff617 tempest-ProjectReaderTests-937480282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3fc4f360-afbe-4628-b434-1e0b4184e243 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:44:28 devstack sudo[115631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3fc4f360-afbe-4628-b434-1e0b4184e243 Aug 26 14:44:28 devstack sudo[115631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:44:29 devstack sudo[115631]: pam_unix(sudo:session): session closed for user root Aug 26 14:44:29 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-0a03e223-628b-4c70-aa3e-a62e167ff617 tempest-ProjectReaderTests-937480282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3fc4f360-afbe-4628-b434-1e0b4184e243" returned: 0 in 0.249s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:44:29 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-0a03e223-628b-4c70-aa3e-a62e167ff617 tempest-ProjectReaderTests-937480282 None] <== create_volume: return (686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:44:29 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-0a03e223-628b-4c70-aa3e-a62e167ff617 tempest-ProjectReaderTests-937480282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.689s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:44:29 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-0a03e223-628b-4c70-aa3e-a62e167ff617 tempest-ProjectReaderTests-937480282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26a15b85-22f5-4f4e-b6d7-667478e0a8ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3fc4f360-afbe-4628-b434-1e0b4184e243', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:44:29 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-0a03e223-628b-4c70-aa3e-a62e167ff617 tempest-ProjectReaderTests-937480282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dc874c2-3783-4a01-9aea-861b8db044c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:44:29 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-0a03e223-628b-4c70-aa3e-a62e167ff617 tempest-ProjectReaderTests-937480282 None] Volume volume-3fc4f360-afbe-4628-b434-1e0b4184e243 (3fc4f360-afbe-4628-b434-1e0b4184e243): created successfully Aug 26 14:44:29 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-0a03e223-628b-4c70-aa3e-a62e167ff617 tempest-ProjectReaderTests-937480282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dc874c2-3783-4a01-9aea-861b8db044c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:44:29 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-0a03e223-628b-4c70-aa3e-a62e167ff617 tempest-ProjectReaderTests-937480282 None] Flow 'volume_create_manager' (3ed217da-f2f1-49c7-ba8b-33284524fd44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:44:29 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-0a03e223-628b-4c70-aa3e-a62e167ff617 tempest-ProjectReaderTests-937480282 None] Created volume successfully. Aug 26 14:44:29 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-71a828ef-d8a0-43e3-8dc1-43df291a6d3c tempest-ProjectReaderTests-937480282 None] Acquiring lock "cinder-3fc4f360-afbe-4628-b434-1e0b4184e243-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:44:29 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-71a828ef-d8a0-43e3-8dc1-43df291a6d3c tempest-ProjectReaderTests-937480282 None] Lock "cinder-3fc4f360-afbe-4628-b434-1e0b4184e243-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:44:29 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-71a828ef-d8a0-43e3-8dc1-43df291a6d3c tempest-ProjectReaderTests-937480282 None] Acquiring lock "cinder-quobyte-3fc4f360-afbe-4628-b434-1e0b4184e243" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:44:29 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-71a828ef-d8a0-43e3-8dc1-43df291a6d3c tempest-ProjectReaderTests-937480282 None] Lock "cinder-quobyte-3fc4f360-afbe-4628-b434-1e0b4184e243" acquired by "delete_volume" :: waited 0.014s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:44:29 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[050b4c76-a83f-4910-956a-00d904820d38]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:44:29 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-71a828ef-d8a0-43e3-8dc1-43df291a6d3c tempest-ProjectReaderTests-937480282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3fc4f360-afbe-4628-b434-1e0b4184e243 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:44:29 devstack sudo[115634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3fc4f360-afbe-4628-b434-1e0b4184e243 Aug 26 14:44:29 devstack sudo[115634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:44:29 devstack sudo[115634]: pam_unix(sudo:session): session closed for user root Aug 26 14:44:29 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-71a828ef-d8a0-43e3-8dc1-43df291a6d3c tempest-ProjectReaderTests-937480282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3fc4f360-afbe-4628-b434-1e0b4184e243" returned: 0 in 0.353s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:44:29 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-71a828ef-d8a0-43e3-8dc1-43df291a6d3c tempest-ProjectReaderTests-937480282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3fc4f360-afbe-4628-b434-1e0b4184e243 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:44:29 devstack sudo[115639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3fc4f360-afbe-4628-b434-1e0b4184e243 Aug 26 14:44:29 devstack sudo[115639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:44:30 devstack sudo[115639]: pam_unix(sudo:session): session closed for user root Aug 26 14:44:30 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-71a828ef-d8a0-43e3-8dc1-43df291a6d3c tempest-ProjectReaderTests-937480282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-3fc4f360-afbe-4628-b434-1e0b4184e243" returned: 0 in 0.242s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:44:30 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-71a828ef-d8a0-43e3-8dc1-43df291a6d3c tempest-ProjectReaderTests-937480282 None] Lock "cinder-quobyte-3fc4f360-afbe-4628-b434-1e0b4184e243" released by "delete_volume" :: held 0.629s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:44:30 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-71a828ef-d8a0-43e3-8dc1-43df291a6d3c tempest-ProjectReaderTests-937480282 None] Created reservations ['c40d39b9-e886-4a49-8c1b-39b50e5ae5c2', '017c3aa6-ae17-4fcb-95c3-8140f523fe91', '75275dbe-71f9-4de1-b573-53c52e23d0e8', '70289f06-a1ea-41b4-a1e3-48f4b0d1b713'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:44:30 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-71a828ef-d8a0-43e3-8dc1-43df291a6d3c tempest-ProjectReaderTests-937480282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:44:30 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-71a828ef-d8a0-43e3-8dc1-43df291a6d3c tempest-ProjectReaderTests-937480282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:44:30 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-71a828ef-d8a0-43e3-8dc1-43df291a6d3c tempest-ProjectReaderTests-937480282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:44:30 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-71a828ef-d8a0-43e3-8dc1-43df291a6d3c tempest-ProjectReaderTests-937480282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:44:30 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-71a828ef-d8a0-43e3-8dc1-43df291a6d3c tempest-ProjectReaderTests-937480282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:44:30 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-71a828ef-d8a0-43e3-8dc1-43df291a6d3c tempest-ProjectReaderTests-937480282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:44:30 devstack sudo[115642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:44:30 devstack sudo[115642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:44:30 devstack sudo[115642]: pam_unix(sudo:session): session closed for user root Aug 26 14:44:30 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-71a828ef-d8a0-43e3-8dc1-43df291a6d3c tempest-ProjectReaderTests-937480282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.231s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:44:30 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-71a828ef-d8a0-43e3-8dc1-43df291a6d3c tempest-ProjectReaderTests-937480282 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:44:30 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-71a828ef-d8a0-43e3-8dc1-43df291a6d3c tempest-ProjectReaderTests-937480282 None] Deleted volume successfully. Aug 26 14:44:30 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-71a828ef-d8a0-43e3-8dc1-43df291a6d3c tempest-ProjectReaderTests-937480282 None] Lock "cinder-3fc4f360-afbe-4628-b434-1e0b4184e243-delete_volume" released by "delete_volume" :: held 1.044s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:44:31 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-684673be-f50f-464c-9386-bf5cf2363440 tempest-ProjectReaderTests-937480282 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:44:31 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-684673be-f50f-464c-9386-bf5cf2363440 tempest-ProjectReaderTests-937480282 None] Flow 'volume_create_manager' (e95c71c8-441c-4d64-a960-a1f11b05d4c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:44:31 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-684673be-f50f-464c-9386-bf5cf2363440 tempest-ProjectReaderTests-937480282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc4753b3-db03-492a-bdda-16dbfaf3324a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:44:31 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-684673be-f50f-464c-9386-bf5cf2363440 tempest-ProjectReaderTests-937480282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc4753b3-db03-492a-bdda-16dbfaf3324a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:44:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-978034344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4b4a39f-2c24-4786-8b76-f902aef77abb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='622b509f87fb480983ddbd2cef0f7028',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:44:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:44:31Z,use_quota=True,user_id='0da0653ba4bc4bc8a95bed71e233e3bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:44:31 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-684673be-f50f-464c-9386-bf5cf2363440 tempest-ProjectReaderTests-937480282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e590da56-892e-4802-b4ec-a580f12cdbe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:44:31 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-684673be-f50f-464c-9386-bf5cf2363440 tempest-ProjectReaderTests-937480282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e590da56-892e-4802-b4ec-a580f12cdbe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:44:31 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-684673be-f50f-464c-9386-bf5cf2363440 tempest-ProjectReaderTests-937480282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6e92ceb-a8b7-4ac3-8071-a8f3e37d5a4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:44:31 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-684673be-f50f-464c-9386-bf5cf2363440 tempest-ProjectReaderTests-937480282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6e92ceb-a8b7-4ac3-8071-a8f3e37d5a4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4b4a39f-2c24-4786-8b76-f902aef77abb', 'volume_name': 'volume-e4b4a39f-2c24-4786-8b76-f902aef77abb', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:44:31 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-684673be-f50f-464c-9386-bf5cf2363440 tempest-ProjectReaderTests-937480282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (453dac14-d96a-4c70-8a70-4f59b289a67a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:44:31 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-684673be-f50f-464c-9386-bf5cf2363440 tempest-ProjectReaderTests-937480282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (453dac14-d96a-4c70-8a70-4f59b289a67a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:44:31 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-684673be-f50f-464c-9386-bf5cf2363440 tempest-ProjectReaderTests-937480282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84fef9c1-0881-4c64-9f0c-cf83e0ca3d18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:44:31 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-684673be-f50f-464c-9386-bf5cf2363440 tempest-ProjectReaderTests-937480282 None] Volume e4b4a39f-2c24-4786-8b76-f902aef77abb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4b4a39f-2c24-4786-8b76-f902aef77abb', 'volume_size': 1} Aug 26 14:44:31 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-684673be-f50f-464c-9386-bf5cf2363440 tempest-ProjectReaderTests-937480282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:44:31 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-684673be-f50f-464c-9386-bf5cf2363440 tempest-ProjectReaderTests-937480282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:44:31 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-684673be-f50f-464c-9386-bf5cf2363440 tempest-ProjectReaderTests-937480282 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:44:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-978034344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4b4a39f-2c24-4786-8b76-f902aef77abb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='622b509f87fb480983ddbd2cef0f7028',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:44:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:44:31Z,use_quota=True,user_id='0da0653ba4bc4bc8a95bed71e233e3bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:44:31 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-684673be-f50f-464c-9386-bf5cf2363440 tempest-ProjectReaderTests-937480282 None] Creating volume e4b4a39f-2c24-4786-8b76-f902aef77abb {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:44:31 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-684673be-f50f-464c-9386-bf5cf2363440 tempest-ProjectReaderTests-937480282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:44:31 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-684673be-f50f-464c-9386-bf5cf2363440 tempest-ProjectReaderTests-937480282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:44:31 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-684673be-f50f-464c-9386-bf5cf2363440 tempest-ProjectReaderTests-937480282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:44:31 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-684673be-f50f-464c-9386-bf5cf2363440 tempest-ProjectReaderTests-937480282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:44:31 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-684673be-f50f-464c-9386-bf5cf2363440 tempest-ProjectReaderTests-937480282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:44:31 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-684673be-f50f-464c-9386-bf5cf2363440 tempest-ProjectReaderTests-937480282 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:44:31 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-684673be-f50f-464c-9386-bf5cf2363440 tempest-ProjectReaderTests-937480282 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:44:31 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-684673be-f50f-464c-9386-bf5cf2363440 tempest-ProjectReaderTests-937480282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-e4b4a39f-2c24-4786-8b76-f902aef77abb 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:44:31 devstack sudo[115646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-e4b4a39f-2c24-4786-8b76-f902aef77abb 1073741824 Aug 26 14:44:31 devstack sudo[115646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:44:31 devstack sudo[115646]: pam_unix(sudo:session): session closed for user root Aug 26 14:44:31 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-684673be-f50f-464c-9386-bf5cf2363440 tempest-ProjectReaderTests-937480282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-e4b4a39f-2c24-4786-8b76-f902aef77abb 1073741824" returned: 0 in 0.401s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:44:31 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-684673be-f50f-464c-9386-bf5cf2363440 tempest-ProjectReaderTests-937480282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-e4b4a39f-2c24-4786-8b76-f902aef77abb {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:44:31 devstack sudo[115651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-e4b4a39f-2c24-4786-8b76-f902aef77abb Aug 26 14:44:31 devstack sudo[115651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:44:31 devstack sudo[115651]: pam_unix(sudo:session): session closed for user root Aug 26 14:44:31 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-684673be-f50f-464c-9386-bf5cf2363440 tempest-ProjectReaderTests-937480282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-e4b4a39f-2c24-4786-8b76-f902aef77abb" returned: 0 in 0.242s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:44:31 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-684673be-f50f-464c-9386-bf5cf2363440 tempest-ProjectReaderTests-937480282 None] <== create_volume: return (679ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:44:31 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-684673be-f50f-464c-9386-bf5cf2363440 tempest-ProjectReaderTests-937480282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.682s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:44:31 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-684673be-f50f-464c-9386-bf5cf2363440 tempest-ProjectReaderTests-937480282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84fef9c1-0881-4c64-9f0c-cf83e0ca3d18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4b4a39f-2c24-4786-8b76-f902aef77abb', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:44:31 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-684673be-f50f-464c-9386-bf5cf2363440 tempest-ProjectReaderTests-937480282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b94b0f47-21f1-4f20-950b-1a79db80a26c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:44:31 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-684673be-f50f-464c-9386-bf5cf2363440 tempest-ProjectReaderTests-937480282 None] Volume volume-e4b4a39f-2c24-4786-8b76-f902aef77abb (e4b4a39f-2c24-4786-8b76-f902aef77abb): created successfully Aug 26 14:44:31 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-684673be-f50f-464c-9386-bf5cf2363440 tempest-ProjectReaderTests-937480282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b94b0f47-21f1-4f20-950b-1a79db80a26c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:44:31 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-684673be-f50f-464c-9386-bf5cf2363440 tempest-ProjectReaderTests-937480282 None] Flow 'volume_create_manager' (e95c71c8-441c-4d64-a960-a1f11b05d4c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:44:31 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-684673be-f50f-464c-9386-bf5cf2363440 tempest-ProjectReaderTests-937480282 None] Created volume successfully. Aug 26 14:44:32 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-c74f6956-9204-498e-9d9b-5eea4635e665 tempest-ProjectReaderTests-937480282 None] Acquiring lock "cinder-e4b4a39f-2c24-4786-8b76-f902aef77abb-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:44:32 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-c74f6956-9204-498e-9d9b-5eea4635e665 tempest-ProjectReaderTests-937480282 None] Lock "cinder-e4b4a39f-2c24-4786-8b76-f902aef77abb-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:44:32 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-c74f6956-9204-498e-9d9b-5eea4635e665 tempest-ProjectReaderTests-937480282 None] Acquiring lock "cinder-quobyte-e4b4a39f-2c24-4786-8b76-f902aef77abb" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:44:32 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-c74f6956-9204-498e-9d9b-5eea4635e665 tempest-ProjectReaderTests-937480282 None] Lock "cinder-quobyte-e4b4a39f-2c24-4786-8b76-f902aef77abb" acquired by "delete_volume" :: waited 0.015s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:44:32 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d6eccb7-38b7-4100-9ccc-d6fffe5ecc04]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:44:32 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-c74f6956-9204-498e-9d9b-5eea4635e665 tempest-ProjectReaderTests-937480282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-e4b4a39f-2c24-4786-8b76-f902aef77abb {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:44:32 devstack sudo[115654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-e4b4a39f-2c24-4786-8b76-f902aef77abb Aug 26 14:44:32 devstack sudo[115654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:44:32 devstack sudo[115654]: pam_unix(sudo:session): session closed for user root Aug 26 14:44:32 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-c74f6956-9204-498e-9d9b-5eea4635e665 tempest-ProjectReaderTests-937480282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-e4b4a39f-2c24-4786-8b76-f902aef77abb" returned: 0 in 0.344s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:44:32 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-c74f6956-9204-498e-9d9b-5eea4635e665 tempest-ProjectReaderTests-937480282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-e4b4a39f-2c24-4786-8b76-f902aef77abb {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:44:32 devstack sudo[115659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-e4b4a39f-2c24-4786-8b76-f902aef77abb Aug 26 14:44:32 devstack sudo[115659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:44:32 devstack sudo[115659]: pam_unix(sudo:session): session closed for user root Aug 26 14:44:32 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-c74f6956-9204-498e-9d9b-5eea4635e665 tempest-ProjectReaderTests-937480282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-e4b4a39f-2c24-4786-8b76-f902aef77abb" returned: 0 in 0.235s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:44:32 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-c74f6956-9204-498e-9d9b-5eea4635e665 tempest-ProjectReaderTests-937480282 None] Lock "cinder-quobyte-e4b4a39f-2c24-4786-8b76-f902aef77abb" released by "delete_volume" :: held 0.615s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:44:32 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-c74f6956-9204-498e-9d9b-5eea4635e665 tempest-ProjectReaderTests-937480282 None] Created reservations ['cc5d20bc-4b00-4ca2-9e5b-0d293225b9c5', 'bf617ce0-5c4a-4702-bed0-6208c381e0f4', '16f0b482-5618-4e46-a2c3-0c0e7aec1df8', 'a6aa39a1-2e50-4598-b8e0-a567dee782bf'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:44:32 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-c74f6956-9204-498e-9d9b-5eea4635e665 tempest-ProjectReaderTests-937480282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:44:32 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-c74f6956-9204-498e-9d9b-5eea4635e665 tempest-ProjectReaderTests-937480282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:44:32 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-c74f6956-9204-498e-9d9b-5eea4635e665 tempest-ProjectReaderTests-937480282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:44:32 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-c74f6956-9204-498e-9d9b-5eea4635e665 tempest-ProjectReaderTests-937480282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:44:32 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-c74f6956-9204-498e-9d9b-5eea4635e665 tempest-ProjectReaderTests-937480282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:44:32 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-c74f6956-9204-498e-9d9b-5eea4635e665 tempest-ProjectReaderTests-937480282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:44:32 devstack sudo[115662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:44:32 devstack sudo[115662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:44:33 devstack sudo[115662]: pam_unix(sudo:session): session closed for user root Aug 26 14:44:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-c74f6956-9204-498e-9d9b-5eea4635e665 tempest-ProjectReaderTests-937480282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.239s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:44:33 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-c74f6956-9204-498e-9d9b-5eea4635e665 tempest-ProjectReaderTests-937480282 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:44:33 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-c74f6956-9204-498e-9d9b-5eea4635e665 tempest-ProjectReaderTests-937480282 None] Deleted volume successfully. Aug 26 14:44:33 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-c74f6956-9204-498e-9d9b-5eea4635e665 tempest-ProjectReaderTests-937480282 None] Lock "cinder-e4b4a39f-2c24-4786-8b76-f902aef77abb-delete_volume" released by "delete_volume" :: held 1.051s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:44:33 devstack cinder-volume[94394]: DEBUG oslo_service.periodic_task [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94394) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 14:44:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:44:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:44:33 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:44:33 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:44:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:44:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:44:33 devstack sudo[115665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:44:33 devstack sudo[115665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:44:33 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5846d67-ac80-438a-a342-bd6ff912bb5f tempest-ProjectReaderTests-937480282 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:44:33 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-c5846d67-ac80-438a-a342-bd6ff912bb5f tempest-ProjectReaderTests-937480282 None] Flow 'volume_create_manager' (5fcb9be2-8201-4a99-ba38-a45a4c6f9c60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:44:33 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-c5846d67-ac80-438a-a342-bd6ff912bb5f tempest-ProjectReaderTests-937480282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f0bed50-c216-4f05-adb0-3da19ccfea83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:44:33 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-c5846d67-ac80-438a-a342-bd6ff912bb5f tempest-ProjectReaderTests-937480282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f0bed50-c216-4f05-adb0-3da19ccfea83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:44:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-685509058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e48bb2d-9397-47c9-b18d-5b4ef1e0b7c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='622b509f87fb480983ddbd2cef0f7028',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:44:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:44:34Z,use_quota=True,user_id='0da0653ba4bc4bc8a95bed71e233e3bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:44:33 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-c5846d67-ac80-438a-a342-bd6ff912bb5f tempest-ProjectReaderTests-937480282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25bfdd0f-45f9-4b16-b406-4c7e4d267feb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:44:33 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-c5846d67-ac80-438a-a342-bd6ff912bb5f tempest-ProjectReaderTests-937480282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25bfdd0f-45f9-4b16-b406-4c7e4d267feb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:44:33 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-c5846d67-ac80-438a-a342-bd6ff912bb5f tempest-ProjectReaderTests-937480282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (307346dd-4bdf-47d6-afca-383898e8d4fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:44:33 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-c5846d67-ac80-438a-a342-bd6ff912bb5f tempest-ProjectReaderTests-937480282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (307346dd-4bdf-47d6-afca-383898e8d4fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e48bb2d-9397-47c9-b18d-5b4ef1e0b7c8', 'volume_name': 'volume-6e48bb2d-9397-47c9-b18d-5b4ef1e0b7c8', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:44:33 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-c5846d67-ac80-438a-a342-bd6ff912bb5f tempest-ProjectReaderTests-937480282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dae9a086-3a52-45d1-b4f7-5ad1ea911d8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:44:33 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-c5846d67-ac80-438a-a342-bd6ff912bb5f tempest-ProjectReaderTests-937480282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dae9a086-3a52-45d1-b4f7-5ad1ea911d8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:44:33 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-c5846d67-ac80-438a-a342-bd6ff912bb5f tempest-ProjectReaderTests-937480282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c96d24e2-c281-40c4-aff1-5b5f68b44a0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:44:33 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-c5846d67-ac80-438a-a342-bd6ff912bb5f tempest-ProjectReaderTests-937480282 None] Volume 6e48bb2d-9397-47c9-b18d-5b4ef1e0b7c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e48bb2d-9397-47c9-b18d-5b4ef1e0b7c8', 'volume_size': 1} Aug 26 14:44:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-c5846d67-ac80-438a-a342-bd6ff912bb5f tempest-ProjectReaderTests-937480282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:44:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-c5846d67-ac80-438a-a342-bd6ff912bb5f tempest-ProjectReaderTests-937480282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:44:33 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-c5846d67-ac80-438a-a342-bd6ff912bb5f tempest-ProjectReaderTests-937480282 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:44:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-685509058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e48bb2d-9397-47c9-b18d-5b4ef1e0b7c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='622b509f87fb480983ddbd2cef0f7028',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:44:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:44:34Z,use_quota=True,user_id='0da0653ba4bc4bc8a95bed71e233e3bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:44:33 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-c5846d67-ac80-438a-a342-bd6ff912bb5f tempest-ProjectReaderTests-937480282 None] Creating volume 6e48bb2d-9397-47c9-b18d-5b4ef1e0b7c8 {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:44:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-c5846d67-ac80-438a-a342-bd6ff912bb5f tempest-ProjectReaderTests-937480282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:44:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-c5846d67-ac80-438a-a342-bd6ff912bb5f tempest-ProjectReaderTests-937480282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:44:33 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-c5846d67-ac80-438a-a342-bd6ff912bb5f tempest-ProjectReaderTests-937480282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:44:33 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-c5846d67-ac80-438a-a342-bd6ff912bb5f tempest-ProjectReaderTests-937480282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:44:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-c5846d67-ac80-438a-a342-bd6ff912bb5f tempest-ProjectReaderTests-937480282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:44:33 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-c5846d67-ac80-438a-a342-bd6ff912bb5f tempest-ProjectReaderTests-937480282 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:44:33 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-c5846d67-ac80-438a-a342-bd6ff912bb5f tempest-ProjectReaderTests-937480282 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:44:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-c5846d67-ac80-438a-a342-bd6ff912bb5f tempest-ProjectReaderTests-937480282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6e48bb2d-9397-47c9-b18d-5b4ef1e0b7c8 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:44:33 devstack sudo[115667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6e48bb2d-9397-47c9-b18d-5b4ef1e0b7c8 1073741824 Aug 26 14:44:33 devstack sudo[115667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:44:33 devstack sudo[115665]: pam_unix(sudo:session): session closed for user root Aug 26 14:44:33 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.263s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:44:33 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:44:33 devstack cinder-volume[94394]: DEBUG oslo_service.periodic_task [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] Running periodic task VolumeManager._thread_info {{(pid=94394) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 14:44:33 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] thread count: 28 {{(pid=94394) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 14:44:33 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-e7dc1ac6-98f1-48eb-bd2b-21a20c1148b2 None None] thread info: [<_MainThread(MainThread, started 126600738033792)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94394) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 14:44:34 devstack sudo[115667]: pam_unix(sudo:session): session closed for user root Aug 26 14:44:34 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-c5846d67-ac80-438a-a342-bd6ff912bb5f tempest-ProjectReaderTests-937480282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6e48bb2d-9397-47c9-b18d-5b4ef1e0b7c8 1073741824" returned: 0 in 0.414s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:44:34 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-c5846d67-ac80-438a-a342-bd6ff912bb5f tempest-ProjectReaderTests-937480282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6e48bb2d-9397-47c9-b18d-5b4ef1e0b7c8 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:44:34 devstack sudo[115673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6e48bb2d-9397-47c9-b18d-5b4ef1e0b7c8 Aug 26 14:44:34 devstack sudo[115673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:44:34 devstack sudo[115673]: pam_unix(sudo:session): session closed for user root Aug 26 14:44:34 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-c5846d67-ac80-438a-a342-bd6ff912bb5f tempest-ProjectReaderTests-937480282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6e48bb2d-9397-47c9-b18d-5b4ef1e0b7c8" returned: 0 in 0.237s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:44:34 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-c5846d67-ac80-438a-a342-bd6ff912bb5f tempest-ProjectReaderTests-937480282 None] <== create_volume: return (694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:44:34 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-c5846d67-ac80-438a-a342-bd6ff912bb5f tempest-ProjectReaderTests-937480282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.698s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:44:34 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-c5846d67-ac80-438a-a342-bd6ff912bb5f tempest-ProjectReaderTests-937480282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c96d24e2-c281-40c4-aff1-5b5f68b44a0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e48bb2d-9397-47c9-b18d-5b4ef1e0b7c8', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:44:34 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-c5846d67-ac80-438a-a342-bd6ff912bb5f tempest-ProjectReaderTests-937480282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25c559f2-5842-46ae-9c79-6be12d1b87b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:44:34 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-c5846d67-ac80-438a-a342-bd6ff912bb5f tempest-ProjectReaderTests-937480282 None] Volume volume-6e48bb2d-9397-47c9-b18d-5b4ef1e0b7c8 (6e48bb2d-9397-47c9-b18d-5b4ef1e0b7c8): created successfully Aug 26 14:44:34 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-c5846d67-ac80-438a-a342-bd6ff912bb5f tempest-ProjectReaderTests-937480282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25c559f2-5842-46ae-9c79-6be12d1b87b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:44:34 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-c5846d67-ac80-438a-a342-bd6ff912bb5f tempest-ProjectReaderTests-937480282 None] Flow 'volume_create_manager' (5fcb9be2-8201-4a99-ba38-a45a4c6f9c60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:44:34 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-c5846d67-ac80-438a-a342-bd6ff912bb5f tempest-ProjectReaderTests-937480282 None] Created volume successfully. Aug 26 14:44:34 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-b5a88ca9-1808-4375-b527-76d7760e39d6 tempest-ProjectReaderTests-937480282 None] Acquiring lock "cinder-6e48bb2d-9397-47c9-b18d-5b4ef1e0b7c8-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:44:34 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-b5a88ca9-1808-4375-b527-76d7760e39d6 tempest-ProjectReaderTests-937480282 None] Lock "cinder-6e48bb2d-9397-47c9-b18d-5b4ef1e0b7c8-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:44:34 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-b5a88ca9-1808-4375-b527-76d7760e39d6 tempest-ProjectReaderTests-937480282 None] Acquiring lock "cinder-quobyte-6e48bb2d-9397-47c9-b18d-5b4ef1e0b7c8" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:44:34 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-b5a88ca9-1808-4375-b527-76d7760e39d6 tempest-ProjectReaderTests-937480282 None] Lock "cinder-quobyte-6e48bb2d-9397-47c9-b18d-5b4ef1e0b7c8" acquired by "delete_volume" :: waited 0.017s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:44:34 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5c540eb-f247-4b26-8c6e-9991ea846bc7]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:44:34 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-b5a88ca9-1808-4375-b527-76d7760e39d6 tempest-ProjectReaderTests-937480282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6e48bb2d-9397-47c9-b18d-5b4ef1e0b7c8 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:44:34 devstack sudo[115676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6e48bb2d-9397-47c9-b18d-5b4ef1e0b7c8 Aug 26 14:44:34 devstack sudo[115676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:44:35 devstack sudo[115676]: pam_unix(sudo:session): session closed for user root Aug 26 14:44:35 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-b5a88ca9-1808-4375-b527-76d7760e39d6 tempest-ProjectReaderTests-937480282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6e48bb2d-9397-47c9-b18d-5b4ef1e0b7c8" returned: 0 in 0.385s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:44:35 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-b5a88ca9-1808-4375-b527-76d7760e39d6 tempest-ProjectReaderTests-937480282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6e48bb2d-9397-47c9-b18d-5b4ef1e0b7c8 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:44:35 devstack sudo[115716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6e48bb2d-9397-47c9-b18d-5b4ef1e0b7c8 Aug 26 14:44:35 devstack sudo[115716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:44:35 devstack sudo[115716]: pam_unix(sudo:session): session closed for user root Aug 26 14:44:35 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-b5a88ca9-1808-4375-b527-76d7760e39d6 tempest-ProjectReaderTests-937480282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-6e48bb2d-9397-47c9-b18d-5b4ef1e0b7c8" returned: 0 in 0.249s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:44:35 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-b5a88ca9-1808-4375-b527-76d7760e39d6 tempest-ProjectReaderTests-937480282 None] Lock "cinder-quobyte-6e48bb2d-9397-47c9-b18d-5b4ef1e0b7c8" released by "delete_volume" :: held 0.673s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:44:35 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-b5a88ca9-1808-4375-b527-76d7760e39d6 tempest-ProjectReaderTests-937480282 None] Created reservations ['ae2552b3-fd50-4822-a684-a978c1e7eb59', '276265c1-9b56-4456-9258-fb539e19ad69', '9c731fc5-67ad-4a11-ad33-1a5167fc493c', 'ca690d9b-c024-4bb4-a846-b9650c6d012a'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:44:35 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-b5a88ca9-1808-4375-b527-76d7760e39d6 tempest-ProjectReaderTests-937480282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:44:35 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-b5a88ca9-1808-4375-b527-76d7760e39d6 tempest-ProjectReaderTests-937480282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:44:35 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-b5a88ca9-1808-4375-b527-76d7760e39d6 tempest-ProjectReaderTests-937480282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:44:35 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-b5a88ca9-1808-4375-b527-76d7760e39d6 tempest-ProjectReaderTests-937480282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:44:35 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-b5a88ca9-1808-4375-b527-76d7760e39d6 tempest-ProjectReaderTests-937480282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:44:35 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-b5a88ca9-1808-4375-b527-76d7760e39d6 tempest-ProjectReaderTests-937480282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:44:35 devstack sudo[115721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:44:35 devstack sudo[115721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:44:35 devstack sudo[115721]: pam_unix(sudo:session): session closed for user root Aug 26 14:44:35 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-b5a88ca9-1808-4375-b527-76d7760e39d6 tempest-ProjectReaderTests-937480282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.237s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:44:35 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-b5a88ca9-1808-4375-b527-76d7760e39d6 tempest-ProjectReaderTests-937480282 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:44:35 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-b5a88ca9-1808-4375-b527-76d7760e39d6 tempest-ProjectReaderTests-937480282 None] Deleted volume successfully. Aug 26 14:44:35 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-b5a88ca9-1808-4375-b527-76d7760e39d6 tempest-ProjectReaderTests-937480282 None] Lock "cinder-6e48bb2d-9397-47c9-b18d-5b4ef1e0b7c8-delete_volume" released by "delete_volume" :: held 1.104s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:44:36 devstack cinder-volume[94394]: DEBUG cinder.volume.flows.manager.create_volume [None req-3734727d-df8a-4db9-be35-bc0644b1d348 tempest-ProjectReaderTests-937480282 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94394) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 14:44:36 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-3734727d-df8a-4db9-be35-bc0644b1d348 tempest-ProjectReaderTests-937480282 None] Flow 'volume_create_manager' (0fac1b08-5149-46bb-8e47-05debe49bd26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:44:36 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-3734727d-df8a-4db9-be35-bc0644b1d348 tempest-ProjectReaderTests-937480282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84b369a9-f423-4e25-8188-60408e372468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:44:36 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-3734727d-df8a-4db9-be35-bc0644b1d348 tempest-ProjectReaderTests-937480282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84b369a9-f423-4e25-8188-60408e372468) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:44:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1490241050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=330ecc9a-745b-493e-a0f9-1a584752d363,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='622b509f87fb480983ddbd2cef0f7028',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:44:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:44:36Z,use_quota=True,user_id='0da0653ba4bc4bc8a95bed71e233e3bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:44:36 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-3734727d-df8a-4db9-be35-bc0644b1d348 tempest-ProjectReaderTests-937480282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b2ca478-bf55-49d0-853d-621fab47d369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:44:36 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-3734727d-df8a-4db9-be35-bc0644b1d348 tempest-ProjectReaderTests-937480282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b2ca478-bf55-49d0-853d-621fab47d369) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:44:36 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-3734727d-df8a-4db9-be35-bc0644b1d348 tempest-ProjectReaderTests-937480282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19432352-36ba-4df8-a928-e98b6c28cf8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:44:36 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-3734727d-df8a-4db9-be35-bc0644b1d348 tempest-ProjectReaderTests-937480282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19432352-36ba-4df8-a928-e98b6c28cf8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '330ecc9a-745b-493e-a0f9-1a584752d363', 'volume_name': 'volume-330ecc9a-745b-493e-a0f9-1a584752d363', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:44:36 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-3734727d-df8a-4db9-be35-bc0644b1d348 tempest-ProjectReaderTests-937480282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1086ddb-52fb-4001-85e4-114385a506e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:44:36 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-3734727d-df8a-4db9-be35-bc0644b1d348 tempest-ProjectReaderTests-937480282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1086ddb-52fb-4001-85e4-114385a506e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:44:36 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-3734727d-df8a-4db9-be35-bc0644b1d348 tempest-ProjectReaderTests-937480282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0aa1e105-2257-4ae6-baae-9c0fefcf7570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:44:36 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-3734727d-df8a-4db9-be35-bc0644b1d348 tempest-ProjectReaderTests-937480282 None] Volume 330ecc9a-745b-493e-a0f9-1a584752d363: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-330ecc9a-745b-493e-a0f9-1a584752d363', 'volume_size': 1} Aug 26 14:44:36 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-3734727d-df8a-4db9-be35-bc0644b1d348 tempest-ProjectReaderTests-937480282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:44:36 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-3734727d-df8a-4db9-be35-bc0644b1d348 tempest-ProjectReaderTests-937480282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:44:36 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-3734727d-df8a-4db9-be35-bc0644b1d348 tempest-ProjectReaderTests-937480282 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T12:44:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1490241050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=330ecc9a-745b-493e-a0f9-1a584752d363,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='622b509f87fb480983ddbd2cef0f7028',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T12:44:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T12:44:36Z,use_quota=True,user_id='0da0653ba4bc4bc8a95bed71e233e3bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79621726-e41a-45b9-9862-cc690aefd710),volume_type_id=79621726-e41a-45b9-9862-cc690aefd710)}" {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 14:44:36 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.remotefs [None req-3734727d-df8a-4db9-be35-bc0644b1d348 tempest-ProjectReaderTests-937480282 None] Creating volume 330ecc9a-745b-493e-a0f9-1a584752d363 {{(pid=94394) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 14:44:36 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-3734727d-df8a-4db9-be35-bc0644b1d348 tempest-ProjectReaderTests-937480282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:44:36 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-3734727d-df8a-4db9-be35-bc0644b1d348 tempest-ProjectReaderTests-937480282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:44:36 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-3734727d-df8a-4db9-be35-bc0644b1d348 tempest-ProjectReaderTests-937480282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:44:36 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-3734727d-df8a-4db9-be35-bc0644b1d348 tempest-ProjectReaderTests-937480282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:44:36 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-3734727d-df8a-4db9-be35-bc0644b1d348 tempest-ProjectReaderTests-937480282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:44:36 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-3734727d-df8a-4db9-be35-bc0644b1d348 tempest-ProjectReaderTests-937480282 None] Selected osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b as target Quobyte volume. {{(pid=94394) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 14:44:36 devstack cinder-volume[94394]: INFO cinder.volume.drivers.remotefs [None req-3734727d-df8a-4db9-be35-bc0644b1d348 tempest-ProjectReaderTests-937480282 None] casted to osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b Aug 26 14:44:36 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-3734727d-df8a-4db9-be35-bc0644b1d348 tempest-ProjectReaderTests-937480282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-330ecc9a-745b-493e-a0f9-1a584752d363 1073741824 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:44:36 devstack sudo[115724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-330ecc9a-745b-493e-a0f9-1a584752d363 1073741824 Aug 26 14:44:36 devstack sudo[115724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:44:36 devstack sudo[115724]: pam_unix(sudo:session): session closed for user root Aug 26 14:44:36 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-3734727d-df8a-4db9-be35-bc0644b1d348 tempest-ProjectReaderTests-937480282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-330ecc9a-745b-493e-a0f9-1a584752d363 1073741824" returned: 0 in 0.406s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:44:36 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-3734727d-df8a-4db9-be35-bc0644b1d348 tempest-ProjectReaderTests-937480282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-330ecc9a-745b-493e-a0f9-1a584752d363 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:44:36 devstack sudo[115730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-330ecc9a-745b-493e-a0f9-1a584752d363 Aug 26 14:44:36 devstack sudo[115730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:44:37 devstack sudo[115730]: pam_unix(sudo:session): session closed for user root Aug 26 14:44:37 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-3734727d-df8a-4db9-be35-bc0644b1d348 tempest-ProjectReaderTests-937480282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-330ecc9a-745b-493e-a0f9-1a584752d363" returned: 0 in 0.240s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:44:37 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-3734727d-df8a-4db9-be35-bc0644b1d348 tempest-ProjectReaderTests-937480282 None] <== create_volume: return (685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'} {{(pid=94394) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 14:44:37 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-3734727d-df8a-4db9-be35-bc0644b1d348 tempest-ProjectReaderTests-937480282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.687s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:44:37 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-3734727d-df8a-4db9-be35-bc0644b1d348 tempest-ProjectReaderTests-937480282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0aa1e105-2257-4ae6-baae-9c0fefcf7570) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-330ecc9a-745b-493e-a0f9-1a584752d363', 'volume_size': 1}' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:44:37 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-3734727d-df8a-4db9-be35-bc0644b1d348 tempest-ProjectReaderTests-937480282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0929a949-b4db-4f50-b345-822ae35ce28f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 14:44:37 devstack cinder-volume[94394]: INFO cinder.volume.flows.manager.create_volume [None req-3734727d-df8a-4db9-be35-bc0644b1d348 tempest-ProjectReaderTests-937480282 None] Volume volume-330ecc9a-745b-493e-a0f9-1a584752d363 (330ecc9a-745b-493e-a0f9-1a584752d363): created successfully Aug 26 14:44:37 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-3734727d-df8a-4db9-be35-bc0644b1d348 tempest-ProjectReaderTests-937480282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0929a949-b4db-4f50-b345-822ae35ce28f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94394) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 14:44:37 devstack cinder-volume[94394]: DEBUG cinder.volume.manager [None req-3734727d-df8a-4db9-be35-bc0644b1d348 tempest-ProjectReaderTests-937480282 None] Flow 'volume_create_manager' (0fac1b08-5149-46bb-8e47-05debe49bd26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94394) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 14:44:37 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-3734727d-df8a-4db9-be35-bc0644b1d348 tempest-ProjectReaderTests-937480282 None] Created volume successfully. Aug 26 14:44:37 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-584b81e5-402f-474f-8de4-bd29e7573b09 tempest-ProjectReaderTests-937480282 None] Acquiring lock "cinder-330ecc9a-745b-493e-a0f9-1a584752d363-delete_volume" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:44:37 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-584b81e5-402f-474f-8de4-bd29e7573b09 tempest-ProjectReaderTests-937480282 None] Lock "cinder-330ecc9a-745b-493e-a0f9-1a584752d363-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:44:37 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-584b81e5-402f-474f-8de4-bd29e7573b09 tempest-ProjectReaderTests-937480282 None] Acquiring lock "cinder-quobyte-330ecc9a-745b-493e-a0f9-1a584752d363" by "delete_volume" {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 14:44:37 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-584b81e5-402f-474f-8de4-bd29e7573b09 tempest-ProjectReaderTests-937480282 None] Lock "cinder-quobyte-330ecc9a-745b-493e-a0f9-1a584752d363" acquired by "delete_volume" :: waited 0.013s {{(pid=94394) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 14:44:37 devstack cinder-volume[94394]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5ca0f62-3fe5-4b07-b05a-9c357607387b]: (4, 'qcow2') {{(pid=95755) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 14:44:37 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-584b81e5-402f-474f-8de4-bd29e7573b09 tempest-ProjectReaderTests-937480282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-330ecc9a-745b-493e-a0f9-1a584752d363 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:44:37 devstack sudo[115733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-330ecc9a-745b-493e-a0f9-1a584752d363 Aug 26 14:44:37 devstack sudo[115733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:44:37 devstack sudo[115733]: pam_unix(sudo:session): session closed for user root Aug 26 14:44:37 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-584b81e5-402f-474f-8de4-bd29e7573b09 tempest-ProjectReaderTests-937480282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-330ecc9a-745b-493e-a0f9-1a584752d363" returned: 0 in 0.340s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:44:37 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-584b81e5-402f-474f-8de4-bd29e7573b09 tempest-ProjectReaderTests-937480282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-330ecc9a-745b-493e-a0f9-1a584752d363 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:44:37 devstack sudo[115738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-330ecc9a-745b-493e-a0f9-1a584752d363 Aug 26 14:44:37 devstack sudo[115738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:44:38 devstack sudo[115738]: pam_unix(sudo:session): session closed for user root Aug 26 14:44:38 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-584b81e5-402f-474f-8de4-bd29e7573b09 tempest-ProjectReaderTests-937480282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4/volume-330ecc9a-745b-493e-a0f9-1a584752d363" returned: 0 in 0.237s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:44:38 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-584b81e5-402f-474f-8de4-bd29e7573b09 tempest-ProjectReaderTests-937480282 None] Lock "cinder-quobyte-330ecc9a-745b-493e-a0f9-1a584752d363" released by "delete_volume" :: held 0.614s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:44:38 devstack cinder-volume[94394]: DEBUG cinder.quota [None req-584b81e5-402f-474f-8de4-bd29e7573b09 tempest-ProjectReaderTests-937480282 None] Created reservations ['355a677b-e3e7-4516-ae29-065b735a9879', '17cb211b-1db8-427c-adaa-a75b08175394', 'e1ef81ef-7e0b-4011-a9ee-45237a4bcd76', 'ae638543-ea07-48d2-bb26-1c62b1e9bcbb'] {{(pid=94394) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 14:44:38 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-584b81e5-402f-474f-8de4-bd29e7573b09 tempest-ProjectReaderTests-937480282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 14:44:38 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-584b81e5-402f-474f-8de4-bd29e7573b09 tempest-ProjectReaderTests-937480282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 14:44:38 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-584b81e5-402f-474f-8de4-bd29e7573b09 tempest-ProjectReaderTests-937480282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b': None} {{(pid=94394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 14:44:38 devstack cinder-volume[94394]: DEBUG cinder.volume.drivers.quobyte [None req-584b81e5-402f-474f-8de4-bd29e7573b09 tempest-ProjectReaderTests-937480282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c6b70ec-9417-4cc3-beaa-4126eac71f3b'] {{(pid=94394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 14:44:38 devstack cinder-volume[94394]: DEBUG oslo_concurrency.lockutils [None req-584b81e5-402f-474f-8de4-bd29e7573b09 tempest-ProjectReaderTests-937480282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94394) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 14:44:38 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-584b81e5-402f-474f-8de4-bd29e7573b09 tempest-ProjectReaderTests-937480282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 14:44:38 devstack sudo[115741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4 Aug 26 14:44:38 devstack sudo[115741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 14:44:38 devstack sudo[115741]: pam_unix(sudo:session): session closed for user root Aug 26 14:44:38 devstack cinder-volume[94394]: DEBUG oslo_concurrency.processutils [None req-584b81e5-402f-474f-8de4-bd29e7573b09 tempest-ProjectReaderTests-937480282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/249da68d11d8308e641a6e4308ba09e4" returned: 0 in 0.241s {{(pid=94394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 14:44:38 devstack cinder-volume[94394]: DEBUG cinder.manager [None req-584b81e5-402f-474f-8de4-bd29e7573b09 tempest-ProjectReaderTests-937480282 None] Notifying Schedulers of capabilities ... {{(pid=94394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 14:44:38 devstack cinder-volume[94394]: INFO cinder.volume.manager [None req-584b81e5-402f-474f-8de4-bd29e7573b09 tempest-ProjectReaderTests-937480282 None] Deleted volume successfully. Aug 26 14:44:38 devstack cinder-volume[94394]: DEBUG cinder.coordination [None req-584b81e5-402f-474f-8de4-bd29e7573b09 tempest-ProjectReaderTests-937480282 None] Lock "cinder-330ecc9a-745b-493e-a0f9-1a584752d363-delete_volume" released by "delete_volume" :: held 1.033s {{(pid=94394) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 14:44:48 devstack cinder-volume[94394]: DEBUG dbcounter [-] [94394] Writing DB stats cinder:UPDATE=69,cinder:SELECT=38,cinder:DELETE=7,cinder:INSERT=13 {{(pid=94394) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 14:44:48 devstack cinder-volume[94394]: DEBUG dbcounter [-] [94394] Writing DB stats cinder:SELECT=46,cinder:INSERT=17,cinder:UPDATE=63,cinder:DELETE=5 {{(pid=94394) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}